[==========] Running 56 tests from 4 test suites.
[----------] Global test environment set-up.
[----------] 30 tests from SecurityITest
[ RUN ] SecurityITest.TestAuthorizationOnListTablets
Loading random data
Initializing database '/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786164000593138-21443-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 04:40:00 dist-test-slave-vxj2 krb5kdc[21450](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 04:40:00 dist-test-slave-vxj2 krb5kdc[21450](info): set up 2 sockets
Aug 08 04:40:00 dist-test-slave-vxj2 krb5kdc[21450](info): commencing operation
krb5kdc: starting...
WARNING: Logging before InitGoogleLogging() is written to STDERR
W20260808 04:40:01.787907 21443 mini_kdc.cc:121] Time spent starting KDC: real 1.122s user 0.001s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786164000593138-21443-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786164000593138-21443-0/krb5kdc/test-user.keytab.
Aug 08 04:40:01 dist-test-slave-vxj2 krb5kdc[21450](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164001, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T04:40:01Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T04:40:01Z Disabled control of system clock
WARNING: no policy specified for kudu/127.20.240.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.240.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.240.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.254.keytab.
Entry for principal kudu/127.20.240.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.254.keytab.
I20260808 04:40:01.921131 21443 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
/tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786164000593138-21443-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786164000593138-21443-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786164000593138-21443-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786164000593138-21443-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.240.254:42157
--webserver_interface=127.20.240.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.254.keytab
--principal=kudu/127.20.240.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.240.212:40713
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.240.254:42157
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786164000593138-21443-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786164000593138-21443-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786164000593138-21443-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 04:40:02.057260 21463 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:40:02.057637 21463 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:40:02.057729 21463 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:40:02.062032 21463 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 04:40:02.062148 21463 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:40:02.062191 21463 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:40:02.062254 21463 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 04:40:02.062314 21463 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 04:40:02.068331 21463 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.240.212:40713
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786164000593138-21443-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786164000593138-21443-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.240.254:42157
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.254.keytab
--principal=kudu/127.20.240.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.240.254:42157
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786164000593138-21443-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.240.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21463
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786164000593138-21443-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 04:05:18 UTC on ccycloud.quasar-drfdgt.root.comops.site
build id 4574101
I20260808 04:40:02.070011 21463 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:40:02.071450 21463 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260808 04:40:02.084669 21463 server_base.cc:1034] running on GCE node
W20260808 04:40:02.084594 21468 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:40:02.085573 21469 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:40:02.085897 21471 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:40:02.086894 21463 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:40:02.088884 21463 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:40:02.090317 21463 hybrid_clock.cc:648] HybridClock initialized: now 1786164002090281 us; error 93 us; skew 500 ppm
Aug 08 04:40:02 dist-test-slave-vxj2 krb5kdc[21450](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164002, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.240.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:40:02.093791 21463 init.cc:377] Logged in from keytab as kudu/127.20.240.254@KRBTEST.COM (short username kudu)
I20260808 04:40:02.095170 21463 webserver.cc:460] Webserver started at http://127.20.240.254:41435/ using document root <none> and password file <none>
I20260808 04:40:02.095844 21463 fs_manager.cc:359] Metadata directory not provided
I20260808 04:40:02.095955 21463 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:40:02.096318 21463 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 04:40:02.098982 21463 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786164000593138-21443-0/minicluster-data/master-0/data/instance:
uuid: "de77b6f12a114a739d4e6070445d331a"
format_stamp: "Formatted at 2026-08-08 04:40:02 on dist-test-slave-vxj2"
server_key: "b3c176a8259e12f37ed5156c8c3b14c0"
server_key_iv: "3428263991af1dac650a8f388f950473"
server_key_version: "encryptionkey@0"
I20260808 04:40:02.099677 21463 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786164000593138-21443-0/minicluster-data/master-0/wal/instance:
uuid: "de77b6f12a114a739d4e6070445d331a"
format_stamp: "Formatted at 2026-08-08 04:40:02 on dist-test-slave-vxj2"
server_key: "b3c176a8259e12f37ed5156c8c3b14c0"
server_key_iv: "3428263991af1dac650a8f388f950473"
server_key_version: "encryptionkey@0"
I20260808 04:40:02.105548 21463 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260808 04:40:02.108677 21480 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:02.110355 21463 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 04:40:02.110662 21463 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786164000593138-21443-0/minicluster-data/master-0/data,/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786164000593138-21443-0/minicluster-data/master-0/wal
uuid: "de77b6f12a114a739d4e6070445d331a"
format_stamp: "Formatted at 2026-08-08 04:40:02 on dist-test-slave-vxj2"
server_key: "b3c176a8259e12f37ed5156c8c3b14c0"
server_key_iv: "3428263991af1dac650a8f388f950473"
server_key_version: "encryptionkey@0"
I20260808 04:40:02.110826 21463 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786164000593138-21443-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786164000593138-21443-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786164000593138-21443-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:40:02.130326 21463 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:40:02.134631 21463 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:40:02.134932 21463 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:40:02.145285 21463 rpc_server.cc:307] RPC server started. Bound to: 127.20.240.254:42157
I20260808 04:40:02.145367 21533 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.240.254:42157 every 8 connection(s)
I20260808 04:40:02.146777 21463 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786164000593138-21443-0/minicluster-data/master-0/data/info.pb
I20260808 04:40:02.150530 21443 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu as pid 21463
I20260808 04:40:02.150748 21443 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786164000593138-21443-0/minicluster-data/master-0/wal/instance
I20260808 04:40:02.152647 21534 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:40:02.152793 21443 external_mini_cluster.cc:1428] Setting key 99eb5c820fb438d954ff3f46a6113eea
I20260808 04:40:02.163007 21534 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P de77b6f12a114a739d4e6070445d331a: Bootstrap starting.
I20260808 04:40:02.167378 21534 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P de77b6f12a114a739d4e6070445d331a: Neither blocks nor log segments found. Creating new log.
I20260808 04:40:02.168668 21534 log.cc:824] T 00000000000000000000000000000000 P de77b6f12a114a739d4e6070445d331a: Log is configured to *not* fsync() on all Append() calls
I20260808 04:40:02.172363 21534 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P de77b6f12a114a739d4e6070445d331a: No bootstrap required, opened a new log
Aug 08 04:40:02 dist-test-slave-vxj2 krb5kdc[21450](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164001, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.240.254@KRBTEST.COM
I20260808 04:40:02.178442 21534 raft_consensus.cc:348] T 00000000000000000000000000000000 P de77b6f12a114a739d4e6070445d331a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "de77b6f12a114a739d4e6070445d331a" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 42157 } }
I20260808 04:40:02.178864 21534 raft_consensus.cc:374] T 00000000000000000000000000000000 P de77b6f12a114a739d4e6070445d331a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:40:02.178982 21534 raft_consensus.cc:729] T 00000000000000000000000000000000 P de77b6f12a114a739d4e6070445d331a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de77b6f12a114a739d4e6070445d331a, State: Initialized, Role: FOLLOWER
I20260808 04:40:02.179970 21534 consensus_queue.cc:260] T 00000000000000000000000000000000 P de77b6f12a114a739d4e6070445d331a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "de77b6f12a114a739d4e6070445d331a" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 42157 } }
I20260808 04:40:02.180291 21534 raft_consensus.cc:388] T 00000000000000000000000000000000 P de77b6f12a114a739d4e6070445d331a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 04:40:02.180434 21534 raft_consensus.cc:482] T 00000000000000000000000000000000 P de77b6f12a114a739d4e6070445d331a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 04:40:02.180605 21534 raft_consensus.cc:3037] T 00000000000000000000000000000000 P de77b6f12a114a739d4e6070445d331a [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:40:02.182191 21534 raft_consensus.cc:504] T 00000000000000000000000000000000 P de77b6f12a114a739d4e6070445d331a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "de77b6f12a114a739d4e6070445d331a" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 42157 } }
I20260808 04:40:02.182933 21534 leader_election.cc:302] T 00000000000000000000000000000000 P de77b6f12a114a739d4e6070445d331a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: de77b6f12a114a739d4e6070445d331a; no voters:
I20260808 04:40:02.183403 21534 leader_election.cc:288] T 00000000000000000000000000000000 P de77b6f12a114a739d4e6070445d331a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 04:40:02.183607 21541 raft_consensus.cc:2781] T 00000000000000000000000000000000 P de77b6f12a114a739d4e6070445d331a [term 1 FOLLOWER]: Leader election won for term 1
I20260808 04:40:02.183867 21541 raft_consensus.cc:686] T 00000000000000000000000000000000 P de77b6f12a114a739d4e6070445d331a [term 1 LEADER]: Becoming Leader. State: Replica: de77b6f12a114a739d4e6070445d331a, State: Running, Role: LEADER
I20260808 04:40:02.184376 21541 consensus_queue.cc:237] T 00000000000000000000000000000000 P de77b6f12a114a739d4e6070445d331a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "de77b6f12a114a739d4e6070445d331a" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 42157 } }
I20260808 04:40:02.185245 21534 sys_catalog.cc:564] T 00000000000000000000000000000000 P de77b6f12a114a739d4e6070445d331a [sys.catalog]: configured and running, proceeding with master startup.
I20260808 04:40:02.187516 21542 sys_catalog.cc:455] T 00000000000000000000000000000000 P de77b6f12a114a739d4e6070445d331a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "de77b6f12a114a739d4e6070445d331a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "de77b6f12a114a739d4e6070445d331a" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 42157 } } }
I20260808 04:40:02.187642 21543 sys_catalog.cc:455] T 00000000000000000000000000000000 P de77b6f12a114a739d4e6070445d331a [sys.catalog]: SysCatalogTable state changed. Reason: New leader de77b6f12a114a739d4e6070445d331a. Latest consensus state: current_term: 1 leader_uuid: "de77b6f12a114a739d4e6070445d331a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "de77b6f12a114a739d4e6070445d331a" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 42157 } } }
I20260808 04:40:02.187726 21542 sys_catalog.cc:458] T 00000000000000000000000000000000 P de77b6f12a114a739d4e6070445d331a [sys.catalog]: This master's current role is: LEADER
I20260808 04:40:02.187739 21543 sys_catalog.cc:458] T 00000000000000000000000000000000 P de77b6f12a114a739d4e6070445d331a [sys.catalog]: This master's current role is: LEADER
I20260808 04:40:02.189296 21537 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:02.158880 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42628 (local address 127.20.240.254:42157)
0808 04:40:02.159550 (+ 670us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:02.159571 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:02.162563 (+ 2992us) server_negotiation.cc:407] Connection header received
0808 04:40:02.166306 (+ 3743us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:02.166336 (+ 30us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:02.166971 (+ 635us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:02.167400 (+ 429us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:02.170166 (+ 2766us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:02.172184 (+ 2018us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:02.173720 (+ 1536us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:02.174599 (+ 879us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:02.174791 (+ 192us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:02.179622 (+ 4831us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:40:02.179666 (+ 44us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:40:02.179685 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:40:02.179756 (+ 71us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:40:02.182499 (+ 2743us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:02.183179 (+ 680us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:02.183187 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:02.183197 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:02.183344 (+ 147us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:02.183859 (+ 515us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:02.183862 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:02.183864 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:02.184817 (+ 953us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:40:02.186482 (+ 1665us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:02.186660 (+ 178us) server_negotiation.cc:299] Negotiation successful
0808 04:40:02.187036 (+ 376us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":398,"thread_start_us":148,"threads_started":1}
W20260808 04:40:02.192742 21556 catalog_manager.cc:1558] T 00000000000000000000000000000000 P de77b6f12a114a739d4e6070445d331a: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 04:40:02.192880 21556 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 04:40:02.193002 21554 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 04:40:02.193984 21554 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 04:40:02.202062 21554 catalog_manager.cc:1347] Generated new cluster ID: 645c370514884324bf3127fde3bad4fb
I20260808 04:40:02.202168 21554 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 04:40:02.219750 21554 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 04:40:02.221402 21554 catalog_manager.cc:1504] Loading token signing keys...
I20260808 04:40:02.230073 21554 catalog_manager.cc:5868] T 00000000000000000000000000000000 P de77b6f12a114a739d4e6070445d331a: Generated new TSK 0
I20260808 04:40:02.231117 21554 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.20.240.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.240.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.240.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.193.keytab.
Entry for principal kudu/127.20.240.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.193.keytab.
I20260808 04:40:02.273643 21443 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
/tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786164000593138-21443-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786164000593138-21443-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786164000593138-21443-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786164000593138-21443-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.240.193:0
--local_ip_for_outbound_sockets=127.20.240.193
--webserver_interface=127.20.240.193
--webserver_port=0
--tserver_master_addrs=127.20.240.254:42157
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.193.keytab
--principal=kudu/127.20.240.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.240.212:40713
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786164000593138-21443-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786164000593138-21443-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786164000593138-21443-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 04:40:02.422152 21562 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:40:02.422472 21562 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:40:02.422572 21562 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:40:02.426903 21562 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:40:02.427006 21562 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:40:02.427116 21562 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.240.193
I20260808 04:40:02.433063 21562 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.240.212:40713
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786164000593138-21443-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786164000593138-21443-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.193.keytab
--principal=kudu/127.20.240.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.240.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786164000593138-21443-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.240.193
--webserver_port=0
--tserver_master_addrs=127.20.240.254:42157
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21562
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.240.193
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786164000593138-21443-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 04:05:18 UTC on ccycloud.quasar-drfdgt.root.comops.site
build id 4574101
I20260808 04:40:02.434394 21562 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:40:02.435508 21562 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:40:02.447118 21568 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:40:02.447118 21569 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:40:02.447118 21571 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:40:02.447175 21562 server_base.cc:1034] running on GCE node
I20260808 04:40:02.447866 21562 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:40:02.448629 21562 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:40:02.449824 21562 hybrid_clock.cc:648] HybridClock initialized: now 1786164002449809 us; error 26 us; skew 500 ppm
Aug 08 04:40:02 dist-test-slave-vxj2 krb5kdc[21450](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164002, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.240.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:40:02.453101 21562 init.cc:377] Logged in from keytab as kudu/127.20.240.193@KRBTEST.COM (short username kudu)
I20260808 04:40:02.454123 21562 webserver.cc:460] Webserver started at http://127.20.240.193:43911/ using document root <none> and password file <none>
I20260808 04:40:02.454731 21562 fs_manager.cc:359] Metadata directory not provided
I20260808 04:40:02.454828 21562 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:40:02.455092 21562 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 04:40:02.457460 21562 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786164000593138-21443-0/minicluster-data/ts-0/data/instance:
uuid: "4e5274dabe2f4deab835c2a989337c1e"
format_stamp: "Formatted at 2026-08-08 04:40:02 on dist-test-slave-vxj2"
server_key: "3796d74ea508c06acfca7bed6d6eed13"
server_key_iv: "93b1c3fe6af17fbb040ac7033a97bc58"
server_key_version: "encryptionkey@0"
I20260808 04:40:02.458143 21562 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786164000593138-21443-0/minicluster-data/ts-0/wal/instance:
uuid: "4e5274dabe2f4deab835c2a989337c1e"
format_stamp: "Formatted at 2026-08-08 04:40:02 on dist-test-slave-vxj2"
server_key: "3796d74ea508c06acfca7bed6d6eed13"
server_key_iv: "93b1c3fe6af17fbb040ac7033a97bc58"
server_key_version: "encryptionkey@0"
I20260808 04:40:02.462752 21562 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260808 04:40:02.465454 21579 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:02.466782 21562 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 04:40:02.466956 21562 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786164000593138-21443-0/minicluster-data/ts-0/data,/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786164000593138-21443-0/minicluster-data/ts-0/wal
uuid: "4e5274dabe2f4deab835c2a989337c1e"
format_stamp: "Formatted at 2026-08-08 04:40:02 on dist-test-slave-vxj2"
server_key: "3796d74ea508c06acfca7bed6d6eed13"
server_key_iv: "93b1c3fe6af17fbb040ac7033a97bc58"
server_key_version: "encryptionkey@0"
I20260808 04:40:02.467093 21562 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786164000593138-21443-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786164000593138-21443-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786164000593138-21443-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:40:02.484771 21562 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:40:02.488699 21562 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:40:02.488924 21562 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:40:02.489764 21562 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 04:40:02.491014 21562 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 04:40:02.491098 21562 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:02.491171 21562 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 04:40:02.491223 21562 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:02.503741 21562 rpc_server.cc:307] RPC server started. Bound to: 127.20.240.193:38417
I20260808 04:40:02.503763 21700 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.240.193:38417 every 8 connection(s)
I20260808 04:40:02.504676 21562 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786164000593138-21443-0/minicluster-data/ts-0/data/info.pb
I20260808 04:40:02.512287 21443 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu as pid 21562
I20260808 04:40:02.512424 21443 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786164000593138-21443-0/minicluster-data/ts-0/wal/instance
I20260808 04:40:02.512748 21443 external_mini_cluster.cc:1428] Setting key 1dbcfd648f22ea40e5e051c74744c739
Aug 08 04:40:02 dist-test-slave-vxj2 krb5kdc[21450](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164002, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.240.193@KRBTEST.COM for kudu/127.20.240.254@KRBTEST.COM
I20260808 04:40:02.521683 21537 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:02.507109 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.240.193:41137 (local address 127.20.240.254:42157)
0808 04:40:02.507258 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:02.507262 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:02.508659 (+ 1397us) server_negotiation.cc:407] Connection header received
0808 04:40:02.510017 (+ 1358us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:02.510021 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:02.510082 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:02.510170 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:02.511654 (+ 1484us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:02.512203 (+ 549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:02.513770 (+ 1567us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:02.514044 (+ 274us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:02.514163 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:02.517542 (+ 3379us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:40:02.517545 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:40:02.517548 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:40:02.517573 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:40:02.519117 (+ 1544us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:02.519844 (+ 727us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:02.519846 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:02.519848 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:02.519927 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:02.520386 (+ 459us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:02.520388 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:02.520390 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:02.520578 (+ 188us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:40:02.520666 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:02.521441 (+ 775us) server_negotiation.cc:299] Negotiation successful
0808 04:40:02.521552 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":31,"server-negotiator.queue_time_us":60}
I20260808 04:40:02.523026 21703 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:02.507506 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:42157 (local address 127.20.240.193:41137)
0808 04:40:02.508499 (+ 993us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:02.508543 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:02.509614 (+ 1071us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:02.510350 (+ 736us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:02.510357 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:02.510881 (+ 524us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:40:02.511491 (+ 610us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:02.511507 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:02.512355 (+ 848us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:02.512359 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:02.513642 (+ 1283us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:02.513652 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:02.514234 (+ 582us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:02.514237 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:02.514465 (+ 228us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:02.515116 (+ 651us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:40:02.515144 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:40:02.517338 (+ 2194us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:40:02.519242 (+ 1904us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:02.519250 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:02.519277 (+ 27us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:02.519680 (+ 403us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:02.520027 (+ 347us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:02.520033 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:02.520038 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:02.520253 (+ 215us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:02.520698 (+ 445us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:40:02.520708 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:40:02.521079 (+ 371us) client_negotiation.cc:769] Sending connection context
0808 04:40:02.521379 (+ 300us) client_negotiation.cc:240] Negotiation successful
0808 04:40:02.521770 (+ 391us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":811,"thread_start_us":642,"threads_started":1}
WARNING: no policy specified for kudu/127.20.240.194@KRBTEST.COM; defaulting to no policy
I20260808 04:40:02.524626 21701 heartbeater.cc:347] Connected to a master server at 127.20.240.254:42157
I20260808 04:40:02.525000 21701 heartbeater.cc:464] Registering TS with master...
I20260808 04:40:02.525589 21701 heartbeater.cc:511] Master 127.20.240.254:42157 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.240.194@KRBTEST.COM" created.
I20260808 04:40:02.527765 21496 ts_manager.cc:194] Registered new tserver with Master: 4e5274dabe2f4deab835c2a989337c1e (127.20.240.193:38417)
I20260808 04:40:02.529990 21496 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.240.193@KRBTEST.COM'} at 127.20.240.193:41137
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.240.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.194.keytab.
Entry for principal kudu/127.20.240.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.194.keytab.
I20260808 04:40:02.544687 21443 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
/tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786164000593138-21443-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786164000593138-21443-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786164000593138-21443-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786164000593138-21443-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.240.194:0
--local_ip_for_outbound_sockets=127.20.240.194
--webserver_interface=127.20.240.194
--webserver_port=0
--tserver_master_addrs=127.20.240.254:42157
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.194.keytab
--principal=kudu/127.20.240.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.240.212:40713
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786164000593138-21443-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786164000593138-21443-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786164000593138-21443-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 04:40:02.674558 21706 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:40:02.674844 21706 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:40:02.674890 21706 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:40:02.679253 21706 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:40:02.679334 21706 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:40:02.679399 21706 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.240.194
I20260808 04:40:02.685375 21706 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.240.212:40713
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786164000593138-21443-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786164000593138-21443-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.194.keytab
--principal=kudu/127.20.240.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.240.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786164000593138-21443-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.240.194
--webserver_port=0
--tserver_master_addrs=127.20.240.254:42157
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21706
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.240.194
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786164000593138-21443-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 04:05:18 UTC on ccycloud.quasar-drfdgt.root.comops.site
build id 4574101
I20260808 04:40:02.686510 21706 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:40:02.687628 21706 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:40:02.697774 21711 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:40:02.697899 21712 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:40:02.697774 21714 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:40:02.698069 21706 server_base.cc:1034] running on GCE node
I20260808 04:40:02.698724 21706 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:40:02.699476 21706 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:40:02.700680 21706 hybrid_clock.cc:648] HybridClock initialized: now 1786164002700645 us; error 46 us; skew 500 ppm
Aug 08 04:40:02 dist-test-slave-vxj2 krb5kdc[21450](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164002, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.240.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:40:02.704120 21706 init.cc:377] Logged in from keytab as kudu/127.20.240.194@KRBTEST.COM (short username kudu)
I20260808 04:40:02.705118 21706 webserver.cc:460] Webserver started at http://127.20.240.194:34039/ using document root <none> and password file <none>
I20260808 04:40:02.705772 21706 fs_manager.cc:359] Metadata directory not provided
I20260808 04:40:02.705871 21706 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:40:02.706132 21706 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 04:40:02.708449 21706 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786164000593138-21443-0/minicluster-data/ts-1/data/instance:
uuid: "b3f8c231aab346c69c315d420da32e3e"
format_stamp: "Formatted at 2026-08-08 04:40:02 on dist-test-slave-vxj2"
server_key: "480b4d6423249aab2cfdf6873a8b6ab4"
server_key_iv: "9bc5bd937c94907f6a6d5390398f5260"
server_key_version: "encryptionkey@0"
I20260808 04:40:02.709144 21706 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786164000593138-21443-0/minicluster-data/ts-1/wal/instance:
uuid: "b3f8c231aab346c69c315d420da32e3e"
format_stamp: "Formatted at 2026-08-08 04:40:02 on dist-test-slave-vxj2"
server_key: "480b4d6423249aab2cfdf6873a8b6ab4"
server_key_iv: "9bc5bd937c94907f6a6d5390398f5260"
server_key_version: "encryptionkey@0"
I20260808 04:40:02.713801 21706 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20260808 04:40:02.716895 21722 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:02.718297 21706 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 04:40:02.718449 21706 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786164000593138-21443-0/minicluster-data/ts-1/data,/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786164000593138-21443-0/minicluster-data/ts-1/wal
uuid: "b3f8c231aab346c69c315d420da32e3e"
format_stamp: "Formatted at 2026-08-08 04:40:02 on dist-test-slave-vxj2"
server_key: "480b4d6423249aab2cfdf6873a8b6ab4"
server_key_iv: "9bc5bd937c94907f6a6d5390398f5260"
server_key_version: "encryptionkey@0"
I20260808 04:40:02.718580 21706 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786164000593138-21443-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786164000593138-21443-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786164000593138-21443-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:40:02.736358 21706 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:40:02.739789 21706 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:40:02.739971 21706 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:40:02.740653 21706 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 04:40:02.741639 21706 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 04:40:02.741691 21706 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:02.741732 21706 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 04:40:02.741756 21706 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:02.751827 21706 rpc_server.cc:307] RPC server started. Bound to: 127.20.240.194:33739
I20260808 04:40:02.751845 21839 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.240.194:33739 every 8 connection(s)
I20260808 04:40:02.752816 21706 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786164000593138-21443-0/minicluster-data/ts-1/data/info.pb
I20260808 04:40:02.762434 21443 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu as pid 21706
I20260808 04:40:02.762555 21443 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786164000593138-21443-0/minicluster-data/ts-1/wal/instance
I20260808 04:40:02.762930 21443 external_mini_cluster.cc:1428] Setting key 6221674e090eb08106d7dcad10a1409e
Aug 08 04:40:02 dist-test-slave-vxj2 krb5kdc[21450](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164002, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.240.194@KRBTEST.COM for kudu/127.20.240.254@KRBTEST.COM
I20260808 04:40:02.767791 21537 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:02.754894 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.240.194:48779 (local address 127.20.240.254:42157)
0808 04:40:02.755031 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:02.755036 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:02.755886 (+ 850us) server_negotiation.cc:407] Connection header received
0808 04:40:02.757475 (+ 1589us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:02.757479 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:02.757542 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:02.757647 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:02.758895 (+ 1248us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:02.759429 (+ 534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:02.760584 (+ 1155us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:02.760807 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:02.760921 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:02.764103 (+ 3182us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:40:02.764107 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:40:02.764110 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:40:02.764134 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:40:02.765684 (+ 1550us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:02.766232 (+ 548us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:02.766242 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:02.766244 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:02.766320 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:02.766692 (+ 372us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:02.766696 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:02.766698 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:02.766888 (+ 190us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:40:02.766999 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:02.767503 (+ 504us) server_negotiation.cc:299] Negotiation successful
0808 04:40:02.767627 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260808 04:40:02.768651 21842 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:02.755170 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:42157 (local address 127.20.240.194:48779)
0808 04:40:02.755614 (+ 444us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:02.755657 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:02.757251 (+ 1594us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:02.757840 (+ 589us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:02.757847 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:02.758250 (+ 403us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:40:02.758733 (+ 483us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:02.758746 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:02.759556 (+ 810us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:02.759560 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:02.760450 (+ 890us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:02.760460 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:02.760962 (+ 502us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:02.760966 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:02.761269 (+ 303us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:02.761918 (+ 649us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:40:02.761935 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:40:02.763938 (+ 2003us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:40:02.765811 (+ 1873us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:02.765817 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:02.765834 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:02.766116 (+ 282us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:02.766427 (+ 311us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:02.766430 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:02.766432 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:02.766588 (+ 156us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:02.766998 (+ 410us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:40:02.767004 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:40:02.767262 (+ 258us) client_negotiation.cc:769] Sending connection context
0808 04:40:02.767462 (+ 200us) client_negotiation.cc:240] Negotiation successful
0808 04:40:02.767794 (+ 332us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":268,"thread_start_us":130,"threads_started":1}
I20260808 04:40:02.770056 21840 heartbeater.cc:347] Connected to a master server at 127.20.240.254:42157
I20260808 04:40:02.770313 21840 heartbeater.cc:464] Registering TS with master...
I20260808 04:40:02.770896 21840 heartbeater.cc:511] Master 127.20.240.254:42157 requested a full tablet report, sending...
I20260808 04:40:02.772066 21496 ts_manager.cc:194] Registered new tserver with Master: b3f8c231aab346c69c315d420da32e3e (127.20.240.194:33739)
I20260808 04:40:02.772680 21496 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.240.194@KRBTEST.COM'} at 127.20.240.194:48779
WARNING: no policy specified for kudu/127.20.240.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.240.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.240.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.195.keytab.
Entry for principal kudu/127.20.240.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.195.keytab.
I20260808 04:40:02.792933 21443 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
/tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786164000593138-21443-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786164000593138-21443-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786164000593138-21443-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786164000593138-21443-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.240.195:0
--local_ip_for_outbound_sockets=127.20.240.195
--webserver_interface=127.20.240.195
--webserver_port=0
--tserver_master_addrs=127.20.240.254:42157
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.195.keytab
--principal=kudu/127.20.240.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.240.212:40713
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786164000593138-21443-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786164000593138-21443-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786164000593138-21443-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 04:40:02.921116 21845 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:40:02.921458 21845 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:40:02.921511 21845 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:40:02.925863 21845 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:40:02.925943 21845 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:40:02.926060 21845 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.240.195
I20260808 04:40:02.931897 21845 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.240.212:40713
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786164000593138-21443-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786164000593138-21443-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.195.keytab
--principal=kudu/127.20.240.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.240.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786164000593138-21443-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.240.195
--webserver_port=0
--tserver_master_addrs=127.20.240.254:42157
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21845
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.240.195
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786164000593138-21443-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 04:05:18 UTC on ccycloud.quasar-drfdgt.root.comops.site
build id 4574101
I20260808 04:40:02.933122 21845 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:40:02.934309 21845 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:40:02.946456 21851 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:40:02.947342 21850 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:40:02.948258 21845 server_base.cc:1034] running on GCE node
W20260808 04:40:02.948673 21853 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:40:02.949741 21845 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:40:02.950929 21845 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:40:02.952204 21845 hybrid_clock.cc:648] HybridClock initialized: now 1786164002952162 us; error 45 us; skew 500 ppm
Aug 08 04:40:02 dist-test-slave-vxj2 krb5kdc[21450](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164002, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.240.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:40:02.955430 21845 init.cc:377] Logged in from keytab as kudu/127.20.240.195@KRBTEST.COM (short username kudu)
I20260808 04:40:02.956413 21845 webserver.cc:460] Webserver started at http://127.20.240.195:41233/ using document root <none> and password file <none>
I20260808 04:40:02.956974 21845 fs_manager.cc:359] Metadata directory not provided
I20260808 04:40:02.957034 21845 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:40:02.957304 21845 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 04:40:02.959646 21845 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786164000593138-21443-0/minicluster-data/ts-2/data/instance:
uuid: "3096a824b8e241e4b08994b7aa3d7b29"
format_stamp: "Formatted at 2026-08-08 04:40:02 on dist-test-slave-vxj2"
server_key: "718f7d68f1b1228133b00a5b837fefa7"
server_key_iv: "1fb6336e8d2afa0f5eb24af2541c58fc"
server_key_version: "encryptionkey@0"
I20260808 04:40:02.960315 21845 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786164000593138-21443-0/minicluster-data/ts-2/wal/instance:
uuid: "3096a824b8e241e4b08994b7aa3d7b29"
format_stamp: "Formatted at 2026-08-08 04:40:02 on dist-test-slave-vxj2"
server_key: "718f7d68f1b1228133b00a5b837fefa7"
server_key_iv: "1fb6336e8d2afa0f5eb24af2541c58fc"
server_key_version: "encryptionkey@0"
I20260808 04:40:02.964718 21845 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.001s
I20260808 04:40:02.967846 21861 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:02.969444 21845 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 04:40:02.969581 21845 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786164000593138-21443-0/minicluster-data/ts-2/data,/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786164000593138-21443-0/minicluster-data/ts-2/wal
uuid: "3096a824b8e241e4b08994b7aa3d7b29"
format_stamp: "Formatted at 2026-08-08 04:40:02 on dist-test-slave-vxj2"
server_key: "718f7d68f1b1228133b00a5b837fefa7"
server_key_iv: "1fb6336e8d2afa0f5eb24af2541c58fc"
server_key_version: "encryptionkey@0"
I20260808 04:40:02.969717 21845 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786164000593138-21443-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786164000593138-21443-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786164000593138-21443-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:40:02.998245 21845 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:40:03.002058 21845 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:40:03.002302 21845 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:40:03.003103 21845 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 04:40:03.004136 21845 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 04:40:03.004210 21845 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:03.004288 21845 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 04:40:03.004331 21845 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:03.018363 21845 rpc_server.cc:307] RPC server started. Bound to: 127.20.240.195:46581
I20260808 04:40:03.018388 21980 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.240.195:46581 every 8 connection(s)
I20260808 04:40:03.019397 21845 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786164000593138-21443-0/minicluster-data/ts-2/data/info.pb
I20260808 04:40:03.022706 21443 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu as pid 21845
I20260808 04:40:03.022825 21443 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786164000593138-21443-0/minicluster-data/ts-2/wal/instance
I20260808 04:40:03.023118 21443 external_mini_cluster.cc:1428] Setting key 5ba55742db9b08ab199a2071a955c58d
Aug 08 04:40:03 dist-test-slave-vxj2 krb5kdc[21450](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164002, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.240.195@KRBTEST.COM for kudu/127.20.240.254@KRBTEST.COM
I20260808 04:40:03.035039 21537 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:03.021340 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.240.195:46613 (local address 127.20.240.254:42157)
0808 04:40:03.021525 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:03.021530 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:03.022569 (+ 1039us) server_negotiation.cc:407] Connection header received
0808 04:40:03.024418 (+ 1849us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:03.024421 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:03.024478 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:03.024564 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:03.026137 (+ 1573us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:03.026734 (+ 597us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:03.028133 (+ 1399us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:03.028340 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:03.028422 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:03.031308 (+ 2886us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:40:03.031311 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:40:03.031313 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:40:03.031339 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:40:03.032816 (+ 1477us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:03.033475 (+ 659us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:03.033478 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:03.033479 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:03.033562 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:03.033879 (+ 317us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:03.033881 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:03.033882 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:03.034060 (+ 178us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:40:03.034135 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:03.034706 (+ 571us) server_negotiation.cc:299] Negotiation successful
0808 04:40:03.034891 (+ 185us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260808 04:40:03.035998 21983 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:03.021708 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:42157 (local address 127.20.240.195:46613)
0808 04:40:03.022399 (+ 691us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:03.022463 (+ 64us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:03.024172 (+ 1709us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:03.024747 (+ 575us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:03.024755 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:03.025287 (+ 532us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:40:03.025958 (+ 671us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:03.025977 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:03.026846 (+ 869us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:03.026849 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:03.028012 (+ 1163us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:03.028022 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:03.028498 (+ 476us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:03.028501 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:03.028706 (+ 205us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:03.029414 (+ 708us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:40:03.029431 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:40:03.031113 (+ 1682us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:40:03.032943 (+ 1830us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:03.032948 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:03.032961 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:03.033358 (+ 397us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:03.033649 (+ 291us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:03.033651 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:03.033652 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:03.033790 (+ 138us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:03.034166 (+ 376us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:40:03.034171 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:40:03.034455 (+ 284us) client_negotiation.cc:769] Sending connection context
0808 04:40:03.034616 (+ 161us) client_negotiation.cc:240] Negotiation successful
0808 04:40:03.035044 (+ 428us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":348,"thread_start_us":190,"threads_started":1}
I20260808 04:40:03.037303 21981 heartbeater.cc:347] Connected to a master server at 127.20.240.254:42157
I20260808 04:40:03.037616 21981 heartbeater.cc:464] Registering TS with master...
I20260808 04:40:03.038225 21981 heartbeater.cc:511] Master 127.20.240.254:42157 requested a full tablet report, sending...
I20260808 04:40:03.039310 21496 ts_manager.cc:194] Registered new tserver with Master: 3096a824b8e241e4b08994b7aa3d7b29 (127.20.240.195:46581)
I20260808 04:40:03.039933 21496 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.240.195@KRBTEST.COM'} at 127.20.240.195:46613
I20260808 04:40:03.051579 21443 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 08 04:40:03 dist-test-slave-vxj2 krb5kdc[21450](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164003, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 08 04:40:03 dist-test-slave-vxj2 krb5kdc[21450](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164003, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.20.240.193@KRBTEST.COM
I20260808 04:40:03.080570 21988 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:03.070168 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35832 (local address 127.20.240.193:38417)
0808 04:40:03.070524 (+ 356us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:03.070532 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:03.070562 (+ 30us) server_negotiation.cc:407] Connection header received
0808 04:40:03.070683 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:03.070698 (+ 15us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:03.070903 (+ 205us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:03.071068 (+ 165us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:03.071827 (+ 759us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:03.072667 (+ 840us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:03.073670 (+ 1003us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:03.074246 (+ 576us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:03.074352 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:03.076957 (+ 2605us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:40:03.076968 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:40:03.076983 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:40:03.077009 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:40:03.078817 (+ 1808us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:03.079222 (+ 405us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:03.079227 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:03.079229 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:03.079328 (+ 99us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:03.079559 (+ 231us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:03.079561 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:03.079562 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:03.079807 (+ 245us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:40:03.079991 (+ 184us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:03.080174 (+ 183us) server_negotiation.cc:299] Negotiation successful
0808 04:40:03.080384 (+ 210us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":238,"thread_start_us":111,"threads_started":1}
W20260808 04:40:03.081669 21607 server_base.cc:1116] Unauthorized access attempt to method kudu.tserver.TabletServerService.ListTablets from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:35832
Aug 08 04:40:03 dist-test-slave-vxj2 krb5kdc[21450](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164003, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 08 04:40:03 dist-test-slave-vxj2 krb5kdc[21450](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164003, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.240.193@KRBTEST.COM
I20260808 04:40:03.108374 21988 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:03.099848 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35840 (local address 127.20.240.193:38417)
0808 04:40:03.100060 (+ 212us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:03.100063 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:03.100123 (+ 60us) server_negotiation.cc:407] Connection header received
0808 04:40:03.100240 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:03.100243 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:03.100303 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:03.100376 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:03.101070 (+ 694us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:03.101642 (+ 572us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:03.102503 (+ 861us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:03.102741 (+ 238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:03.102849 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:03.105459 (+ 2610us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:40:03.105463 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:40:03.105465 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:40:03.105491 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:40:03.106798 (+ 1307us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:03.107204 (+ 406us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:03.107206 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:03.107207 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:03.107296 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:03.107530 (+ 234us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:03.107532 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:03.107533 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:03.107697 (+ 164us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:40:03.107805 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:03.108007 (+ 202us) server_negotiation.cc:299] Negotiation successful
0808 04:40:03.108114 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":95}
I20260808 04:40:03.109712 21443 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu with pid 21562
I20260808 04:40:03.117276 21443 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu with pid 21706
I20260808 04:40:03.124305 21443 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu with pid 21845
I20260808 04:40:03.131688 21443 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu with pid 21463
2026-08-08T04:40:03Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnListTablets (2502 ms)
[ RUN ] SecurityITest.TestAuthorizationOnChecksum
Loading random data
Initializing database '/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786164000593138-21443-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 04:40:03 dist-test-slave-vxj2 krb5kdc[21995](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 04:40:03 dist-test-slave-vxj2 krb5kdc[21995](info): set up 2 sockets
Aug 08 04:40:03 dist-test-slave-vxj2 krb5kdc[21995](info): commencing operation
krb5kdc: starting...
W20260808 04:40:04.233235 21443 mini_kdc.cc:121] Time spent starting KDC: real 1.077s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786164000593138-21443-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786164000593138-21443-0/krb5kdc/test-user.keytab.
Aug 08 04:40:04 dist-test-slave-vxj2 krb5kdc[21995](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164004, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T04:40:04Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T04:40:04Z Disabled control of system clock
WARNING: no policy specified for kudu/127.20.240.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.240.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.240.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.254.keytab.
Entry for principal kudu/127.20.240.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.254.keytab.
I20260808 04:40:04.360978 21443 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
/tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786164000593138-21443-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786164000593138-21443-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786164000593138-21443-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786164000593138-21443-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.240.254:33123
--webserver_interface=127.20.240.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.254.keytab
--principal=kudu/127.20.240.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.240.212:37197
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.240.254:33123
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786164000593138-21443-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786164000593138-21443-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786164000593138-21443-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 04:40:04.474136 22009 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:40:04.474423 22009 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:40:04.474466 22009 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:40:04.478716 22009 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 04:40:04.478775 22009 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:40:04.478796 22009 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:40:04.478813 22009 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 04:40:04.478828 22009 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 04:40:04.484262 22009 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.240.212:37197
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786164000593138-21443-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786164000593138-21443-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.240.254:33123
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.254.keytab
--principal=kudu/127.20.240.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.240.254:33123
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786164000593138-21443-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.240.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22009
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786164000593138-21443-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 04:05:18 UTC on ccycloud.quasar-drfdgt.root.comops.site
build id 4574101
I20260808 04:40:04.485448 22009 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:40:04.486565 22009 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:40:04.495364 22015 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:40:04.495378 22014 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:40:04.495370 22018 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:40:04.495790 22009 server_base.cc:1034] running on GCE node
I20260808 04:40:04.496325 22009 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:40:04.497541 22009 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:40:04.498713 22009 hybrid_clock.cc:648] HybridClock initialized: now 1786164004498683 us; error 41 us; skew 500 ppm
Aug 08 04:40:04 dist-test-slave-vxj2 krb5kdc[21995](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164004, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.240.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:40:04.505263 22009 init.cc:377] Logged in from keytab as kudu/127.20.240.254@KRBTEST.COM (short username kudu)
I20260808 04:40:04.506203 22009 webserver.cc:460] Webserver started at http://127.20.240.254:38859/ using document root <none> and password file <none>
I20260808 04:40:04.506778 22009 fs_manager.cc:359] Metadata directory not provided
I20260808 04:40:04.506841 22009 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:40:04.507021 22009 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 04:40:04.509111 22009 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786164000593138-21443-0/minicluster-data/master-0/data/instance:
uuid: "a990556d2dec413dbdc9cf5cac385bd0"
format_stamp: "Formatted at 2026-08-08 04:40:04 on dist-test-slave-vxj2"
server_key: "33ce72586a1eb567cdea026280409f27"
server_key_iv: "a32bbee6569f932107a024f2d005a6f0"
server_key_version: "encryptionkey@0"
I20260808 04:40:04.509848 22009 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786164000593138-21443-0/minicluster-data/master-0/wal/instance:
uuid: "a990556d2dec413dbdc9cf5cac385bd0"
format_stamp: "Formatted at 2026-08-08 04:40:04 on dist-test-slave-vxj2"
server_key: "33ce72586a1eb567cdea026280409f27"
server_key_iv: "a32bbee6569f932107a024f2d005a6f0"
server_key_version: "encryptionkey@0"
I20260808 04:40:04.514051 22009 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260808 04:40:04.516577 22026 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:04.518082 22009 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 04:40:04.518229 22009 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786164000593138-21443-0/minicluster-data/master-0/data,/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786164000593138-21443-0/minicluster-data/master-0/wal
uuid: "a990556d2dec413dbdc9cf5cac385bd0"
format_stamp: "Formatted at 2026-08-08 04:40:04 on dist-test-slave-vxj2"
server_key: "33ce72586a1eb567cdea026280409f27"
server_key_iv: "a32bbee6569f932107a024f2d005a6f0"
server_key_version: "encryptionkey@0"
I20260808 04:40:04.518362 22009 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786164000593138-21443-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786164000593138-21443-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786164000593138-21443-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:40:04.532929 22009 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:40:04.536219 22009 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:40:04.536448 22009 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:40:04.543860 22009 rpc_server.cc:307] RPC server started. Bound to: 127.20.240.254:33123
I20260808 04:40:04.543929 22083 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.240.254:33123 every 8 connection(s)
I20260808 04:40:04.544929 22009 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786164000593138-21443-0/minicluster-data/master-0/data/info.pb
I20260808 04:40:04.548065 21443 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu as pid 22009
I20260808 04:40:04.548175 21443 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786164000593138-21443-0/minicluster-data/master-0/wal/instance
I20260808 04:40:04.548120 22084 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:40:04.548465 21443 external_mini_cluster.cc:1428] Setting key 19e4587240349f4de7c02848aa6ab50d
I20260808 04:40:04.556017 22084 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a990556d2dec413dbdc9cf5cac385bd0: Bootstrap starting.
I20260808 04:40:04.559017 22084 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a990556d2dec413dbdc9cf5cac385bd0: Neither blocks nor log segments found. Creating new log.
Aug 08 04:40:04 dist-test-slave-vxj2 krb5kdc[21995](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164004, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.240.254@KRBTEST.COM
I20260808 04:40:04.559945 22084 log.cc:824] T 00000000000000000000000000000000 P a990556d2dec413dbdc9cf5cac385bd0: Log is configured to *not* fsync() on all Append() calls
I20260808 04:40:04.562781 22084 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a990556d2dec413dbdc9cf5cac385bd0: No bootstrap required, opened a new log
I20260808 04:40:04.565399 22087 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:04.550013 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35372 (local address 127.20.240.254:33123)
0808 04:40:04.550509 (+ 496us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:04.550530 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:04.550613 (+ 83us) server_negotiation.cc:407] Connection header received
0808 04:40:04.551857 (+ 1244us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:04.551884 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:04.552355 (+ 471us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:04.552749 (+ 394us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:04.553523 (+ 774us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:04.555129 (+ 1606us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:04.556100 (+ 971us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:04.556792 (+ 692us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:04.556964 (+ 172us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:04.559836 (+ 2872us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:40:04.559843 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:40:04.559861 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:40:04.559897 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:40:04.562043 (+ 2146us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:04.562528 (+ 485us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:04.562534 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:04.562540 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:04.562686 (+ 146us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:04.563026 (+ 340us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:04.563029 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:04.563031 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:04.563568 (+ 537us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:40:04.563773 (+ 205us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:04.563986 (+ 213us) server_negotiation.cc:299] Negotiation successful
0808 04:40:04.564291 (+ 305us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":318,"thread_start_us":122,"threads_started":1}
I20260808 04:40:04.567731 22084 raft_consensus.cc:348] T 00000000000000000000000000000000 P a990556d2dec413dbdc9cf5cac385bd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a990556d2dec413dbdc9cf5cac385bd0" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 33123 } }
I20260808 04:40:04.568084 22084 raft_consensus.cc:374] T 00000000000000000000000000000000 P a990556d2dec413dbdc9cf5cac385bd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:40:04.568151 22084 raft_consensus.cc:729] T 00000000000000000000000000000000 P a990556d2dec413dbdc9cf5cac385bd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a990556d2dec413dbdc9cf5cac385bd0, State: Initialized, Role: FOLLOWER
I20260808 04:40:04.568634 22084 consensus_queue.cc:260] T 00000000000000000000000000000000 P a990556d2dec413dbdc9cf5cac385bd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a990556d2dec413dbdc9cf5cac385bd0" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 33123 } }
I20260808 04:40:04.568766 22084 raft_consensus.cc:388] T 00000000000000000000000000000000 P a990556d2dec413dbdc9cf5cac385bd0 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 04:40:04.568814 22084 raft_consensus.cc:482] T 00000000000000000000000000000000 P a990556d2dec413dbdc9cf5cac385bd0 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 04:40:04.568888 22084 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a990556d2dec413dbdc9cf5cac385bd0 [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:40:04.569903 22084 raft_consensus.cc:504] T 00000000000000000000000000000000 P a990556d2dec413dbdc9cf5cac385bd0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a990556d2dec413dbdc9cf5cac385bd0" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 33123 } }
I20260808 04:40:04.570212 22084 leader_election.cc:302] T 00000000000000000000000000000000 P a990556d2dec413dbdc9cf5cac385bd0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a990556d2dec413dbdc9cf5cac385bd0; no voters:
I20260808 04:40:04.570559 22084 leader_election.cc:288] T 00000000000000000000000000000000 P a990556d2dec413dbdc9cf5cac385bd0 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 04:40:04.570703 22089 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a990556d2dec413dbdc9cf5cac385bd0 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 04:40:04.570986 22089 raft_consensus.cc:686] T 00000000000000000000000000000000 P a990556d2dec413dbdc9cf5cac385bd0 [term 1 LEADER]: Becoming Leader. State: Replica: a990556d2dec413dbdc9cf5cac385bd0, State: Running, Role: LEADER
I20260808 04:40:04.571297 22089 consensus_queue.cc:237] T 00000000000000000000000000000000 P a990556d2dec413dbdc9cf5cac385bd0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a990556d2dec413dbdc9cf5cac385bd0" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 33123 } }
I20260808 04:40:04.571905 22084 sys_catalog.cc:564] T 00000000000000000000000000000000 P a990556d2dec413dbdc9cf5cac385bd0 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 04:40:04.573240 22090 sys_catalog.cc:455] T 00000000000000000000000000000000 P a990556d2dec413dbdc9cf5cac385bd0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a990556d2dec413dbdc9cf5cac385bd0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a990556d2dec413dbdc9cf5cac385bd0" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 33123 } } }
I20260808 04:40:04.573381 22090 sys_catalog.cc:458] T 00000000000000000000000000000000 P a990556d2dec413dbdc9cf5cac385bd0 [sys.catalog]: This master's current role is: LEADER
I20260808 04:40:04.573684 22091 sys_catalog.cc:455] T 00000000000000000000000000000000 P a990556d2dec413dbdc9cf5cac385bd0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a990556d2dec413dbdc9cf5cac385bd0. Latest consensus state: current_term: 1 leader_uuid: "a990556d2dec413dbdc9cf5cac385bd0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a990556d2dec413dbdc9cf5cac385bd0" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 33123 } } }
I20260808 04:40:04.573777 22091 sys_catalog.cc:458] T 00000000000000000000000000000000 P a990556d2dec413dbdc9cf5cac385bd0 [sys.catalog]: This master's current role is: LEADER
I20260808 04:40:04.573895 22099 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 04:40:04.576581 22099 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 04:40:04.582432 22099 catalog_manager.cc:1347] Generated new cluster ID: 3bb79a6a23ce4f60aeb199869dc1e280
I20260808 04:40:04.582517 22099 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 04:40:04.633458 22099 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 04:40:04.634624 22099 catalog_manager.cc:1504] Loading token signing keys...
I20260808 04:40:04.642236 22099 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a990556d2dec413dbdc9cf5cac385bd0: Generated new TSK 0
I20260808 04:40:04.643115 22099 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.20.240.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.240.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.240.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.193.keytab.
Entry for principal kudu/127.20.240.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.193.keytab.
I20260808 04:40:04.684517 21443 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
/tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786164000593138-21443-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786164000593138-21443-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786164000593138-21443-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786164000593138-21443-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.240.193:0
--local_ip_for_outbound_sockets=127.20.240.193
--webserver_interface=127.20.240.193
--webserver_port=0
--tserver_master_addrs=127.20.240.254:33123
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.193.keytab
--principal=kudu/127.20.240.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.240.212:37197
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786164000593138-21443-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786164000593138-21443-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786164000593138-21443-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 04:40:04.805534 22111 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:40:04.805833 22111 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:40:04.805889 22111 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:40:04.810631 22111 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:40:04.810714 22111 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:40:04.810786 22111 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.240.193
I20260808 04:40:04.816597 22111 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.240.212:37197
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786164000593138-21443-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786164000593138-21443-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.193.keytab
--principal=kudu/127.20.240.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.240.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786164000593138-21443-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.240.193
--webserver_port=0
--tserver_master_addrs=127.20.240.254:33123
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22111
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.240.193
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786164000593138-21443-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 04:05:18 UTC on ccycloud.quasar-drfdgt.root.comops.site
build id 4574101
I20260808 04:40:04.817883 22111 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:40:04.818986 22111 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:40:04.829739 22119 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:40:04.829766 22117 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:40:04.829766 22116 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:40:04.830308 22111 server_base.cc:1034] running on GCE node
I20260808 04:40:04.830725 22111 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:40:04.831473 22111 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:40:04.832655 22111 hybrid_clock.cc:648] HybridClock initialized: now 1786164004832615 us; error 51 us; skew 500 ppm
Aug 08 04:40:04 dist-test-slave-vxj2 krb5kdc[21995](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164004, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.240.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:40:04.835726 22111 init.cc:377] Logged in from keytab as kudu/127.20.240.193@KRBTEST.COM (short username kudu)
I20260808 04:40:04.836755 22111 webserver.cc:460] Webserver started at http://127.20.240.193:35693/ using document root <none> and password file <none>
I20260808 04:40:04.837424 22111 fs_manager.cc:359] Metadata directory not provided
I20260808 04:40:04.837522 22111 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:40:04.837774 22111 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 04:40:04.839963 22111 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786164000593138-21443-0/minicluster-data/ts-0/data/instance:
uuid: "29c4501f48e84b49b49e9cc6d66472b2"
format_stamp: "Formatted at 2026-08-08 04:40:04 on dist-test-slave-vxj2"
server_key: "0d7426f09b5b36005cc0ae737ef8a51b"
server_key_iv: "2051d5e995f00639a99a457097afd33b"
server_key_version: "encryptionkey@0"
I20260808 04:40:04.840579 22111 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786164000593138-21443-0/minicluster-data/ts-0/wal/instance:
uuid: "29c4501f48e84b49b49e9cc6d66472b2"
format_stamp: "Formatted at 2026-08-08 04:40:04 on dist-test-slave-vxj2"
server_key: "0d7426f09b5b36005cc0ae737ef8a51b"
server_key_iv: "2051d5e995f00639a99a457097afd33b"
server_key_version: "encryptionkey@0"
I20260808 04:40:04.844659 22111 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.004s
I20260808 04:40:04.847664 22126 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:04.849064 22111 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260808 04:40:04.849275 22111 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786164000593138-21443-0/minicluster-data/ts-0/data,/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786164000593138-21443-0/minicluster-data/ts-0/wal
uuid: "29c4501f48e84b49b49e9cc6d66472b2"
format_stamp: "Formatted at 2026-08-08 04:40:04 on dist-test-slave-vxj2"
server_key: "0d7426f09b5b36005cc0ae737ef8a51b"
server_key_iv: "2051d5e995f00639a99a457097afd33b"
server_key_version: "encryptionkey@0"
I20260808 04:40:04.849416 22111 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786164000593138-21443-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786164000593138-21443-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786164000593138-21443-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:40:04.862202 22111 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:40:04.865422 22111 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:40:04.865646 22111 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:40:04.866328 22111 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 04:40:04.867197 22111 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 04:40:04.867268 22111 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:04.867344 22111 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 04:40:04.867391 22111 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:04.879103 22111 rpc_server.cc:307] RPC server started. Bound to: 127.20.240.193:37265
I20260808 04:40:04.879123 22246 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.240.193:37265 every 8 connection(s)
I20260808 04:40:04.880091 22111 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786164000593138-21443-0/minicluster-data/ts-0/data/info.pb
I20260808 04:40:04.881906 21443 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu as pid 22111
I20260808 04:40:04.882027 21443 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786164000593138-21443-0/minicluster-data/ts-0/wal/instance
I20260808 04:40:04.882308 21443 external_mini_cluster.cc:1428] Setting key 275e0cdab1711c2a76ea845954d28f31
Aug 08 04:40:04 dist-test-slave-vxj2 krb5kdc[21995](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164004, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.240.193@KRBTEST.COM for kudu/127.20.240.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.20.240.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.240.194@KRBTEST.COM" created.
I20260808 04:40:04.895727 22087 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:04.882671 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.240.193:51279 (local address 127.20.240.254:33123)
0808 04:40:04.882832 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:04.882837 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:04.883757 (+ 920us) server_negotiation.cc:407] Connection header received
0808 04:40:04.885179 (+ 1422us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:04.885183 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:04.885241 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:04.885348 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:04.886566 (+ 1218us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:04.887114 (+ 548us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:04.888266 (+ 1152us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:04.888509 (+ 243us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:04.888625 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:04.891625 (+ 3000us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:40:04.891628 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:40:04.891630 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:40:04.891656 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:40:04.893323 (+ 1667us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:04.893858 (+ 535us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:04.893861 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:04.893862 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:04.893940 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:04.894281 (+ 341us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:04.894283 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:04.894284 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:04.894540 (+ 256us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:40:04.894630 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:04.895400 (+ 770us) server_negotiation.cc:299] Negotiation successful
0808 04:40:04.895520 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260808 04:40:04.896620 22249 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:04.882950 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:33123 (local address 127.20.240.193:51279)
0808 04:40:04.883585 (+ 635us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:04.883641 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:04.884940 (+ 1299us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:04.885536 (+ 596us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:04.885543 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:04.885904 (+ 361us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:40:04.886388 (+ 484us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:04.886402 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:04.887248 (+ 846us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:04.887252 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:04.888131 (+ 879us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:04.888140 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:04.888668 (+ 528us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:04.888672 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:04.888850 (+ 178us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:04.889539 (+ 689us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:40:04.889557 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:40:04.891397 (+ 1840us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:40:04.893471 (+ 2074us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:04.893476 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:04.893489 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:04.893763 (+ 274us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:04.894052 (+ 289us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:04.894054 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:04.894055 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:04.894196 (+ 141us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:04.894678 (+ 482us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:40:04.894683 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:40:04.895047 (+ 364us) client_negotiation.cc:769] Sending connection context
0808 04:40:04.895345 (+ 298us) client_negotiation.cc:240] Negotiation successful
0808 04:40:04.895703 (+ 358us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":406,"thread_start_us":208,"threads_started":1}
I20260808 04:40:04.898181 22247 heartbeater.cc:347] Connected to a master server at 127.20.240.254:33123
I20260808 04:40:04.898473 22247 heartbeater.cc:464] Registering TS with master...
I20260808 04:40:04.899027 22247 heartbeater.cc:511] Master 127.20.240.254:33123 requested a full tablet report, sending...
I20260808 04:40:04.900714 22045 ts_manager.cc:194] Registered new tserver with Master: 29c4501f48e84b49b49e9cc6d66472b2 (127.20.240.193:37265)
I20260808 04:40:04.902311 22045 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.240.193@KRBTEST.COM'} at 127.20.240.193:51279
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.240.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.194.keytab.
Entry for principal kudu/127.20.240.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.194.keytab.
I20260808 04:40:04.912899 21443 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
/tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786164000593138-21443-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786164000593138-21443-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786164000593138-21443-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786164000593138-21443-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.240.194:0
--local_ip_for_outbound_sockets=127.20.240.194
--webserver_interface=127.20.240.194
--webserver_port=0
--tserver_master_addrs=127.20.240.254:33123
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.194.keytab
--principal=kudu/127.20.240.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.240.212:37197
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786164000593138-21443-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786164000593138-21443-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786164000593138-21443-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 04:40:05.039073 22252 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:40:05.039382 22252 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:40:05.039460 22252 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:40:05.043828 22252 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:40:05.043941 22252 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:40:05.044042 22252 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.240.194
I20260808 04:40:05.049690 22252 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.240.212:37197
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786164000593138-21443-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786164000593138-21443-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.194.keytab
--principal=kudu/127.20.240.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.240.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786164000593138-21443-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.240.194
--webserver_port=0
--tserver_master_addrs=127.20.240.254:33123
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22252
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.240.194
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786164000593138-21443-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 04:05:18 UTC on ccycloud.quasar-drfdgt.root.comops.site
build id 4574101
I20260808 04:40:05.050824 22252 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:40:05.051892 22252 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:40:05.063104 22260 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:40:05.063128 22257 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:40:05.063114 22258 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:40:05.063243 22252 server_base.cc:1034] running on GCE node
I20260808 04:40:05.063865 22252 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:40:05.064563 22252 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:40:05.065757 22252 hybrid_clock.cc:648] HybridClock initialized: now 1786164005065712 us; error 66 us; skew 500 ppm
Aug 08 04:40:05 dist-test-slave-vxj2 krb5kdc[21995](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164005, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.240.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:40:05.068930 22252 init.cc:377] Logged in from keytab as kudu/127.20.240.194@KRBTEST.COM (short username kudu)
I20260808 04:40:05.070024 22252 webserver.cc:460] Webserver started at http://127.20.240.194:40585/ using document root <none> and password file <none>
I20260808 04:40:05.070636 22252 fs_manager.cc:359] Metadata directory not provided
I20260808 04:40:05.070732 22252 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:40:05.070990 22252 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 04:40:05.073446 22252 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786164000593138-21443-0/minicluster-data/ts-1/data/instance:
uuid: "99cf90e153844861bbbf0645fe33d8b7"
format_stamp: "Formatted at 2026-08-08 04:40:05 on dist-test-slave-vxj2"
server_key: "c37e314ad0e56fab4802addc57e05488"
server_key_iv: "d1ad30cda53b4252be15f0fe6804b4a8"
server_key_version: "encryptionkey@0"
I20260808 04:40:05.074045 22252 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786164000593138-21443-0/minicluster-data/ts-1/wal/instance:
uuid: "99cf90e153844861bbbf0645fe33d8b7"
format_stamp: "Formatted at 2026-08-08 04:40:05 on dist-test-slave-vxj2"
server_key: "c37e314ad0e56fab4802addc57e05488"
server_key_iv: "d1ad30cda53b4252be15f0fe6804b4a8"
server_key_version: "encryptionkey@0"
I20260808 04:40:05.078224 22252 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260808 04:40:05.080790 22267 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:05.082068 22252 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260808 04:40:05.082211 22252 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786164000593138-21443-0/minicluster-data/ts-1/data,/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786164000593138-21443-0/minicluster-data/ts-1/wal
uuid: "99cf90e153844861bbbf0645fe33d8b7"
format_stamp: "Formatted at 2026-08-08 04:40:05 on dist-test-slave-vxj2"
server_key: "c37e314ad0e56fab4802addc57e05488"
server_key_iv: "d1ad30cda53b4252be15f0fe6804b4a8"
server_key_version: "encryptionkey@0"
I20260808 04:40:05.082333 22252 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786164000593138-21443-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786164000593138-21443-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786164000593138-21443-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:40:05.100921 22252 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:40:05.104570 22252 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:40:05.104801 22252 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:40:05.105482 22252 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 04:40:05.106371 22252 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 04:40:05.106443 22252 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:05.106529 22252 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 04:40:05.106581 22252 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:05.118642 22252 rpc_server.cc:307] RPC server started. Bound to: 127.20.240.194:43125
I20260808 04:40:05.118667 22386 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.240.194:43125 every 8 connection(s)
I20260808 04:40:05.119619 22252 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786164000593138-21443-0/minicluster-data/ts-1/data/info.pb
I20260808 04:40:05.120065 21443 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu as pid 22252
I20260808 04:40:05.120185 21443 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786164000593138-21443-0/minicluster-data/ts-1/wal/instance
I20260808 04:40:05.120504 21443 external_mini_cluster.cc:1428] Setting key e9541b60facf4581622887f67dca7ea2
WARNING: no policy specified for kudu/127.20.240.195@KRBTEST.COM; defaulting to no policy
Aug 08 04:40:05 dist-test-slave-vxj2 krb5kdc[21995](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164005, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.240.194@KRBTEST.COM for kudu/127.20.240.254@KRBTEST.COM
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.240.195@KRBTEST.COM" created.
I20260808 04:40:05.137778 22087 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:05.121747 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.240.194:54673 (local address 127.20.240.254:33123)
0808 04:40:05.121957 (+ 210us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:05.121961 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:05.123102 (+ 1141us) server_negotiation.cc:407] Connection header received
0808 04:40:05.124914 (+ 1812us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:05.124920 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:05.124990 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:05.125098 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:05.126959 (+ 1861us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:05.127510 (+ 551us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:05.129590 (+ 2080us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:05.129853 (+ 263us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:05.129959 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:05.133477 (+ 3518us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:40:05.133481 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:40:05.133483 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:40:05.133514 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:40:05.135216 (+ 1702us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:05.136007 (+ 791us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:05.136010 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:05.136012 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:05.136100 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:05.136487 (+ 387us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:05.136490 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:05.136492 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:05.136706 (+ 214us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:40:05.136821 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:05.137457 (+ 636us) server_negotiation.cc:299] Negotiation successful
0808 04:40:05.137601 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":122}
I20260808 04:40:05.138688 22390 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:05.122300 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:33123 (local address 127.20.240.194:54673)
0808 04:40:05.122906 (+ 606us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:05.122995 (+ 89us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:05.124660 (+ 1665us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:05.125332 (+ 672us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:05.125340 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:05.125970 (+ 630us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:40:05.126754 (+ 784us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:05.126781 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:05.127658 (+ 877us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:05.127663 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:05.129414 (+ 1751us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:05.129431 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:05.130093 (+ 662us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:05.130098 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:05.130434 (+ 336us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:05.131313 (+ 879us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:40:05.131332 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:40:05.133131 (+ 1799us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:40:05.135478 (+ 2347us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:05.135489 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:05.135510 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:05.135861 (+ 351us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:05.136201 (+ 340us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:05.136205 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:05.136207 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:05.136372 (+ 165us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:05.136820 (+ 448us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:40:05.136828 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:40:05.137124 (+ 296us) client_negotiation.cc:769] Sending connection context
0808 04:40:05.137396 (+ 272us) client_negotiation.cc:240] Negotiation successful
0808 04:40:05.137762 (+ 366us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":324,"thread_start_us":126,"threads_started":1}
I20260808 04:40:05.140193 22387 heartbeater.cc:347] Connected to a master server at 127.20.240.254:33123
I20260808 04:40:05.140481 22387 heartbeater.cc:464] Registering TS with master...
I20260808 04:40:05.141019 22387 heartbeater.cc:511] Master 127.20.240.254:33123 requested a full tablet report, sending...
I20260808 04:40:05.142227 22045 ts_manager.cc:194] Registered new tserver with Master: 99cf90e153844861bbbf0645fe33d8b7 (127.20.240.194:43125)
I20260808 04:40:05.142838 22045 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.240.194@KRBTEST.COM'} at 127.20.240.194:54673
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.240.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.195.keytab.
Entry for principal kudu/127.20.240.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.195.keytab.
I20260808 04:40:05.153476 21443 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
/tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786164000593138-21443-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786164000593138-21443-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786164000593138-21443-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786164000593138-21443-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.240.195:0
--local_ip_for_outbound_sockets=127.20.240.195
--webserver_interface=127.20.240.195
--webserver_port=0
--tserver_master_addrs=127.20.240.254:33123
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.195.keytab
--principal=kudu/127.20.240.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.240.212:37197
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786164000593138-21443-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786164000593138-21443-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786164000593138-21443-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 04:40:05.284924 22393 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:40:05.285307 22393 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:40:05.285403 22393 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:40:05.289736 22393 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:40:05.289829 22393 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:40:05.289935 22393 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.240.195
I20260808 04:40:05.295583 22393 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.240.212:37197
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786164000593138-21443-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786164000593138-21443-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.195.keytab
--principal=kudu/127.20.240.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.240.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786164000593138-21443-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.240.195
--webserver_port=0
--tserver_master_addrs=127.20.240.254:33123
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22393
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.240.195
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786164000593138-21443-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 04:05:18 UTC on ccycloud.quasar-drfdgt.root.comops.site
build id 4574101
I20260808 04:40:05.296772 22393 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:40:05.297896 22393 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:40:05.308022 22401 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:40:05.308040 22398 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:40:05.308027 22399 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:40:05.308465 22393 server_base.cc:1034] running on GCE node
I20260808 04:40:05.308923 22393 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:40:05.309662 22393 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:40:05.310827 22393 hybrid_clock.cc:648] HybridClock initialized: now 1786164005310808 us; error 33 us; skew 500 ppm
Aug 08 04:40:05 dist-test-slave-vxj2 krb5kdc[21995](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164005, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.240.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:40:05.313755 22393 init.cc:377] Logged in from keytab as kudu/127.20.240.195@KRBTEST.COM (short username kudu)
I20260808 04:40:05.314675 22393 webserver.cc:460] Webserver started at http://127.20.240.195:46873/ using document root <none> and password file <none>
I20260808 04:40:05.315272 22393 fs_manager.cc:359] Metadata directory not provided
I20260808 04:40:05.315367 22393 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:40:05.315616 22393 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 04:40:05.317806 22393 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786164000593138-21443-0/minicluster-data/ts-2/data/instance:
uuid: "b02ea2da8d4f44d8b3337b7b5373ebb8"
format_stamp: "Formatted at 2026-08-08 04:40:05 on dist-test-slave-vxj2"
server_key: "e6aa1ef88b130fbef114ba53c879eb61"
server_key_iv: "60c936b2649498bc40ba6309dbf9c56b"
server_key_version: "encryptionkey@0"
I20260808 04:40:05.318390 22393 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786164000593138-21443-0/minicluster-data/ts-2/wal/instance:
uuid: "b02ea2da8d4f44d8b3337b7b5373ebb8"
format_stamp: "Formatted at 2026-08-08 04:40:05 on dist-test-slave-vxj2"
server_key: "e6aa1ef88b130fbef114ba53c879eb61"
server_key_iv: "60c936b2649498bc40ba6309dbf9c56b"
server_key_version: "encryptionkey@0"
I20260808 04:40:05.322350 22393 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260808 04:40:05.325290 22408 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:05.326514 22393 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260808 04:40:05.326655 22393 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786164000593138-21443-0/minicluster-data/ts-2/data,/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786164000593138-21443-0/minicluster-data/ts-2/wal
uuid: "b02ea2da8d4f44d8b3337b7b5373ebb8"
format_stamp: "Formatted at 2026-08-08 04:40:05 on dist-test-slave-vxj2"
server_key: "e6aa1ef88b130fbef114ba53c879eb61"
server_key_iv: "60c936b2649498bc40ba6309dbf9c56b"
server_key_version: "encryptionkey@0"
I20260808 04:40:05.326776 22393 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786164000593138-21443-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786164000593138-21443-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786164000593138-21443-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:40:05.340945 22393 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:40:05.344187 22393 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:40:05.344404 22393 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:40:05.345130 22393 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 04:40:05.346020 22393 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 04:40:05.346093 22393 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:05.346170 22393 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 04:40:05.346215 22393 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:05.358264 22393 rpc_server.cc:307] RPC server started. Bound to: 127.20.240.195:41551
I20260808 04:40:05.358355 22530 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.240.195:41551 every 8 connection(s)
I20260808 04:40:05.359301 22393 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786164000593138-21443-0/minicluster-data/ts-2/data/info.pb
I20260808 04:40:05.361414 21443 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu as pid 22393
I20260808 04:40:05.361567 21443 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786164000593138-21443-0/minicluster-data/ts-2/wal/instance
I20260808 04:40:05.361852 21443 external_mini_cluster.cc:1428] Setting key cc8034d2a1392594db3e9079e253c14b
Aug 08 04:40:05 dist-test-slave-vxj2 krb5kdc[21995](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164005, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.240.195@KRBTEST.COM for kudu/127.20.240.254@KRBTEST.COM
I20260808 04:40:05.373775 22087 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:05.361306 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.240.195:43463 (local address 127.20.240.254:33123)
0808 04:40:05.361479 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:05.361484 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:05.362501 (+ 1017us) server_negotiation.cc:407] Connection header received
0808 04:40:05.364057 (+ 1556us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:05.364061 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:05.364120 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:05.364185 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:05.365483 (+ 1298us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:05.366038 (+ 555us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:05.367271 (+ 1233us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:05.367491 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:05.367572 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:05.370155 (+ 2583us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:40:05.370158 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:40:05.370160 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:40:05.370193 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:40:05.371667 (+ 1474us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:05.372222 (+ 555us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:05.372225 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:05.372226 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:05.372306 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:05.372619 (+ 313us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:05.372621 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:05.372622 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:05.372801 (+ 179us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:40:05.372875 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:05.373541 (+ 666us) server_negotiation.cc:299] Negotiation successful
0808 04:40:05.373644 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260808 04:40:05.375010 22533 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:05.361794 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:33123 (local address 127.20.240.195:43463)
0808 04:40:05.362335 (+ 541us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:05.362391 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:05.363851 (+ 1460us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:05.364337 (+ 486us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:05.364344 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:05.364703 (+ 359us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:40:05.365339 (+ 636us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:05.365356 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:05.366155 (+ 799us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:05.366157 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:05.367157 (+ 1000us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:05.367166 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:05.367627 (+ 461us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:05.367630 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:05.367773 (+ 143us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:05.368376 (+ 603us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:40:05.368392 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:40:05.369984 (+ 1592us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:40:05.371776 (+ 1792us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:05.371780 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:05.371792 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:05.372125 (+ 333us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:05.372384 (+ 259us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:05.372386 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:05.372387 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:05.372531 (+ 144us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:05.372927 (+ 396us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:40:05.372932 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:40:05.373288 (+ 356us) client_negotiation.cc:769] Sending connection context
0808 04:40:05.373472 (+ 184us) client_negotiation.cc:240] Negotiation successful
0808 04:40:05.373742 (+ 270us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":335,"thread_start_us":203,"threads_started":1}
I20260808 04:40:05.376255 22531 heartbeater.cc:347] Connected to a master server at 127.20.240.254:33123
I20260808 04:40:05.376523 22531 heartbeater.cc:464] Registering TS with master...
I20260808 04:40:05.377044 22531 heartbeater.cc:511] Master 127.20.240.254:33123 requested a full tablet report, sending...
I20260808 04:40:05.378084 22045 ts_manager.cc:194] Registered new tserver with Master: b02ea2da8d4f44d8b3337b7b5373ebb8 (127.20.240.195:41551)
I20260808 04:40:05.378683 22045 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.240.195@KRBTEST.COM'} at 127.20.240.195:43463
I20260808 04:40:05.388248 21443 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 04:40:05.401583 22087 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:05.393402 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35380 (local address 127.20.240.254:33123)
0808 04:40:05.393619 (+ 217us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:05.393624 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:05.393803 (+ 179us) server_negotiation.cc:407] Connection header received
0808 04:40:05.394012 (+ 209us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:05.394015 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:05.394075 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:05.394167 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:05.395069 (+ 902us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:05.395647 (+ 578us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:05.396550 (+ 903us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:05.396797 (+ 247us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:05.396915 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:05.398404 (+ 1489us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:40:05.398408 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:40:05.398411 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:40:05.398441 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:40:05.399751 (+ 1310us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:05.400205 (+ 454us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:05.400208 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:05.400210 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:05.400299 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:05.400602 (+ 303us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:05.400605 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:05.400607 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:05.400847 (+ 240us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:40:05.400994 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:05.401265 (+ 271us) server_negotiation.cc:299] Negotiation successful
0808 04:40:05.401421 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":91}
I20260808 04:40:05.408077 22045 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35380:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 04:40:05.411583 22045 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 04:40:05.429143 22545 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:05.422747 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.194:43125 (local address 127.0.0.1:50466)
0808 04:40:05.423889 (+ 1142us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:05.423948 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:05.424161 (+ 213us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:05.424863 (+ 702us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:05.424869 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:05.424890 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 04:40:05.425072 (+ 182us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:05.425083 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:05.426599 (+ 1516us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:05.426603 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:05.427740 (+ 1137us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:05.427749 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:05.428555 (+ 806us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:05.428558 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:05.428688 (+ 130us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:05.428728 (+ 40us) client_negotiation.cc:769] Sending connection context
0808 04:40:05.428870 (+ 142us) client_negotiation.cc:240] Negotiation successful
0808 04:40:05.428995 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":864,"mutex_wait_us":23,"thread_start_us":91,"threads_started":1}
I20260808 04:40:05.429236 22546 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:05.422898 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50466 (local address 127.20.240.194:43125)
0808 04:40:05.423363 (+ 465us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:05.423380 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:05.424048 (+ 668us) server_negotiation.cc:407] Connection header received
0808 04:40:05.424402 (+ 354us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:05.424427 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:05.424679 (+ 252us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:05.424871 (+ 192us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 04:40:05.425197 (+ 326us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:05.426129 (+ 932us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:05.427872 (+ 1743us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:05.428430 (+ 558us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:05.428568 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:05.428756 (+ 188us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:05.428900 (+ 144us) server_negotiation.cc:299] Negotiation successful
0808 04:40:05.428995 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":371,"thread_start_us":163,"threads_started":1}
I20260808 04:40:05.430711 22550 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:05.423600 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.193:37265 (local address 127.0.0.1:47474)
0808 04:40:05.424570 (+ 970us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:05.424583 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:05.424687 (+ 104us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:05.425241 (+ 554us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:05.425244 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:05.425284 (+ 40us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 04:40:05.425490 (+ 206us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:05.425499 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:05.427063 (+ 1564us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:05.427066 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:05.428673 (+ 1607us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:05.428685 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:05.430215 (+ 1530us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:05.430219 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:05.430337 (+ 118us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:05.430380 (+ 43us) client_negotiation.cc:769] Sending connection context
0808 04:40:05.430465 (+ 85us) client_negotiation.cc:240] Negotiation successful
0808 04:40:05.430548 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":911,"mutex_wait_us":757,"thread_start_us":188,"threads_started":1}
I20260808 04:40:05.431102 22548 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:05.423891 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47474 (local address 127.20.240.193:37265)
0808 04:40:05.424666 (+ 775us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:05.424673 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:05.424695 (+ 22us) server_negotiation.cc:407] Connection header received
0808 04:40:05.424813 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:05.424820 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:05.424998 (+ 178us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:05.425138 (+ 140us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 04:40:05.425627 (+ 489us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:05.426955 (+ 1328us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:05.428824 (+ 1869us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:05.429813 (+ 989us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:05.430004 (+ 191us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:05.430146 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:05.430514 (+ 368us) server_negotiation.cc:299] Negotiation successful
0808 04:40:05.430612 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":674,"thread_start_us":140,"threads_started":1}
I20260808 04:40:05.431145 22547 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:05.423409 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52738 (local address 127.20.240.195:41551)
0808 04:40:05.424050 (+ 641us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:05.424064 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:05.424489 (+ 425us) server_negotiation.cc:407] Connection header received
0808 04:40:05.424575 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:05.424581 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:05.424800 (+ 219us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:05.424954 (+ 154us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 04:40:05.425521 (+ 567us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:05.426878 (+ 1357us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:05.428822 (+ 1944us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:05.430033 (+ 1211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:05.430152 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:05.430283 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:05.430857 (+ 574us) server_negotiation.cc:299] Negotiation successful
0808 04:40:05.430974 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":518,"thread_start_us":230,"threads_started":1}
I20260808 04:40:05.430757 22543 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:05.422886 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.195:41551 (local address 127.0.0.1:52738)
0808 04:40:05.424202 (+ 1316us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:05.424228 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:05.424367 (+ 139us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:05.425138 (+ 771us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:05.425142 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:05.425197 (+ 55us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 04:40:05.425387 (+ 190us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:05.425395 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:05.427058 (+ 1663us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:05.427064 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:05.428608 (+ 1544us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:05.428635 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:05.430347 (+ 1712us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:05.430350 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:05.430490 (+ 140us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:05.430511 (+ 21us) client_negotiation.cc:769] Sending connection context
0808 04:40:05.430577 (+ 66us) client_negotiation.cc:240] Negotiation successful
0808 04:40:05.430637 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1248,"mutex_wait_us":145,"thread_start_us":182,"threads_started":1}
I20260808 04:40:05.433194 22318 tablet_service.cc:1467] Processing CreateTablet for tablet b299fcd3ab4f4fab8ed0ed088dfaa13f (DEFAULT_TABLE table=test-table [id=ce332adf85ed4f189a024b0d47f2f359]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 04:40:05.433808 22179 tablet_service.cc:1467] Processing CreateTablet for tablet b299fcd3ab4f4fab8ed0ed088dfaa13f (DEFAULT_TABLE table=test-table [id=ce332adf85ed4f189a024b0d47f2f359]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 04:40:05.434582 22318 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b299fcd3ab4f4fab8ed0ed088dfaa13f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:40:05.434579 22457 tablet_service.cc:1467] Processing CreateTablet for tablet b299fcd3ab4f4fab8ed0ed088dfaa13f (DEFAULT_TABLE table=test-table [id=ce332adf85ed4f189a024b0d47f2f359]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 04:40:05.434964 22179 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b299fcd3ab4f4fab8ed0ed088dfaa13f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:40:05.435446 22457 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b299fcd3ab4f4fab8ed0ed088dfaa13f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:40:05.442710 22551 tablet_bootstrap.cc:492] T b299fcd3ab4f4fab8ed0ed088dfaa13f P b02ea2da8d4f44d8b3337b7b5373ebb8: Bootstrap starting.
I20260808 04:40:05.443606 22553 tablet_bootstrap.cc:492] T b299fcd3ab4f4fab8ed0ed088dfaa13f P 99cf90e153844861bbbf0645fe33d8b7: Bootstrap starting.
I20260808 04:40:05.445814 22551 tablet_bootstrap.cc:654] T b299fcd3ab4f4fab8ed0ed088dfaa13f P b02ea2da8d4f44d8b3337b7b5373ebb8: Neither blocks nor log segments found. Creating new log.
I20260808 04:40:05.446403 22553 tablet_bootstrap.cc:654] T b299fcd3ab4f4fab8ed0ed088dfaa13f P 99cf90e153844861bbbf0645fe33d8b7: Neither blocks nor log segments found. Creating new log.
I20260808 04:40:05.447158 22551 log.cc:824] T b299fcd3ab4f4fab8ed0ed088dfaa13f P b02ea2da8d4f44d8b3337b7b5373ebb8: Log is configured to *not* fsync() on all Append() calls
I20260808 04:40:05.447242 22553 log.cc:824] T b299fcd3ab4f4fab8ed0ed088dfaa13f P 99cf90e153844861bbbf0645fe33d8b7: Log is configured to *not* fsync() on all Append() calls
I20260808 04:40:05.448043 22552 tablet_bootstrap.cc:492] T b299fcd3ab4f4fab8ed0ed088dfaa13f P 29c4501f48e84b49b49e9cc6d66472b2: Bootstrap starting.
I20260808 04:40:05.449288 22551 tablet_bootstrap.cc:492] T b299fcd3ab4f4fab8ed0ed088dfaa13f P b02ea2da8d4f44d8b3337b7b5373ebb8: No bootstrap required, opened a new log
I20260808 04:40:05.449496 22551 ts_tablet_manager.cc:1397] T b299fcd3ab4f4fab8ed0ed088dfaa13f P b02ea2da8d4f44d8b3337b7b5373ebb8: Time spent bootstrapping tablet: real 0.007s user 0.005s sys 0.001s
I20260808 04:40:05.450273 22552 tablet_bootstrap.cc:654] T b299fcd3ab4f4fab8ed0ed088dfaa13f P 29c4501f48e84b49b49e9cc6d66472b2: Neither blocks nor log segments found. Creating new log.
I20260808 04:40:05.451121 22552 log.cc:824] T b299fcd3ab4f4fab8ed0ed088dfaa13f P 29c4501f48e84b49b49e9cc6d66472b2: Log is configured to *not* fsync() on all Append() calls
I20260808 04:40:05.453203 22553 tablet_bootstrap.cc:492] T b299fcd3ab4f4fab8ed0ed088dfaa13f P 99cf90e153844861bbbf0645fe33d8b7: No bootstrap required, opened a new log
I20260808 04:40:05.453457 22553 ts_tablet_manager.cc:1397] T b299fcd3ab4f4fab8ed0ed088dfaa13f P 99cf90e153844861bbbf0645fe33d8b7: Time spent bootstrapping tablet: real 0.010s user 0.006s sys 0.000s
I20260808 04:40:05.453644 22551 raft_consensus.cc:348] T b299fcd3ab4f4fab8ed0ed088dfaa13f P b02ea2da8d4f44d8b3337b7b5373ebb8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99cf90e153844861bbbf0645fe33d8b7" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 43125 } } peers { permanent_uuid: "b02ea2da8d4f44d8b3337b7b5373ebb8" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 41551 } } peers { permanent_uuid: "29c4501f48e84b49b49e9cc6d66472b2" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 37265 } }
I20260808 04:40:05.453907 22551 raft_consensus.cc:374] T b299fcd3ab4f4fab8ed0ed088dfaa13f P b02ea2da8d4f44d8b3337b7b5373ebb8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:40:05.453961 22551 raft_consensus.cc:729] T b299fcd3ab4f4fab8ed0ed088dfaa13f P b02ea2da8d4f44d8b3337b7b5373ebb8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b02ea2da8d4f44d8b3337b7b5373ebb8, State: Initialized, Role: FOLLOWER
I20260808 04:40:05.454417 22551 consensus_queue.cc:260] T b299fcd3ab4f4fab8ed0ed088dfaa13f P b02ea2da8d4f44d8b3337b7b5373ebb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99cf90e153844861bbbf0645fe33d8b7" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 43125 } } peers { permanent_uuid: "b02ea2da8d4f44d8b3337b7b5373ebb8" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 41551 } } peers { permanent_uuid: "29c4501f48e84b49b49e9cc6d66472b2" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 37265 } }
I20260808 04:40:05.454664 22552 tablet_bootstrap.cc:492] T b299fcd3ab4f4fab8ed0ed088dfaa13f P 29c4501f48e84b49b49e9cc6d66472b2: No bootstrap required, opened a new log
I20260808 04:40:05.454871 22552 ts_tablet_manager.cc:1397] T b299fcd3ab4f4fab8ed0ed088dfaa13f P 29c4501f48e84b49b49e9cc6d66472b2: Time spent bootstrapping tablet: real 0.007s user 0.005s sys 0.000s
I20260808 04:40:05.455415 22551 ts_tablet_manager.cc:1428] T b299fcd3ab4f4fab8ed0ed088dfaa13f P b02ea2da8d4f44d8b3337b7b5373ebb8: Time spent starting tablet: real 0.006s user 0.003s sys 0.003s
I20260808 04:40:05.455852 22531 heartbeater.cc:503] Master 127.20.240.254:33123 was elected leader, sending a full tablet report...
I20260808 04:40:05.458580 22553 raft_consensus.cc:348] T b299fcd3ab4f4fab8ed0ed088dfaa13f P 99cf90e153844861bbbf0645fe33d8b7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99cf90e153844861bbbf0645fe33d8b7" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 43125 } } peers { permanent_uuid: "b02ea2da8d4f44d8b3337b7b5373ebb8" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 41551 } } peers { permanent_uuid: "29c4501f48e84b49b49e9cc6d66472b2" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 37265 } }
I20260808 04:40:05.458913 22553 raft_consensus.cc:374] T b299fcd3ab4f4fab8ed0ed088dfaa13f P 99cf90e153844861bbbf0645fe33d8b7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:40:05.458982 22553 raft_consensus.cc:729] T b299fcd3ab4f4fab8ed0ed088dfaa13f P 99cf90e153844861bbbf0645fe33d8b7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99cf90e153844861bbbf0645fe33d8b7, State: Initialized, Role: FOLLOWER
I20260808 04:40:05.459491 22553 consensus_queue.cc:260] T b299fcd3ab4f4fab8ed0ed088dfaa13f P 99cf90e153844861bbbf0645fe33d8b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99cf90e153844861bbbf0645fe33d8b7" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 43125 } } peers { permanent_uuid: "b02ea2da8d4f44d8b3337b7b5373ebb8" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 41551 } } peers { permanent_uuid: "29c4501f48e84b49b49e9cc6d66472b2" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 37265 } }
I20260808 04:40:05.460268 22387 heartbeater.cc:503] Master 127.20.240.254:33123 was elected leader, sending a full tablet report...
I20260808 04:40:05.460649 22553 ts_tablet_manager.cc:1428] T b299fcd3ab4f4fab8ed0ed088dfaa13f P 99cf90e153844861bbbf0645fe33d8b7: Time spent starting tablet: real 0.007s user 0.007s sys 0.000s
I20260808 04:40:05.460570 22552 raft_consensus.cc:348] T b299fcd3ab4f4fab8ed0ed088dfaa13f P 29c4501f48e84b49b49e9cc6d66472b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99cf90e153844861bbbf0645fe33d8b7" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 43125 } } peers { permanent_uuid: "b02ea2da8d4f44d8b3337b7b5373ebb8" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 41551 } } peers { permanent_uuid: "29c4501f48e84b49b49e9cc6d66472b2" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 37265 } }
I20260808 04:40:05.460888 22552 raft_consensus.cc:374] T b299fcd3ab4f4fab8ed0ed088dfaa13f P 29c4501f48e84b49b49e9cc6d66472b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:40:05.460963 22552 raft_consensus.cc:729] T b299fcd3ab4f4fab8ed0ed088dfaa13f P 29c4501f48e84b49b49e9cc6d66472b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 29c4501f48e84b49b49e9cc6d66472b2, State: Initialized, Role: FOLLOWER
I20260808 04:40:05.461516 22552 consensus_queue.cc:260] T b299fcd3ab4f4fab8ed0ed088dfaa13f P 29c4501f48e84b49b49e9cc6d66472b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99cf90e153844861bbbf0645fe33d8b7" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 43125 } } peers { permanent_uuid: "b02ea2da8d4f44d8b3337b7b5373ebb8" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 41551 } } peers { permanent_uuid: "29c4501f48e84b49b49e9cc6d66472b2" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 37265 } }
I20260808 04:40:05.462205 22247 heartbeater.cc:503] Master 127.20.240.254:33123 was elected leader, sending a full tablet report...
I20260808 04:40:05.462631 22552 ts_tablet_manager.cc:1428] T b299fcd3ab4f4fab8ed0ed088dfaa13f P 29c4501f48e84b49b49e9cc6d66472b2: Time spent starting tablet: real 0.008s user 0.003s sys 0.004s
I20260808 04:40:05.536037 22557 raft_consensus.cc:482] T b299fcd3ab4f4fab8ed0ed088dfaa13f P b02ea2da8d4f44d8b3337b7b5373ebb8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 04:40:05.536332 22557 raft_consensus.cc:504] T b299fcd3ab4f4fab8ed0ed088dfaa13f P b02ea2da8d4f44d8b3337b7b5373ebb8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99cf90e153844861bbbf0645fe33d8b7" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 43125 } } peers { permanent_uuid: "b02ea2da8d4f44d8b3337b7b5373ebb8" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 41551 } } peers { permanent_uuid: "29c4501f48e84b49b49e9cc6d66472b2" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 37265 } }
I20260808 04:40:05.537737 22557 leader_election.cc:288] T b299fcd3ab4f4fab8ed0ed088dfaa13f P b02ea2da8d4f44d8b3337b7b5373ebb8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 99cf90e153844861bbbf0645fe33d8b7 (127.20.240.194:43125), 29c4501f48e84b49b49e9cc6d66472b2 (127.20.240.193:37265)
I20260808 04:40:05.542529 22546 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:05.538171 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.240.195:46175 (local address 127.20.240.194:43125)
0808 04:40:05.538324 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:05.538329 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:05.538345 (+ 16us) server_negotiation.cc:407] Connection header received
0808 04:40:05.538504 (+ 159us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:05.538509 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:05.538570 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:05.538683 (+ 113us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 04:40:05.539112 (+ 429us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:05.539917 (+ 805us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:05.541276 (+ 1359us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:05.541895 (+ 619us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:05.542032 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:05.542094 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:05.542364 (+ 270us) server_negotiation.cc:299] Negotiation successful
0808 04:40:05.542424 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260808 04:40:05.542562 22533 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:05.538072 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.194:43125 (local address 127.20.240.195:46175)
0808 04:40:05.538228 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:05.538246 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:05.538376 (+ 130us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:05.538741 (+ 365us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:05.538747 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:05.538776 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 04:40:05.538980 (+ 204us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:05.538987 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:05.540030 (+ 1043us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:05.540034 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:05.541099 (+ 1065us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:05.541108 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:05.542048 (+ 940us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:05.542053 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:05.542229 (+ 176us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:05.542256 (+ 27us) client_negotiation.cc:769] Sending connection context
0808 04:40:05.542341 (+ 85us) client_negotiation.cc:240] Negotiation successful
0808 04:40:05.542412 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":48}
I20260808 04:40:05.543284 22560 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:05.538543 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.193:37265 (local address 127.20.240.195:47251)
0808 04:40:05.539085 (+ 542us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:05.539101 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:05.539240 (+ 139us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:05.539457 (+ 217us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:05.539459 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:05.539476 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 04:40:05.539688 (+ 212us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:05.539695 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:05.540683 (+ 988us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:05.540686 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:05.541918 (+ 1232us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:05.541931 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:05.542874 (+ 943us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:05.542877 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:05.542978 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:05.542999 (+ 21us) client_negotiation.cc:769] Sending connection context
0808 04:40:05.543073 (+ 74us) client_negotiation.cc:240] Negotiation successful
0808 04:40:05.543133 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":450,"mutex_wait_us":1,"thread_start_us":190,"threads_started":1}
I20260808 04:40:05.543301 22548 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:05.538758 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.240.195:47251 (local address 127.20.240.193:37265)
0808 04:40:05.538961 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:05.538966 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:05.539226 (+ 260us) server_negotiation.cc:407] Connection header received
0808 04:40:05.539321 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:05.539323 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:05.539364 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:05.539421 (+ 57us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 04:40:05.539822 (+ 401us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:05.540561 (+ 739us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:05.542036 (+ 1475us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:05.542725 (+ 689us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:05.542852 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:05.542902 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:05.543096 (+ 194us) server_negotiation.cc:299] Negotiation successful
0808 04:40:05.543192 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260808 04:40:05.543531 22338 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b299fcd3ab4f4fab8ed0ed088dfaa13f" candidate_uuid: "b02ea2da8d4f44d8b3337b7b5373ebb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99cf90e153844861bbbf0645fe33d8b7" is_pre_election: true
I20260808 04:40:05.544008 22199 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b299fcd3ab4f4fab8ed0ed088dfaa13f" candidate_uuid: "b02ea2da8d4f44d8b3337b7b5373ebb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29c4501f48e84b49b49e9cc6d66472b2" is_pre_election: true
I20260808 04:40:05.544059 22338 raft_consensus.cc:2454] T b299fcd3ab4f4fab8ed0ed088dfaa13f P 99cf90e153844861bbbf0645fe33d8b7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b02ea2da8d4f44d8b3337b7b5373ebb8 in term 0.
I20260808 04:40:05.544274 22199 raft_consensus.cc:2454] T b299fcd3ab4f4fab8ed0ed088dfaa13f P 29c4501f48e84b49b49e9cc6d66472b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b02ea2da8d4f44d8b3337b7b5373ebb8 in term 0.
I20260808 04:40:05.544693 22411 leader_election.cc:302] T b299fcd3ab4f4fab8ed0ed088dfaa13f P b02ea2da8d4f44d8b3337b7b5373ebb8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99cf90e153844861bbbf0645fe33d8b7, b02ea2da8d4f44d8b3337b7b5373ebb8; no voters:
I20260808 04:40:05.545035 22557 raft_consensus.cc:2781] T b299fcd3ab4f4fab8ed0ed088dfaa13f P b02ea2da8d4f44d8b3337b7b5373ebb8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 04:40:05.545190 22557 raft_consensus.cc:482] T b299fcd3ab4f4fab8ed0ed088dfaa13f P b02ea2da8d4f44d8b3337b7b5373ebb8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 04:40:05.545265 22557 raft_consensus.cc:3037] T b299fcd3ab4f4fab8ed0ed088dfaa13f P b02ea2da8d4f44d8b3337b7b5373ebb8 [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:40:05.546759 22557 raft_consensus.cc:504] T b299fcd3ab4f4fab8ed0ed088dfaa13f P b02ea2da8d4f44d8b3337b7b5373ebb8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99cf90e153844861bbbf0645fe33d8b7" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 43125 } } peers { permanent_uuid: "b02ea2da8d4f44d8b3337b7b5373ebb8" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 41551 } } peers { permanent_uuid: "29c4501f48e84b49b49e9cc6d66472b2" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 37265 } }
I20260808 04:40:05.547159 22557 leader_election.cc:288] T b299fcd3ab4f4fab8ed0ed088dfaa13f P b02ea2da8d4f44d8b3337b7b5373ebb8 [CANDIDATE]: Term 1 election: Requested vote from peers 99cf90e153844861bbbf0645fe33d8b7 (127.20.240.194:43125), 29c4501f48e84b49b49e9cc6d66472b2 (127.20.240.193:37265)
I20260808 04:40:05.547676 22338 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b299fcd3ab4f4fab8ed0ed088dfaa13f" candidate_uuid: "b02ea2da8d4f44d8b3337b7b5373ebb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99cf90e153844861bbbf0645fe33d8b7"
I20260808 04:40:05.547684 22199 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b299fcd3ab4f4fab8ed0ed088dfaa13f" candidate_uuid: "b02ea2da8d4f44d8b3337b7b5373ebb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29c4501f48e84b49b49e9cc6d66472b2"
I20260808 04:40:05.547808 22338 raft_consensus.cc:3037] T b299fcd3ab4f4fab8ed0ed088dfaa13f P 99cf90e153844861bbbf0645fe33d8b7 [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:40:05.547842 22199 raft_consensus.cc:3037] T b299fcd3ab4f4fab8ed0ed088dfaa13f P 29c4501f48e84b49b49e9cc6d66472b2 [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:40:05.549090 22199 raft_consensus.cc:2454] T b299fcd3ab4f4fab8ed0ed088dfaa13f P 29c4501f48e84b49b49e9cc6d66472b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b02ea2da8d4f44d8b3337b7b5373ebb8 in term 1.
I20260808 04:40:05.549197 22338 raft_consensus.cc:2454] T b299fcd3ab4f4fab8ed0ed088dfaa13f P 99cf90e153844861bbbf0645fe33d8b7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b02ea2da8d4f44d8b3337b7b5373ebb8 in term 1.
I20260808 04:40:05.549504 22411 leader_election.cc:302] T b299fcd3ab4f4fab8ed0ed088dfaa13f P b02ea2da8d4f44d8b3337b7b5373ebb8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29c4501f48e84b49b49e9cc6d66472b2, b02ea2da8d4f44d8b3337b7b5373ebb8; no voters:
I20260808 04:40:05.549770 22557 raft_consensus.cc:2781] T b299fcd3ab4f4fab8ed0ed088dfaa13f P b02ea2da8d4f44d8b3337b7b5373ebb8 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 04:40:05.550017 22557 raft_consensus.cc:686] T b299fcd3ab4f4fab8ed0ed088dfaa13f P b02ea2da8d4f44d8b3337b7b5373ebb8 [term 1 LEADER]: Becoming Leader. State: Replica: b02ea2da8d4f44d8b3337b7b5373ebb8, State: Running, Role: LEADER
I20260808 04:40:05.550372 22557 consensus_queue.cc:237] T b299fcd3ab4f4fab8ed0ed088dfaa13f P b02ea2da8d4f44d8b3337b7b5373ebb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99cf90e153844861bbbf0645fe33d8b7" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 43125 } } peers { permanent_uuid: "b02ea2da8d4f44d8b3337b7b5373ebb8" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 41551 } } peers { permanent_uuid: "29c4501f48e84b49b49e9cc6d66472b2" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 37265 } }
I20260808 04:40:05.554021 22041 catalog_manager.cc:5495] T b299fcd3ab4f4fab8ed0ed088dfaa13f P b02ea2da8d4f44d8b3337b7b5373ebb8 reported cstate change: term changed from 0 to 1, leader changed from <none> to b02ea2da8d4f44d8b3337b7b5373ebb8 (127.20.240.195). New cstate: current_term: 1 leader_uuid: "b02ea2da8d4f44d8b3337b7b5373ebb8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99cf90e153844861bbbf0645fe33d8b7" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 43125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b02ea2da8d4f44d8b3337b7b5373ebb8" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 41551 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "29c4501f48e84b49b49e9cc6d66472b2" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 37265 } health_report { overall_health: UNKNOWN } } }
Aug 08 04:40:05 dist-test-slave-vxj2 krb5kdc[21995](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164004, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.240.193@KRBTEST.COM
I20260808 04:40:05.585551 22548 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:05.576169 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47484 (local address 127.20.240.193:37265)
0808 04:40:05.576375 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:05.576380 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:05.576507 (+ 127us) server_negotiation.cc:407] Connection header received
0808 04:40:05.576682 (+ 175us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:05.576686 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:05.576736 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:05.576826 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:05.577736 (+ 910us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:05.578259 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:05.579132 (+ 873us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:05.579358 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:05.579467 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:05.582188 (+ 2721us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:40:05.582204 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:40:05.582222 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:40:05.582249 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:40:05.583927 (+ 1678us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:05.584327 (+ 400us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:05.584332 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:05.584333 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:05.584427 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:05.584656 (+ 229us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:05.584658 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:05.584659 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:05.584911 (+ 252us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:40:05.585062 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:05.585308 (+ 246us) server_negotiation.cc:299] Negotiation successful
0808 04:40:05.585422 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":84}
Aug 08 04:40:05 dist-test-slave-vxj2 krb5kdc[21995](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164005, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
W20260808 04:40:05.610452 22532 tablet.cc:2369] T b299fcd3ab4f4fab8ed0ed088dfaa13f P b02ea2da8d4f44d8b3337b7b5373ebb8: Can't schedule compaction. Clean time has not been advanced past its initial value.
Aug 08 04:40:05 dist-test-slave-vxj2 krb5kdc[21995](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164005, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.20.240.193@KRBTEST.COM
I20260808 04:40:05.615990 22548 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:05.606943 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47498 (local address 127.20.240.193:37265)
0808 04:40:05.607117 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:05.607122 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:05.607255 (+ 133us) server_negotiation.cc:407] Connection header received
0808 04:40:05.607464 (+ 209us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:05.607467 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:05.607512 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:05.607613 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:05.608340 (+ 727us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:05.608860 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:05.609791 (+ 931us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:05.610015 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:05.610123 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:05.612710 (+ 2587us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:40:05.612714 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:40:05.612716 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:40:05.612740 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:40:05.614229 (+ 1489us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:05.614651 (+ 422us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:05.614656 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:05.614659 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:05.614741 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:05.615020 (+ 279us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:05.615024 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:05.615026 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:05.615195 (+ 169us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:40:05.615328 (+ 133us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:05.615664 (+ 336us) server_negotiation.cc:299] Negotiation successful
0808 04:40:05.615797 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
W20260808 04:40:05.620913 22388 tablet.cc:2369] T b299fcd3ab4f4fab8ed0ed088dfaa13f P 99cf90e153844861bbbf0645fe33d8b7: Can't schedule compaction. Clean time has not been advanced past its initial value.
Aug 08 04:40:05 dist-test-slave-vxj2 krb5kdc[21995](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164005, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
W20260808 04:40:05.631580 22248 tablet.cc:2369] T b299fcd3ab4f4fab8ed0ed088dfaa13f P 29c4501f48e84b49b49e9cc6d66472b2: Can't schedule compaction. Clean time has not been advanced past its initial value.
Aug 08 04:40:05 dist-test-slave-vxj2 krb5kdc[21995](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164005, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.240.193@KRBTEST.COM
I20260808 04:40:05.644767 22548 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:05.636040 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47510 (local address 127.20.240.193:37265)
0808 04:40:05.636235 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:05.636239 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:05.636350 (+ 111us) server_negotiation.cc:407] Connection header received
0808 04:40:05.636509 (+ 159us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:05.636512 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:05.636557 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:05.636621 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:05.637390 (+ 769us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:05.637933 (+ 543us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:05.638717 (+ 784us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:05.638968 (+ 251us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:05.639050 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:05.641673 (+ 2623us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:40:05.641677 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:40:05.641679 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:40:05.641703 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:40:05.643100 (+ 1397us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:05.643534 (+ 434us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:05.643538 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:05.643540 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:05.643620 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:05.643899 (+ 279us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:05.643904 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:05.643906 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:05.644075 (+ 169us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:40:05.644209 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:05.644477 (+ 268us) server_negotiation.cc:299] Negotiation successful
0808 04:40:05.644596 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":94}
W20260808 04:40:05.646543 22157 tablet_service.cc:2908] Rejecting scan request for tablet b299fcd3ab4f4fab8ed0ed088dfaa13f: Uninitialized: clean time has not yet been initialized
I20260808 04:40:05.648767 21443 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu with pid 22111
I20260808 04:40:05.656057 21443 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu with pid 22252
I20260808 04:40:05.665517 21443 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu with pid 22393
I20260808 04:40:05.672904 21443 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu with pid 22009
2026-08-08T04:40:05Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnChecksum (2540 ms)
[ RUN ] SecurityITest.SmokeTestAsAuthorizedUser
Loading random data
Initializing database '/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786164000593138-21443-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 04:40:05 dist-test-slave-vxj2 krb5kdc[22577](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 04:40:05 dist-test-slave-vxj2 krb5kdc[22577](info): set up 2 sockets
Aug 08 04:40:05 dist-test-slave-vxj2 krb5kdc[22577](info): commencing operation
krb5kdc: starting...
W20260808 04:40:06.795374 21443 mini_kdc.cc:121] Time spent starting KDC: real 1.099s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786164000593138-21443-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786164000593138-21443-0/krb5kdc/test-user.keytab.
Aug 08 04:40:06 dist-test-slave-vxj2 krb5kdc[22577](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164006, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T04:40:06Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T04:40:06Z Disabled control of system clock
WARNING: no policy specified for kudu/127.20.240.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.240.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.240.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.254.keytab.
Entry for principal kudu/127.20.240.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.254.keytab.
I20260808 04:40:06.920080 21443 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
/tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786164000593138-21443-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786164000593138-21443-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786164000593138-21443-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786164000593138-21443-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.240.254:43933
--webserver_interface=127.20.240.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.254.keytab
--principal=kudu/127.20.240.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.240.212:35519
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.240.254:43933
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786164000593138-21443-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786164000593138-21443-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786164000593138-21443-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 04:40:07.034152 22591 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:40:07.034507 22591 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:40:07.034595 22591 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:40:07.038759 22591 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 04:40:07.038863 22591 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260808 04:40:07.038895 22591 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:40:07.038951 22591 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:40:07.039007 22591 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 04:40:07.039047 22591 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 04:40:07.044732 22591 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.240.212:35519
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786164000593138-21443-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786164000593138-21443-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.240.254:43933
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.254.keytab
--principal=kudu/127.20.240.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.240.254:43933
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786164000593138-21443-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.240.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22591
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786164000593138-21443-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 04:05:18 UTC on ccycloud.quasar-drfdgt.root.comops.site
build id 4574101
I20260808 04:40:07.046077 22591 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:40:07.047200 22591 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:40:07.056344 22597 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:40:07.056362 22596 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:40:07.056344 22599 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:40:07.056528 22591 server_base.cc:1034] running on GCE node
I20260808 04:40:07.057277 22591 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:40:07.058475 22591 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:40:07.059657 22591 hybrid_clock.cc:648] HybridClock initialized: now 1786164007059637 us; error 31 us; skew 500 ppm
Aug 08 04:40:07 dist-test-slave-vxj2 krb5kdc[22577](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164007, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.240.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:40:07.062745 22591 init.cc:377] Logged in from keytab as kudu/127.20.240.254@KRBTEST.COM (short username kudu)
I20260808 04:40:07.063727 22591 webserver.cc:460] Webserver started at http://127.20.240.254:46663/ using document root <none> and password file <none>
I20260808 04:40:07.064289 22591 fs_manager.cc:359] Metadata directory not provided
I20260808 04:40:07.064356 22591 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:40:07.064532 22591 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 04:40:07.066834 22591 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786164000593138-21443-0/minicluster-data/master-0/data/instance:
uuid: "4ecb9ee877ff450fae91d30f2669eab4"
format_stamp: "Formatted at 2026-08-08 04:40:07 on dist-test-slave-vxj2"
server_key: "c17bb540a87871f73e9ad1e8292273ad"
server_key_iv: "660e19d0ed08e210dfdf7c959df0b420"
server_key_version: "encryptionkey@0"
I20260808 04:40:07.067481 22591 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786164000593138-21443-0/minicluster-data/master-0/wal/instance:
uuid: "4ecb9ee877ff450fae91d30f2669eab4"
format_stamp: "Formatted at 2026-08-08 04:40:07 on dist-test-slave-vxj2"
server_key: "c17bb540a87871f73e9ad1e8292273ad"
server_key_iv: "660e19d0ed08e210dfdf7c959df0b420"
server_key_version: "encryptionkey@0"
I20260808 04:40:07.071678 22591 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260808 04:40:07.074434 22607 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:07.075922 22591 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.003s
I20260808 04:40:07.076133 22591 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786164000593138-21443-0/minicluster-data/master-0/data,/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786164000593138-21443-0/minicluster-data/master-0/wal
uuid: "4ecb9ee877ff450fae91d30f2669eab4"
format_stamp: "Formatted at 2026-08-08 04:40:07 on dist-test-slave-vxj2"
server_key: "c17bb540a87871f73e9ad1e8292273ad"
server_key_iv: "660e19d0ed08e210dfdf7c959df0b420"
server_key_version: "encryptionkey@0"
I20260808 04:40:07.076275 22591 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786164000593138-21443-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786164000593138-21443-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786164000593138-21443-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:40:07.094197 22591 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:40:07.097787 22591 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:40:07.098022 22591 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:40:07.106808 22591 rpc_server.cc:307] RPC server started. Bound to: 127.20.240.254:43933
I20260808 04:40:07.106837 22672 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.240.254:43933 every 8 connection(s)
I20260808 04:40:07.107864 22591 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786164000593138-21443-0/minicluster-data/master-0/data/info.pb
I20260808 04:40:07.110777 22673 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:40:07.116515 22673 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4ecb9ee877ff450fae91d30f2669eab4: Bootstrap starting.
I20260808 04:40:07.117403 21443 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu as pid 22591
I20260808 04:40:07.117549 21443 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786164000593138-21443-0/minicluster-data/master-0/wal/instance
I20260808 04:40:07.117806 21443 external_mini_cluster.cc:1428] Setting key eb519f6a82525bdd14b0fbc203085987
I20260808 04:40:07.119498 22673 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4ecb9ee877ff450fae91d30f2669eab4: Neither blocks nor log segments found. Creating new log.
I20260808 04:40:07.120266 22673 log.cc:824] T 00000000000000000000000000000000 P 4ecb9ee877ff450fae91d30f2669eab4: Log is configured to *not* fsync() on all Append() calls
I20260808 04:40:07.122648 22673 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4ecb9ee877ff450fae91d30f2669eab4: No bootstrap required, opened a new log
Aug 08 04:40:07 dist-test-slave-vxj2 krb5kdc[22577](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164006, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.240.254@KRBTEST.COM
I20260808 04:40:07.127967 22673 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4ecb9ee877ff450fae91d30f2669eab4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4ecb9ee877ff450fae91d30f2669eab4" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 43933 } }
I20260808 04:40:07.128351 22673 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4ecb9ee877ff450fae91d30f2669eab4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:40:07.128427 22673 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4ecb9ee877ff450fae91d30f2669eab4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4ecb9ee877ff450fae91d30f2669eab4, State: Initialized, Role: FOLLOWER
I20260808 04:40:07.129014 22673 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4ecb9ee877ff450fae91d30f2669eab4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4ecb9ee877ff450fae91d30f2669eab4" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 43933 } }
I20260808 04:40:07.129230 22673 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4ecb9ee877ff450fae91d30f2669eab4 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 04:40:07.129354 22673 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4ecb9ee877ff450fae91d30f2669eab4 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 04:40:07.129463 22673 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4ecb9ee877ff450fae91d30f2669eab4 [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:40:07.130535 22673 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4ecb9ee877ff450fae91d30f2669eab4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4ecb9ee877ff450fae91d30f2669eab4" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 43933 } }
I20260808 04:40:07.130972 22673 leader_election.cc:302] T 00000000000000000000000000000000 P 4ecb9ee877ff450fae91d30f2669eab4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4ecb9ee877ff450fae91d30f2669eab4; no voters:
I20260808 04:40:07.131419 22673 leader_election.cc:288] T 00000000000000000000000000000000 P 4ecb9ee877ff450fae91d30f2669eab4 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 04:40:07.131515 22678 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4ecb9ee877ff450fae91d30f2669eab4 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 04:40:07.131701 22678 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4ecb9ee877ff450fae91d30f2669eab4 [term 1 LEADER]: Becoming Leader. State: Replica: 4ecb9ee877ff450fae91d30f2669eab4, State: Running, Role: LEADER
I20260808 04:40:07.132084 22678 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4ecb9ee877ff450fae91d30f2669eab4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4ecb9ee877ff450fae91d30f2669eab4" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 43933 } }
I20260808 04:40:07.132871 22673 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4ecb9ee877ff450fae91d30f2669eab4 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 04:40:07.134126 22679 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4ecb9ee877ff450fae91d30f2669eab4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4ecb9ee877ff450fae91d30f2669eab4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4ecb9ee877ff450fae91d30f2669eab4" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 43933 } } }
I20260808 04:40:07.134131 22680 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4ecb9ee877ff450fae91d30f2669eab4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4ecb9ee877ff450fae91d30f2669eab4. Latest consensus state: current_term: 1 leader_uuid: "4ecb9ee877ff450fae91d30f2669eab4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4ecb9ee877ff450fae91d30f2669eab4" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 43933 } } }
I20260808 04:40:07.134342 22676 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:07.119074 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36352 (local address 127.20.240.254:43933)
0808 04:40:07.119569 (+ 495us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:07.119585 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:07.119646 (+ 61us) server_negotiation.cc:407] Connection header received
0808 04:40:07.120313 (+ 667us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:07.120330 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:07.120754 (+ 424us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:07.121201 (+ 447us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:07.122089 (+ 888us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:07.123144 (+ 1055us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:07.124557 (+ 1413us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:07.125066 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:07.125271 (+ 205us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:07.128220 (+ 2949us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:40:07.128228 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:40:07.128250 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:40:07.128290 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:40:07.130357 (+ 2067us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:07.130925 (+ 568us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:07.130930 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:07.130935 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:07.131091 (+ 156us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:07.131432 (+ 341us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:07.131438 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:07.131440 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:07.132037 (+ 597us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:40:07.132244 (+ 207us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:07.132895 (+ 651us) server_negotiation.cc:299] Negotiation successful
0808 04:40:07.133270 (+ 375us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":329,"thread_start_us":157,"threads_started":1}
I20260808 04:40:07.134387 22679 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4ecb9ee877ff450fae91d30f2669eab4 [sys.catalog]: This master's current role is: LEADER
I20260808 04:40:07.134409 22680 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4ecb9ee877ff450fae91d30f2669eab4 [sys.catalog]: This master's current role is: LEADER
W20260808 04:40:07.138140 22693 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 4ecb9ee877ff450fae91d30f2669eab4: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 04:40:07.138214 22693 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 04:40:07.138302 22687 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 04:40:07.139128 22687 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 04:40:07.144788 22687 catalog_manager.cc:1347] Generated new cluster ID: 00fe78fc9e6b4df48e18f05132394103
I20260808 04:40:07.144901 22687 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 04:40:07.156471 22687 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 04:40:07.157888 22687 catalog_manager.cc:1504] Loading token signing keys...
I20260808 04:40:07.168859 22687 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4ecb9ee877ff450fae91d30f2669eab4: Generated new TSK 0
I20260808 04:40:07.169652 22687 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.20.240.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.240.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.240.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.193.keytab.
Entry for principal kudu/127.20.240.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.193.keytab.
I20260808 04:40:07.205579 21443 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
/tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786164000593138-21443-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786164000593138-21443-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786164000593138-21443-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786164000593138-21443-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.240.193:0
--local_ip_for_outbound_sockets=127.20.240.193
--webserver_interface=127.20.240.193
--webserver_port=0
--tserver_master_addrs=127.20.240.254:43933
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.193.keytab
--principal=kudu/127.20.240.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.240.212:35519
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786164000593138-21443-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786164000593138-21443-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786164000593138-21443-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 04:40:07.325798 22701 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:40:07.326126 22701 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:40:07.326208 22701 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:40:07.330312 22701 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:40:07.330416 22701 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:40:07.330489 22701 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260808 04:40:07.330577 22701 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.240.193
I20260808 04:40:07.336776 22701 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.240.212:35519
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786164000593138-21443-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786164000593138-21443-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.193.keytab
--principal=kudu/127.20.240.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.240.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786164000593138-21443-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.240.193
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.20.240.254:43933
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22701
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.240.193
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786164000593138-21443-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 04:05:18 UTC on ccycloud.quasar-drfdgt.root.comops.site
build id 4574101
I20260808 04:40:07.338020 22701 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:40:07.339097 22701 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:40:07.349479 22707 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:40:07.349498 22706 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:40:07.349824 22701 server_base.cc:1034] running on GCE node
W20260808 04:40:07.349823 22709 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:40:07.350283 22701 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:40:07.351018 22701 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:40:07.352257 22701 hybrid_clock.cc:648] HybridClock initialized: now 1786164007352234 us; error 38 us; skew 500 ppm
Aug 08 04:40:07 dist-test-slave-vxj2 krb5kdc[22577](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164007, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.240.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:40:07.355574 22701 init.cc:377] Logged in from keytab as kudu/127.20.240.193@KRBTEST.COM (short username kudu)
I20260808 04:40:07.356590 22701 webserver.cc:460] Webserver started at http://127.20.240.193:45989/ using document root <none> and password file <none>
I20260808 04:40:07.357250 22701 fs_manager.cc:359] Metadata directory not provided
I20260808 04:40:07.357352 22701 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:40:07.357594 22701 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 04:40:07.359937 22701 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786164000593138-21443-0/minicluster-data/ts-0/data/instance:
uuid: "e3d1c1c2ef5b4ca1a6ed268c8a358c3a"
format_stamp: "Formatted at 2026-08-08 04:40:07 on dist-test-slave-vxj2"
server_key: "f802779ad0ae53590dd033ab27f30f7c"
server_key_iv: "0db3863a7fb7c7cd35c702658dd1f052"
server_key_version: "encryptionkey@0"
I20260808 04:40:07.360723 22701 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786164000593138-21443-0/minicluster-data/ts-0/wal/instance:
uuid: "e3d1c1c2ef5b4ca1a6ed268c8a358c3a"
format_stamp: "Formatted at 2026-08-08 04:40:07 on dist-test-slave-vxj2"
server_key: "f802779ad0ae53590dd033ab27f30f7c"
server_key_iv: "0db3863a7fb7c7cd35c702658dd1f052"
server_key_version: "encryptionkey@0"
I20260808 04:40:07.364979 22701 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.007s sys 0.000s
I20260808 04:40:07.367686 22716 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:07.369016 22701 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260808 04:40:07.369215 22701 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786164000593138-21443-0/minicluster-data/ts-0/data,/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786164000593138-21443-0/minicluster-data/ts-0/wal
uuid: "e3d1c1c2ef5b4ca1a6ed268c8a358c3a"
format_stamp: "Formatted at 2026-08-08 04:40:07 on dist-test-slave-vxj2"
server_key: "f802779ad0ae53590dd033ab27f30f7c"
server_key_iv: "0db3863a7fb7c7cd35c702658dd1f052"
server_key_version: "encryptionkey@0"
I20260808 04:40:07.369343 22701 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786164000593138-21443-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786164000593138-21443-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786164000593138-21443-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:40:07.388938 22701 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:40:07.392489 22701 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:40:07.392688 22701 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:40:07.394577 22701 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 04:40:07.394639 22701 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:07.394723 22701 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 04:40:07.394764 22701 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 08 04:40:07 dist-test-slave-vxj2 krb5kdc[22577](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164007, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.240.193@KRBTEST.COM for kudu/127.20.240.254@KRBTEST.COM
I20260808 04:40:07.408553 22701 rpc_server.cc:307] RPC server started. Bound to: 127.20.240.193:35345
I20260808 04:40:07.408833 22835 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.240.193:35345 every 8 connection(s)
I20260808 04:40:07.409924 22701 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786164000593138-21443-0/minicluster-data/ts-0/data/info.pb
I20260808 04:40:07.412336 22676 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:07.395366 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.240.193:59861 (local address 127.20.240.254:43933)
0808 04:40:07.395526 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:07.395530 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:07.397265 (+ 1735us) server_negotiation.cc:407] Connection header received
0808 04:40:07.398805 (+ 1540us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:07.398810 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:07.398889 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:07.399022 (+ 133us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:07.401111 (+ 2089us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:07.402031 (+ 920us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:07.404004 (+ 1973us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:07.404407 (+ 403us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:07.404548 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:07.408073 (+ 3525us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:40:07.408079 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:40:07.408085 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:40:07.408126 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:40:07.410055 (+ 1929us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:07.410749 (+ 694us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:07.410753 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:07.410755 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:07.410871 (+ 116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:07.411303 (+ 432us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:07.411306 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:07.411307 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:07.411513 (+ 206us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:40:07.411597 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:07.412084 (+ 487us) server_negotiation.cc:299] Negotiation successful
0808 04:40:07.412204 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260808 04:40:07.413271 22726 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:07.396430 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:43933 (local address 127.20.240.193:59861)
0808 04:40:07.397021 (+ 591us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:07.397123 (+ 102us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:07.398480 (+ 1357us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:07.399405 (+ 925us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:07.399419 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:07.399971 (+ 552us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:40:07.400860 (+ 889us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:07.400893 (+ 33us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:07.402216 (+ 1323us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:07.402220 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:07.403854 (+ 1634us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:07.403867 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:07.404599 (+ 732us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:07.404603 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:07.404814 (+ 211us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:07.405616 (+ 802us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:40:07.405633 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:40:07.407849 (+ 2216us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:40:07.410188 (+ 2339us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:07.410199 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:07.410213 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:07.410599 (+ 386us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:07.410986 (+ 387us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:07.410989 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:07.410991 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:07.411180 (+ 189us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:07.411612 (+ 432us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:40:07.411616 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:40:07.411860 (+ 244us) client_negotiation.cc:769] Sending connection context
0808 04:40:07.412027 (+ 167us) client_negotiation.cc:240] Negotiation successful
0808 04:40:07.412299 (+ 272us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":313,"thread_start_us":158,"threads_started":1}
I20260808 04:40:07.413815 21443 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu as pid 22701
I20260808 04:40:07.413956 21443 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786164000593138-21443-0/minicluster-data/ts-0/wal/instance
I20260808 04:40:07.414404 21443 external_mini_cluster.cc:1428] Setting key d2285db0fa84797327fa19810dd92556
I20260808 04:40:07.415004 22836 heartbeater.cc:347] Connected to a master server at 127.20.240.254:43933
I20260808 04:40:07.415205 22836 heartbeater.cc:464] Registering TS with master...
I20260808 04:40:07.415925 22836 heartbeater.cc:511] Master 127.20.240.254:43933 requested a full tablet report, sending...
I20260808 04:40:07.417758 22623 ts_manager.cc:194] Registered new tserver with Master: e3d1c1c2ef5b4ca1a6ed268c8a358c3a (127.20.240.193:35345)
I20260808 04:40:07.419222 22623 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.240.193@KRBTEST.COM'} at 127.20.240.193:59861
WARNING: no policy specified for kudu/127.20.240.194@KRBTEST.COM; defaulting to no policy
I20260808 04:40:07.427505 22844 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:07.418188 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:43933 (local address 127.20.240.193:37139)
0808 04:40:07.418618 (+ 430us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:07.418636 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:07.418735 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:07.420283 (+ 1548us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:07.420289 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:07.420663 (+ 374us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:40:07.420963 (+ 300us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:07.420979 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:07.422099 (+ 1120us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:07.422102 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:07.422679 (+ 577us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:07.422688 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:07.423209 (+ 521us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:07.423213 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:07.423307 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:07.423871 (+ 564us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:40:07.423883 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:40:07.424209 (+ 326us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:40:07.426078 (+ 1869us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:07.426081 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:07.426082 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:07.426281 (+ 199us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:07.426616 (+ 335us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:07.426618 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:07.426620 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:07.426707 (+ 87us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:07.427074 (+ 367us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:40:07.427076 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:40:07.427153 (+ 77us) client_negotiation.cc:769] Sending connection context
0808 04:40:07.427237 (+ 84us) client_negotiation.cc:240] Negotiation successful
0808 04:40:07.427360 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":331,"thread_start_us":207,"threads_started":1}
I20260808 04:40:07.427696 22676 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:07.419858 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.240.193:37139 (local address 127.20.240.254:43933)
0808 04:40:07.420002 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:07.420006 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:07.420020 (+ 14us) server_negotiation.cc:407] Connection header received
0808 04:40:07.420058 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:07.420060 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:07.420130 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:07.420223 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:07.421137 (+ 914us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:07.421966 (+ 829us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:07.422854 (+ 888us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:07.423087 (+ 233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:07.423203 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:07.424361 (+ 1158us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:40:07.424365 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:40:07.424367 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:40:07.424398 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:40:07.425971 (+ 1573us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:07.426438 (+ 467us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:07.426441 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:07.426442 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:07.426532 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:07.426789 (+ 257us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:07.426791 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:07.426792 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:07.426955 (+ 163us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:40:07.427066 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:07.427306 (+ 240us) server_negotiation.cc:299] Negotiation successful
0808 04:40:07.427498 (+ 192us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.240.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.240.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.194.keytab.
Entry for principal kudu/127.20.240.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.194.keytab.
I20260808 04:40:07.444347 21443 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
/tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786164000593138-21443-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786164000593138-21443-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786164000593138-21443-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786164000593138-21443-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.240.194:0
--local_ip_for_outbound_sockets=127.20.240.194
--webserver_interface=127.20.240.194
--webserver_port=0
--tserver_master_addrs=127.20.240.254:43933
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.194.keytab
--principal=kudu/127.20.240.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.240.212:35519
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786164000593138-21443-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786164000593138-21443-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786164000593138-21443-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 04:40:07.576614 22846 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:40:07.576983 22846 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:40:07.577068 22846 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:40:07.581339 22846 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:40:07.581401 22846 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:40:07.581472 22846 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260808 04:40:07.581542 22846 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.240.194
I20260808 04:40:07.587029 22846 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.240.212:35519
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786164000593138-21443-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786164000593138-21443-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.194.keytab
--principal=kudu/127.20.240.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.240.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786164000593138-21443-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.240.194
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.20.240.254:43933
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22846
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.240.194
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786164000593138-21443-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 04:05:18 UTC on ccycloud.quasar-drfdgt.root.comops.site
build id 4574101
I20260808 04:40:07.588191 22846 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:40:07.589282 22846 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:40:07.599279 22853 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:40:07.599370 22846 server_base.cc:1034] running on GCE node
W20260808 04:40:07.599256 22852 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:40:07.599320 22855 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:40:07.599978 22846 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:40:07.600677 22846 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:40:07.601871 22846 hybrid_clock.cc:648] HybridClock initialized: now 1786164007601851 us; error 29 us; skew 500 ppm
Aug 08 04:40:07 dist-test-slave-vxj2 krb5kdc[22577](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164007, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.240.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:40:07.604792 22846 init.cc:377] Logged in from keytab as kudu/127.20.240.194@KRBTEST.COM (short username kudu)
I20260808 04:40:07.605777 22846 webserver.cc:460] Webserver started at http://127.20.240.194:44243/ using document root <none> and password file <none>
I20260808 04:40:07.606563 22846 fs_manager.cc:359] Metadata directory not provided
I20260808 04:40:07.606784 22846 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:40:07.607069 22846 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 04:40:07.609752 22846 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786164000593138-21443-0/minicluster-data/ts-1/data/instance:
uuid: "eef3e5b55032492194cd3df63c04ab1a"
format_stamp: "Formatted at 2026-08-08 04:40:07 on dist-test-slave-vxj2"
server_key: "29c8e2384a40166a7d7b14301c459769"
server_key_iv: "b649ccb9e0df108d7953c4352483f4bf"
server_key_version: "encryptionkey@0"
I20260808 04:40:07.610476 22846 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786164000593138-21443-0/minicluster-data/ts-1/wal/instance:
uuid: "eef3e5b55032492194cd3df63c04ab1a"
format_stamp: "Formatted at 2026-08-08 04:40:07 on dist-test-slave-vxj2"
server_key: "29c8e2384a40166a7d7b14301c459769"
server_key_iv: "b649ccb9e0df108d7953c4352483f4bf"
server_key_version: "encryptionkey@0"
I20260808 04:40:07.615217 22846 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260808 04:40:07.618083 22862 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:07.619428 22846 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 04:40:07.619580 22846 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786164000593138-21443-0/minicluster-data/ts-1/data,/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786164000593138-21443-0/minicluster-data/ts-1/wal
uuid: "eef3e5b55032492194cd3df63c04ab1a"
format_stamp: "Formatted at 2026-08-08 04:40:07 on dist-test-slave-vxj2"
server_key: "29c8e2384a40166a7d7b14301c459769"
server_key_iv: "b649ccb9e0df108d7953c4352483f4bf"
server_key_version: "encryptionkey@0"
I20260808 04:40:07.619701 22846 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786164000593138-21443-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786164000593138-21443-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786164000593138-21443-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:40:07.646344 22846 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:40:07.649462 22846 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:40:07.649678 22846 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:40:07.651283 22846 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 04:40:07.651357 22846 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:07.651427 22846 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 04:40:07.651468 22846 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 08 04:40:07 dist-test-slave-vxj2 krb5kdc[22577](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164007, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.240.194@KRBTEST.COM for kudu/127.20.240.254@KRBTEST.COM
I20260808 04:40:07.665369 22846 rpc_server.cc:307] RPC server started. Bound to: 127.20.240.194:39177
I20260808 04:40:07.665479 22983 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.240.194:39177 every 8 connection(s)
I20260808 04:40:07.666491 22846 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786164000593138-21443-0/minicluster-data/ts-1/data/info.pb
I20260808 04:40:07.666636 22676 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:07.652163 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.240.194:42977 (local address 127.20.240.254:43933)
0808 04:40:07.652298 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:07.652302 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:07.653538 (+ 1236us) server_negotiation.cc:407] Connection header received
0808 04:40:07.654514 (+ 976us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:07.654518 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:07.654621 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:07.654718 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:07.656124 (+ 1406us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:07.656722 (+ 598us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:07.658042 (+ 1320us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:07.658286 (+ 244us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:07.658412 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:07.662288 (+ 3876us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:40:07.662293 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:40:07.662296 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:40:07.662330 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:40:07.664233 (+ 1903us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:07.664845 (+ 612us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:07.664849 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:07.664851 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:07.664959 (+ 108us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:07.665447 (+ 488us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:07.665450 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:07.665452 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:07.665674 (+ 222us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:40:07.665779 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:07.666304 (+ 525us) server_negotiation.cc:299] Negotiation successful
0808 04:40:07.666464 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260808 04:40:07.667433 22871 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:07.652721 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:43933 (local address 127.20.240.194:42977)
0808 04:40:07.653388 (+ 667us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:07.653432 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:07.654290 (+ 858us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:07.654926 (+ 636us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:07.654936 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:07.655376 (+ 440us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:40:07.655964 (+ 588us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:07.656001 (+ 37us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:07.656858 (+ 857us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:07.656862 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:07.657910 (+ 1048us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:07.657920 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:07.658457 (+ 537us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:07.658462 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:07.658646 (+ 184us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:07.659311 (+ 665us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:40:07.659330 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:40:07.662076 (+ 2746us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:40:07.664364 (+ 2288us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:07.664369 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:07.664381 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:07.664704 (+ 323us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:07.665088 (+ 384us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:07.665092 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:07.665094 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:07.665309 (+ 215us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:07.665781 (+ 472us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:40:07.665785 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:40:07.666030 (+ 245us) client_negotiation.cc:769] Sending connection context
0808 04:40:07.666195 (+ 165us) client_negotiation.cc:240] Negotiation successful
0808 04:40:07.666449 (+ 254us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":439,"thread_start_us":146,"threads_started":1}
I20260808 04:40:07.668846 22984 heartbeater.cc:347] Connected to a master server at 127.20.240.254:43933
I20260808 04:40:07.669121 22984 heartbeater.cc:464] Registering TS with master...
I20260808 04:40:07.669765 22984 heartbeater.cc:511] Master 127.20.240.254:43933 requested a full tablet report, sending...
I20260808 04:40:07.670924 22624 ts_manager.cc:194] Registered new tserver with Master: eef3e5b55032492194cd3df63c04ab1a (127.20.240.194:39177)
I20260808 04:40:07.671744 22624 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.240.194@KRBTEST.COM'} at 127.20.240.194:42977
I20260808 04:40:07.672533 21443 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu as pid 22846
I20260808 04:40:07.672621 21443 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786164000593138-21443-0/minicluster-data/ts-1/wal/instance
I20260808 04:40:07.672919 21443 external_mini_cluster.cc:1428] Setting key 03e2c812606a3c4057513e1a366fbd43
I20260808 04:40:07.680696 22676 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:07.671385 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.240.194:47259 (local address 127.20.240.254:43933)
0808 04:40:07.671517 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:07.671521 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:07.671637 (+ 116us) server_negotiation.cc:407] Connection header received
0808 04:40:07.671759 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:07.671761 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:07.671795 (+ 34us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:07.671895 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:07.673378 (+ 1483us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:07.674016 (+ 638us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:07.675040 (+ 1024us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:07.675462 (+ 422us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:07.675590 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:07.677044 (+ 1454us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:40:07.677047 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:40:07.677049 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:40:07.677072 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:40:07.678620 (+ 1548us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:07.679215 (+ 595us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:07.679218 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:07.679219 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:07.679339 (+ 120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:07.679659 (+ 320us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:07.679661 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:07.679663 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:07.679910 (+ 247us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:40:07.679993 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:07.680407 (+ 414us) server_negotiation.cc:299] Negotiation successful
0808 04:40:07.680519 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260808 04:40:07.680862 22990 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:07.671259 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:43933 (local address 127.20.240.194:47259)
0808 04:40:07.671568 (+ 309us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:07.671583 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:07.671679 (+ 96us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:07.671911 (+ 232us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:07.671914 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:07.672119 (+ 205us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:40:07.672218 (+ 99us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:07.672224 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:07.674179 (+ 1955us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:07.674182 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:07.674903 (+ 721us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:07.674914 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:07.675589 (+ 675us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:07.675591 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:07.675666 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:07.676351 (+ 685us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:40:07.676370 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:40:07.676894 (+ 524us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:40:07.678772 (+ 1878us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:07.678779 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:07.678783 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:07.679091 (+ 308us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:07.679436 (+ 345us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:07.679443 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:07.679448 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:07.679557 (+ 109us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:07.680017 (+ 460us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:40:07.680022 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:40:07.680155 (+ 133us) client_negotiation.cc:769] Sending connection context
0808 04:40:07.680340 (+ 185us) client_negotiation.cc:240] Negotiation successful
0808 04:40:07.680543 (+ 203us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":225,"thread_start_us":97,"threads_started":1}
WARNING: no policy specified for kudu/127.20.240.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.240.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.240.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.195.keytab.
Entry for principal kudu/127.20.240.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.195.keytab.
I20260808 04:40:07.704067 21443 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
/tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786164000593138-21443-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786164000593138-21443-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786164000593138-21443-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786164000593138-21443-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.240.195:0
--local_ip_for_outbound_sockets=127.20.240.195
--webserver_interface=127.20.240.195
--webserver_port=0
--tserver_master_addrs=127.20.240.254:43933
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.195.keytab
--principal=kudu/127.20.240.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.240.212:35519
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786164000593138-21443-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786164000593138-21443-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786164000593138-21443-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 04:40:07.820103 22993 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:40:07.820437 22993 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:40:07.820521 22993 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:40:07.825649 22993 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:40:07.825749 22993 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:40:07.825829 22993 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260808 04:40:07.825913 22993 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.240.195
I20260808 04:40:07.834141 22993 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.240.212:35519
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786164000593138-21443-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786164000593138-21443-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.195.keytab
--principal=kudu/127.20.240.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.240.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786164000593138-21443-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.240.195
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.20.240.254:43933
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22993
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.240.195
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786164000593138-21443-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 04:05:18 UTC on ccycloud.quasar-drfdgt.root.comops.site
build id 4574101
I20260808 04:40:07.835391 22993 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:40:07.836409 22993 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260808 04:40:07.846632 22993 server_base.cc:1034] running on GCE node
W20260808 04:40:07.846601 22999 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:40:07.846675 22998 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:40:07.846658 23001 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:40:07.847572 22993 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:40:07.848253 22993 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:40:07.849419 22993 hybrid_clock.cc:648] HybridClock initialized: now 1786164007849406 us; error 31 us; skew 500 ppm
Aug 08 04:40:07 dist-test-slave-vxj2 krb5kdc[22577](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164007, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.240.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:40:07.852403 22993 init.cc:377] Logged in from keytab as kudu/127.20.240.195@KRBTEST.COM (short username kudu)
I20260808 04:40:07.853389 22993 webserver.cc:460] Webserver started at http://127.20.240.195:36455/ using document root <none> and password file <none>
I20260808 04:40:07.853956 22993 fs_manager.cc:359] Metadata directory not provided
I20260808 04:40:07.854020 22993 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:40:07.854261 22993 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 04:40:07.856323 22993 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786164000593138-21443-0/minicluster-data/ts-2/data/instance:
uuid: "02628df318bf414195901aba8b58e2d9"
format_stamp: "Formatted at 2026-08-08 04:40:07 on dist-test-slave-vxj2"
server_key: "01036cb4fa0d5dba99a0cfff1e3afb47"
server_key_iv: "c2bd6fd26296e3c9a37fc5ed47682d91"
server_key_version: "encryptionkey@0"
I20260808 04:40:07.856912 22993 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786164000593138-21443-0/minicluster-data/ts-2/wal/instance:
uuid: "02628df318bf414195901aba8b58e2d9"
format_stamp: "Formatted at 2026-08-08 04:40:07 on dist-test-slave-vxj2"
server_key: "01036cb4fa0d5dba99a0cfff1e3afb47"
server_key_iv: "c2bd6fd26296e3c9a37fc5ed47682d91"
server_key_version: "encryptionkey@0"
I20260808 04:40:07.860644 22993 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.000s
I20260808 04:40:07.863075 23009 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:07.864277 22993 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 04:40:07.864429 22993 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786164000593138-21443-0/minicluster-data/ts-2/data,/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786164000593138-21443-0/minicluster-data/ts-2/wal
uuid: "02628df318bf414195901aba8b58e2d9"
format_stamp: "Formatted at 2026-08-08 04:40:07 on dist-test-slave-vxj2"
server_key: "01036cb4fa0d5dba99a0cfff1e3afb47"
server_key_iv: "c2bd6fd26296e3c9a37fc5ed47682d91"
server_key_version: "encryptionkey@0"
I20260808 04:40:07.864548 22993 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786164000593138-21443-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786164000593138-21443-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786164000593138-21443-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:40:07.886981 22993 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:40:07.890239 22993 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:40:07.890456 22993 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:40:07.891978 22993 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 04:40:07.892052 22993 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:07.892119 22993 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 04:40:07.892161 22993 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 08 04:40:07 dist-test-slave-vxj2 krb5kdc[22577](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164007, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.240.195@KRBTEST.COM for kudu/127.20.240.254@KRBTEST.COM
I20260808 04:40:07.903460 22993 rpc_server.cc:307] RPC server started. Bound to: 127.20.240.195:45719
I20260808 04:40:07.903545 23128 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.240.195:45719 every 8 connection(s)
I20260808 04:40:07.904420 22993 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786164000593138-21443-0/minicluster-data/ts-2/data/info.pb
I20260808 04:40:07.906059 22676 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:07.892676 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.240.195:42663 (local address 127.20.240.254:43933)
0808 04:40:07.892847 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:07.892854 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:07.894221 (+ 1367us) server_negotiation.cc:407] Connection header received
0808 04:40:07.895392 (+ 1171us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:07.895395 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:07.895450 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:07.895557 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:07.896796 (+ 1239us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:07.897406 (+ 610us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:07.898759 (+ 1353us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:07.899109 (+ 350us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:07.899230 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:07.902046 (+ 2816us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:40:07.902053 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:40:07.902056 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:40:07.902087 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:40:07.903778 (+ 1691us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:07.904289 (+ 511us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:07.904293 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:07.904295 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:07.904392 (+ 97us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:07.904792 (+ 400us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:07.904795 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:07.904797 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:07.905014 (+ 217us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:40:07.905114 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:07.905791 (+ 677us) server_negotiation.cc:299] Negotiation successful
0808 04:40:07.905934 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260808 04:40:07.906774 23018 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:07.893600 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:43933 (local address 127.20.240.195:42663)
0808 04:40:07.894047 (+ 447us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:07.894098 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:07.895163 (+ 1065us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:07.895725 (+ 562us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:07.895737 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:07.896119 (+ 382us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:40:07.896648 (+ 529us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:07.896662 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:07.897532 (+ 870us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:07.897535 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:07.898631 (+ 1096us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:07.898644 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:07.899273 (+ 629us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:07.899277 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:07.899494 (+ 217us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:07.900129 (+ 635us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:40:07.900146 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:40:07.901881 (+ 1735us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:40:07.903892 (+ 2011us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:07.903899 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:07.903916 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:07.904183 (+ 267us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:07.904502 (+ 319us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:07.904505 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:07.904507 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:07.904685 (+ 178us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:07.905184 (+ 499us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:40:07.905190 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:40:07.905476 (+ 286us) client_negotiation.cc:769] Sending connection context
0808 04:40:07.905682 (+ 206us) client_negotiation.cc:240] Negotiation successful
0808 04:40:07.905949 (+ 267us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":243,"thread_start_us":133,"threads_started":1}
I20260808 04:40:07.907886 23129 heartbeater.cc:347] Connected to a master server at 127.20.240.254:43933
I20260808 04:40:07.908059 23129 heartbeater.cc:464] Registering TS with master...
I20260808 04:40:07.908556 23129 heartbeater.cc:511] Master 127.20.240.254:43933 requested a full tablet report, sending...
I20260808 04:40:07.909633 22623 ts_manager.cc:194] Registered new tserver with Master: 02628df318bf414195901aba8b58e2d9 (127.20.240.195:45719)
I20260808 04:40:07.910296 22623 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.240.195@KRBTEST.COM'} at 127.20.240.195:42663
I20260808 04:40:07.911437 21443 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu as pid 22993
I20260808 04:40:07.911579 21443 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786164000593138-21443-0/minicluster-data/ts-2/wal/instance
I20260808 04:40:07.911821 21443 external_mini_cluster.cc:1428] Setting key 2b29469ed0277790b38ae5d53410d16d
I20260808 04:40:07.913951 21443 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 04:40:07.917842 23135 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:07.910121 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:43933 (local address 127.20.240.195:53529)
0808 04:40:07.910460 (+ 339us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:07.910473 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:07.910598 (+ 125us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:07.910834 (+ 236us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:07.910837 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:07.911043 (+ 206us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:40:07.911142 (+ 99us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:07.911170 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:07.912207 (+ 1037us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:07.912210 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:07.912881 (+ 671us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:07.912890 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:07.913434 (+ 544us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:07.913438 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:07.913528 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:07.914113 (+ 585us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:40:07.914124 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:40:07.914441 (+ 317us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:40:07.916261 (+ 1820us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:07.916264 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:07.916266 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:07.916476 (+ 210us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:07.916772 (+ 296us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:07.916774 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:07.916775 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:07.916849 (+ 74us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:07.917350 (+ 501us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:40:07.917352 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:40:07.917448 (+ 96us) client_negotiation.cc:769] Sending connection context
0808 04:40:07.917571 (+ 123us) client_negotiation.cc:240] Negotiation successful
0808 04:40:07.917703 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":261,"thread_start_us":109,"threads_started":1}
I20260808 04:40:07.918015 22676 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:07.910201 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.240.195:53529 (local address 127.20.240.254:43933)
0808 04:40:07.910344 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:07.910351 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:07.910579 (+ 228us) server_negotiation.cc:407] Connection header received
0808 04:40:07.910683 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:07.910685 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:07.910720 (+ 35us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:07.910788 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:07.911294 (+ 506us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:07.912044 (+ 750us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:07.912982 (+ 938us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:07.913321 (+ 339us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:07.913406 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:07.914592 (+ 1186us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:40:07.914596 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:40:07.914600 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:40:07.914629 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:40:07.916120 (+ 1491us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:07.916572 (+ 452us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:07.916577 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:07.916580 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:07.916676 (+ 96us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:07.916935 (+ 259us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:07.916941 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:07.916943 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:07.917234 (+ 291us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:40:07.917358 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:07.917652 (+ 294us) server_negotiation.cc:299] Negotiation successful
0808 04:40:07.917788 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
Aug 08 04:40:07 dist-test-slave-vxj2 krb5kdc[22577](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164007, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 08 04:40:07 dist-test-slave-vxj2 krb5kdc[22577](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164007, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.20.240.254@KRBTEST.COM
I20260808 04:40:07.942406 22676 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:07.933328 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36364 (local address 127.20.240.254:43933)
0808 04:40:07.933492 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:07.933495 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:07.933508 (+ 13us) server_negotiation.cc:407] Connection header received
0808 04:40:07.933549 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:07.933551 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:07.933631 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:07.933722 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:07.934535 (+ 813us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:07.935128 (+ 593us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:07.936054 (+ 926us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:07.936287 (+ 233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:07.936406 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:07.938890 (+ 2484us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:40:07.938894 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:40:07.938895 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:40:07.938922 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:40:07.940601 (+ 1679us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:07.941027 (+ 426us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:07.941031 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:07.941033 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:07.941122 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:07.941470 (+ 348us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:07.941474 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:07.941475 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:07.941673 (+ 198us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:40:07.941817 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:07.942167 (+ 350us) server_negotiation.cc:299] Negotiation successful
0808 04:40:07.942272 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260808 04:40:07.945555 22623 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:36364:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 04:40:07.948707 22623 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 04:40:07.964534 23152 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:07.958382 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57148 (local address 127.20.240.195:45719)
0808 04:40:07.958995 (+ 613us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:07.959006 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:07.959023 (+ 17us) server_negotiation.cc:407] Connection header received
0808 04:40:07.959098 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:07.959109 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:07.959250 (+ 141us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:07.959876 (+ 626us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 04:40:07.960006 (+ 130us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:07.961135 (+ 1129us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:07.963153 (+ 2018us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:07.963803 (+ 650us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:07.963967 (+ 164us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:07.964106 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:07.964265 (+ 159us) server_negotiation.cc:299] Negotiation successful
0808 04:40:07.964372 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":522,"thread_start_us":119,"threads_started":1}
I20260808 04:40:07.964584 23147 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:07.957581 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.195:45719 (local address 127.0.0.1:57148)
0808 04:40:07.958408 (+ 827us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:07.958422 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:07.958511 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:07.959427 (+ 916us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:07.959434 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:07.959472 (+ 38us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 04:40:07.959730 (+ 258us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:07.959739 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:07.961278 (+ 1539us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:07.961281 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:07.963012 (+ 1731us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:07.963024 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:07.963931 (+ 907us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:07.963935 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:07.964049 (+ 114us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:07.964086 (+ 37us) client_negotiation.cc:769] Sending connection context
0808 04:40:07.964224 (+ 138us) client_negotiation.cc:240] Negotiation successful
0808 04:40:07.964413 (+ 189us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":737,"mutex_wait_us":248,"spinlock_wait_cycles":12928,"thread_start_us":93,"threads_started":1}
I20260808 04:40:07.964596 23151 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:07.958299 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.193:35345 (local address 127.0.0.1:46402)
0808 04:40:07.958594 (+ 295us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:07.958608 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:07.958731 (+ 123us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:07.959427 (+ 696us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:07.959434 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:07.959470 (+ 36us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 04:40:07.959783 (+ 313us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:07.959791 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:07.961276 (+ 1485us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:07.961281 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:07.963012 (+ 1731us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:07.963024 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:07.964078 (+ 1054us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:07.964082 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:07.964172 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:07.964203 (+ 31us) client_negotiation.cc:769] Sending connection context
0808 04:40:07.964257 (+ 54us) client_negotiation.cc:240] Negotiation successful
0808 04:40:07.964412 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":238,"mutex_wait_us":287,"spinlock_wait_cycles":6656,"thread_start_us":88,"threads_started":1}
I20260808 04:40:07.964960 23148 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:07.957562 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.194:39177 (local address 127.0.0.1:60972)
0808 04:40:07.958008 (+ 446us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:07.958064 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:07.958197 (+ 133us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:07.959532 (+ 1335us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:07.959535 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:07.959565 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 04:40:07.959787 (+ 222us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:07.959792 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:07.962479 (+ 2687us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:07.962482 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:07.963297 (+ 815us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:07.963307 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:07.964558 (+ 1251us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:07.964562 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:07.964681 (+ 119us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:07.964705 (+ 24us) client_negotiation.cc:769] Sending connection context
0808 04:40:07.964777 (+ 72us) client_negotiation.cc:240] Negotiation successful
0808 04:40:07.964843 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":254,"mutex_wait_us":71,"spinlock_wait_cycles":2304,"thread_start_us":67,"threads_started":1}
I20260808 04:40:07.965267 23153 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:07.958526 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46402 (local address 127.20.240.193:35345)
0808 04:40:07.958880 (+ 354us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:07.958888 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:07.958912 (+ 24us) server_negotiation.cc:407] Connection header received
0808 04:40:07.958985 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:07.958990 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:07.959243 (+ 253us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:07.959654 (+ 411us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 04:40:07.959912 (+ 258us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:07.961115 (+ 1203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:07.963168 (+ 2053us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:07.963930 (+ 762us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:07.964841 (+ 911us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:07.964964 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:07.965019 (+ 55us) server_negotiation.cc:299] Negotiation successful
0808 04:40:07.965114 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":247,"thread_start_us":113,"threads_started":1}
I20260808 04:40:07.965394 23150 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:07.957729 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60972 (local address 127.20.240.194:39177)
0808 04:40:07.958213 (+ 484us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:07.958227 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:07.958253 (+ 26us) server_negotiation.cc:407] Connection header received
0808 04:40:07.958881 (+ 628us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:07.958888 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:07.959190 (+ 302us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:07.959362 (+ 172us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 04:40:07.961343 (+ 1981us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:07.962313 (+ 970us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:07.963445 (+ 1132us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:07.964231 (+ 786us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:07.964377 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:07.964495 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:07.965113 (+ 618us) server_negotiation.cc:299] Negotiation successful
0808 04:40:07.965225 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":380,"thread_start_us":140,"threads_started":1}
I20260808 04:40:07.967948 23060 tablet_service.cc:1467] Processing CreateTablet for tablet 73363ce91ac7448892d7a2ad82f7b00f (DEFAULT_TABLE table=test-table [id=3b31779783164dbb8a5a81b10fbeaf1e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 04:40:07.968077 22913 tablet_service.cc:1467] Processing CreateTablet for tablet 73363ce91ac7448892d7a2ad82f7b00f (DEFAULT_TABLE table=test-table [id=3b31779783164dbb8a5a81b10fbeaf1e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 04:40:07.968070 22767 tablet_service.cc:1467] Processing CreateTablet for tablet 73363ce91ac7448892d7a2ad82f7b00f (DEFAULT_TABLE table=test-table [id=3b31779783164dbb8a5a81b10fbeaf1e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 04:40:07.969244 22913 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 73363ce91ac7448892d7a2ad82f7b00f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:40:07.969244 22767 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 73363ce91ac7448892d7a2ad82f7b00f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:40:07.969261 23060 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 73363ce91ac7448892d7a2ad82f7b00f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:40:07.976802 23154 tablet_bootstrap.cc:492] T 73363ce91ac7448892d7a2ad82f7b00f P 02628df318bf414195901aba8b58e2d9: Bootstrap starting.
I20260808 04:40:07.977916 23156 tablet_bootstrap.cc:492] T 73363ce91ac7448892d7a2ad82f7b00f P eef3e5b55032492194cd3df63c04ab1a: Bootstrap starting.
I20260808 04:40:07.979290 23154 tablet_bootstrap.cc:654] T 73363ce91ac7448892d7a2ad82f7b00f P 02628df318bf414195901aba8b58e2d9: Neither blocks nor log segments found. Creating new log.
I20260808 04:40:07.979825 23156 tablet_bootstrap.cc:654] T 73363ce91ac7448892d7a2ad82f7b00f P eef3e5b55032492194cd3df63c04ab1a: Neither blocks nor log segments found. Creating new log.
I20260808 04:40:07.980105 23154 log.cc:824] T 73363ce91ac7448892d7a2ad82f7b00f P 02628df318bf414195901aba8b58e2d9: Log is configured to *not* fsync() on all Append() calls
I20260808 04:40:07.980590 23156 log.cc:824] T 73363ce91ac7448892d7a2ad82f7b00f P eef3e5b55032492194cd3df63c04ab1a: Log is configured to *not* fsync() on all Append() calls
I20260808 04:40:07.980765 23155 tablet_bootstrap.cc:492] T 73363ce91ac7448892d7a2ad82f7b00f P e3d1c1c2ef5b4ca1a6ed268c8a358c3a: Bootstrap starting.
I20260808 04:40:07.982362 23156 tablet_bootstrap.cc:492] T 73363ce91ac7448892d7a2ad82f7b00f P eef3e5b55032492194cd3df63c04ab1a: No bootstrap required, opened a new log
I20260808 04:40:07.982394 23154 tablet_bootstrap.cc:492] T 73363ce91ac7448892d7a2ad82f7b00f P 02628df318bf414195901aba8b58e2d9: No bootstrap required, opened a new log
I20260808 04:40:07.982575 23156 ts_tablet_manager.cc:1397] T 73363ce91ac7448892d7a2ad82f7b00f P eef3e5b55032492194cd3df63c04ab1a: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260808 04:40:07.982571 23154 ts_tablet_manager.cc:1397] T 73363ce91ac7448892d7a2ad82f7b00f P 02628df318bf414195901aba8b58e2d9: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260808 04:40:07.982923 23155 tablet_bootstrap.cc:654] T 73363ce91ac7448892d7a2ad82f7b00f P e3d1c1c2ef5b4ca1a6ed268c8a358c3a: Neither blocks nor log segments found. Creating new log.
I20260808 04:40:07.983852 23155 log.cc:824] T 73363ce91ac7448892d7a2ad82f7b00f P e3d1c1c2ef5b4ca1a6ed268c8a358c3a: Log is configured to *not* fsync() on all Append() calls
I20260808 04:40:07.985903 23155 tablet_bootstrap.cc:492] T 73363ce91ac7448892d7a2ad82f7b00f P e3d1c1c2ef5b4ca1a6ed268c8a358c3a: No bootstrap required, opened a new log
I20260808 04:40:07.986110 23155 ts_tablet_manager.cc:1397] T 73363ce91ac7448892d7a2ad82f7b00f P e3d1c1c2ef5b4ca1a6ed268c8a358c3a: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260808 04:40:07.986239 23156 raft_consensus.cc:348] T 73363ce91ac7448892d7a2ad82f7b00f P eef3e5b55032492194cd3df63c04ab1a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eef3e5b55032492194cd3df63c04ab1a" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 39177 } } peers { permanent_uuid: "02628df318bf414195901aba8b58e2d9" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 45719 } } peers { permanent_uuid: "e3d1c1c2ef5b4ca1a6ed268c8a358c3a" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 35345 } }
I20260808 04:40:07.986505 23156 raft_consensus.cc:374] T 73363ce91ac7448892d7a2ad82f7b00f P eef3e5b55032492194cd3df63c04ab1a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:40:07.986588 23156 raft_consensus.cc:729] T 73363ce91ac7448892d7a2ad82f7b00f P eef3e5b55032492194cd3df63c04ab1a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eef3e5b55032492194cd3df63c04ab1a, State: Initialized, Role: FOLLOWER
I20260808 04:40:07.986660 23154 raft_consensus.cc:348] T 73363ce91ac7448892d7a2ad82f7b00f P 02628df318bf414195901aba8b58e2d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eef3e5b55032492194cd3df63c04ab1a" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 39177 } } peers { permanent_uuid: "02628df318bf414195901aba8b58e2d9" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 45719 } } peers { permanent_uuid: "e3d1c1c2ef5b4ca1a6ed268c8a358c3a" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 35345 } }
I20260808 04:40:07.986934 23154 raft_consensus.cc:374] T 73363ce91ac7448892d7a2ad82f7b00f P 02628df318bf414195901aba8b58e2d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:40:07.986995 23154 raft_consensus.cc:729] T 73363ce91ac7448892d7a2ad82f7b00f P 02628df318bf414195901aba8b58e2d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 02628df318bf414195901aba8b58e2d9, State: Initialized, Role: FOLLOWER
I20260808 04:40:07.987110 23156 consensus_queue.cc:260] T 73363ce91ac7448892d7a2ad82f7b00f P eef3e5b55032492194cd3df63c04ab1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eef3e5b55032492194cd3df63c04ab1a" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 39177 } } peers { permanent_uuid: "02628df318bf414195901aba8b58e2d9" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 45719 } } peers { permanent_uuid: "e3d1c1c2ef5b4ca1a6ed268c8a358c3a" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 35345 } }
I20260808 04:40:07.987478 23154 consensus_queue.cc:260] T 73363ce91ac7448892d7a2ad82f7b00f P 02628df318bf414195901aba8b58e2d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eef3e5b55032492194cd3df63c04ab1a" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 39177 } } peers { permanent_uuid: "02628df318bf414195901aba8b58e2d9" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 45719 } } peers { permanent_uuid: "e3d1c1c2ef5b4ca1a6ed268c8a358c3a" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 35345 } }
I20260808 04:40:07.987818 22984 heartbeater.cc:503] Master 127.20.240.254:43933 was elected leader, sending a full tablet report...
I20260808 04:40:07.988173 23156 ts_tablet_manager.cc:1428] T 73363ce91ac7448892d7a2ad82f7b00f P eef3e5b55032492194cd3df63c04ab1a: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260808 04:40:07.988206 23129 heartbeater.cc:503] Master 127.20.240.254:43933 was elected leader, sending a full tablet report...
I20260808 04:40:07.989517 23154 ts_tablet_manager.cc:1428] T 73363ce91ac7448892d7a2ad82f7b00f P 02628df318bf414195901aba8b58e2d9: Time spent starting tablet: real 0.007s user 0.007s sys 0.000s
I20260808 04:40:07.991357 23155 raft_consensus.cc:348] T 73363ce91ac7448892d7a2ad82f7b00f P e3d1c1c2ef5b4ca1a6ed268c8a358c3a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eef3e5b55032492194cd3df63c04ab1a" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 39177 } } peers { permanent_uuid: "02628df318bf414195901aba8b58e2d9" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 45719 } } peers { permanent_uuid: "e3d1c1c2ef5b4ca1a6ed268c8a358c3a" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 35345 } }
I20260808 04:40:07.991644 23155 raft_consensus.cc:374] T 73363ce91ac7448892d7a2ad82f7b00f P e3d1c1c2ef5b4ca1a6ed268c8a358c3a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:40:07.991706 23155 raft_consensus.cc:729] T 73363ce91ac7448892d7a2ad82f7b00f P e3d1c1c2ef5b4ca1a6ed268c8a358c3a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3d1c1c2ef5b4ca1a6ed268c8a358c3a, State: Initialized, Role: FOLLOWER
I20260808 04:40:07.992123 23155 consensus_queue.cc:260] T 73363ce91ac7448892d7a2ad82f7b00f P e3d1c1c2ef5b4ca1a6ed268c8a358c3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eef3e5b55032492194cd3df63c04ab1a" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 39177 } } peers { permanent_uuid: "02628df318bf414195901aba8b58e2d9" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 45719 } } peers { permanent_uuid: "e3d1c1c2ef5b4ca1a6ed268c8a358c3a" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 35345 } }
I20260808 04:40:07.992812 22836 heartbeater.cc:503] Master 127.20.240.254:43933 was elected leader, sending a full tablet report...
I20260808 04:40:07.993037 23155 ts_tablet_manager.cc:1428] T 73363ce91ac7448892d7a2ad82f7b00f P e3d1c1c2ef5b4ca1a6ed268c8a358c3a: Time spent starting tablet: real 0.007s user 0.006s sys 0.000s
I20260808 04:40:08.119690 23162 raft_consensus.cc:482] T 73363ce91ac7448892d7a2ad82f7b00f P e3d1c1c2ef5b4ca1a6ed268c8a358c3a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 04:40:08.119942 23162 raft_consensus.cc:504] T 73363ce91ac7448892d7a2ad82f7b00f P e3d1c1c2ef5b4ca1a6ed268c8a358c3a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eef3e5b55032492194cd3df63c04ab1a" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 39177 } } peers { permanent_uuid: "02628df318bf414195901aba8b58e2d9" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 45719 } } peers { permanent_uuid: "e3d1c1c2ef5b4ca1a6ed268c8a358c3a" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 35345 } }
I20260808 04:40:08.121081 23162 leader_election.cc:288] T 73363ce91ac7448892d7a2ad82f7b00f P e3d1c1c2ef5b4ca1a6ed268c8a358c3a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eef3e5b55032492194cd3df63c04ab1a (127.20.240.194:39177), 02628df318bf414195901aba8b58e2d9 (127.20.240.195:45719)
I20260808 04:40:08.125387 23152 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:08.121566 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.240.193:52127 (local address 127.20.240.195:45719)
0808 04:40:08.121709 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:08.121714 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:08.121989 (+ 275us) server_negotiation.cc:407] Connection header received
0808 04:40:08.122139 (+ 150us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:08.122142 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:08.122222 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:08.122309 (+ 87us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 04:40:08.122581 (+ 272us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:08.123239 (+ 658us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:08.124395 (+ 1156us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:08.124814 (+ 419us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:08.124953 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:08.125005 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:08.125196 (+ 191us) server_negotiation.cc:299] Negotiation successful
0808 04:40:08.125266 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260808 04:40:08.125424 23163 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:08.121426 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.195:45719 (local address 127.20.240.193:52127)
0808 04:40:08.121886 (+ 460us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:08.121898 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:08.122041 (+ 143us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:08.122323 (+ 282us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:08.122326 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:08.122341 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 04:40:08.122474 (+ 133us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:08.122479 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:08.123348 (+ 869us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:08.123360 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:08.124269 (+ 909us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:08.124277 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:08.124948 (+ 671us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:08.124951 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:08.125045 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:08.125067 (+ 22us) client_negotiation.cc:769] Sending connection context
0808 04:40:08.125183 (+ 116us) client_negotiation.cc:240] Negotiation successful
0808 04:40:08.125259 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":389,"mutex_wait_us":30,"thread_start_us":134,"threads_started":1}
I20260808 04:40:08.125723 23150 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:08.121585 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.240.193:55493 (local address 127.20.240.194:39177)
0808 04:40:08.121734 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:08.121740 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:08.122042 (+ 302us) server_negotiation.cc:407] Connection header received
0808 04:40:08.122258 (+ 216us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:08.122261 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:08.122305 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:08.122397 (+ 92us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 04:40:08.122692 (+ 295us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:08.123319 (+ 627us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:08.124632 (+ 1313us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:08.125048 (+ 416us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:08.125223 (+ 175us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:08.125287 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:08.125494 (+ 207us) server_negotiation.cc:299] Negotiation successful
0808 04:40:08.125585 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260808 04:40:08.125892 23164 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:08.121426 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.194:39177 (local address 127.20.240.193:55493)
0808 04:40:08.121962 (+ 536us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:08.121976 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:08.122081 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:08.122422 (+ 341us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:08.122425 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:08.122442 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 04:40:08.122569 (+ 127us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:08.122575 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:08.123444 (+ 869us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:08.123449 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:08.124488 (+ 1039us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:08.124499 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:08.125206 (+ 707us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:08.125211 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:08.125348 (+ 137us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:08.125369 (+ 21us) client_negotiation.cc:769] Sending connection context
0808 04:40:08.125464 (+ 95us) client_negotiation.cc:240] Negotiation successful
0808 04:40:08.125697 (+ 233us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":455,"mutex_wait_us":261,"thread_start_us":106,"threads_started":1}
I20260808 04:40:08.126157 23081 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "73363ce91ac7448892d7a2ad82f7b00f" candidate_uuid: "e3d1c1c2ef5b4ca1a6ed268c8a358c3a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02628df318bf414195901aba8b58e2d9" is_pre_election: true
I20260808 04:40:08.126502 23081 raft_consensus.cc:2454] T 73363ce91ac7448892d7a2ad82f7b00f P 02628df318bf414195901aba8b58e2d9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3d1c1c2ef5b4ca1a6ed268c8a358c3a in term 0.
I20260808 04:40:08.126971 22721 leader_election.cc:302] T 73363ce91ac7448892d7a2ad82f7b00f P e3d1c1c2ef5b4ca1a6ed268c8a358c3a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02628df318bf414195901aba8b58e2d9, e3d1c1c2ef5b4ca1a6ed268c8a358c3a; no voters:
I20260808 04:40:08.126977 22935 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "73363ce91ac7448892d7a2ad82f7b00f" candidate_uuid: "e3d1c1c2ef5b4ca1a6ed268c8a358c3a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eef3e5b55032492194cd3df63c04ab1a" is_pre_election: true
I20260808 04:40:08.127233 22935 raft_consensus.cc:2454] T 73363ce91ac7448892d7a2ad82f7b00f P eef3e5b55032492194cd3df63c04ab1a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3d1c1c2ef5b4ca1a6ed268c8a358c3a in term 0.
I20260808 04:40:08.127271 23162 raft_consensus.cc:2781] T 73363ce91ac7448892d7a2ad82f7b00f P e3d1c1c2ef5b4ca1a6ed268c8a358c3a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 04:40:08.127396 23162 raft_consensus.cc:482] T 73363ce91ac7448892d7a2ad82f7b00f P e3d1c1c2ef5b4ca1a6ed268c8a358c3a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 04:40:08.127460 23162 raft_consensus.cc:3037] T 73363ce91ac7448892d7a2ad82f7b00f P e3d1c1c2ef5b4ca1a6ed268c8a358c3a [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:40:08.128633 23162 raft_consensus.cc:504] T 73363ce91ac7448892d7a2ad82f7b00f P e3d1c1c2ef5b4ca1a6ed268c8a358c3a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eef3e5b55032492194cd3df63c04ab1a" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 39177 } } peers { permanent_uuid: "02628df318bf414195901aba8b58e2d9" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 45719 } } peers { permanent_uuid: "e3d1c1c2ef5b4ca1a6ed268c8a358c3a" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 35345 } }
I20260808 04:40:08.129050 23162 leader_election.cc:288] T 73363ce91ac7448892d7a2ad82f7b00f P e3d1c1c2ef5b4ca1a6ed268c8a358c3a [CANDIDATE]: Term 1 election: Requested vote from peers eef3e5b55032492194cd3df63c04ab1a (127.20.240.194:39177), 02628df318bf414195901aba8b58e2d9 (127.20.240.195:45719)
I20260808 04:40:08.129359 22935 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "73363ce91ac7448892d7a2ad82f7b00f" candidate_uuid: "e3d1c1c2ef5b4ca1a6ed268c8a358c3a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eef3e5b55032492194cd3df63c04ab1a"
I20260808 04:40:08.129474 23081 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "73363ce91ac7448892d7a2ad82f7b00f" candidate_uuid: "e3d1c1c2ef5b4ca1a6ed268c8a358c3a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02628df318bf414195901aba8b58e2d9"
I20260808 04:40:08.129482 22935 raft_consensus.cc:3037] T 73363ce91ac7448892d7a2ad82f7b00f P eef3e5b55032492194cd3df63c04ab1a [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:40:08.129623 23081 raft_consensus.cc:3037] T 73363ce91ac7448892d7a2ad82f7b00f P 02628df318bf414195901aba8b58e2d9 [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:40:08.130582 22935 raft_consensus.cc:2454] T 73363ce91ac7448892d7a2ad82f7b00f P eef3e5b55032492194cd3df63c04ab1a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3d1c1c2ef5b4ca1a6ed268c8a358c3a in term 1.
I20260808 04:40:08.130897 22719 leader_election.cc:302] T 73363ce91ac7448892d7a2ad82f7b00f P e3d1c1c2ef5b4ca1a6ed268c8a358c3a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e3d1c1c2ef5b4ca1a6ed268c8a358c3a, eef3e5b55032492194cd3df63c04ab1a; no voters:
I20260808 04:40:08.131063 23162 raft_consensus.cc:2781] T 73363ce91ac7448892d7a2ad82f7b00f P e3d1c1c2ef5b4ca1a6ed268c8a358c3a [term 1 FOLLOWER]: Leader election won for term 1
I20260808 04:40:08.131331 23081 raft_consensus.cc:2454] T 73363ce91ac7448892d7a2ad82f7b00f P 02628df318bf414195901aba8b58e2d9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3d1c1c2ef5b4ca1a6ed268c8a358c3a in term 1.
I20260808 04:40:08.131333 23162 raft_consensus.cc:686] T 73363ce91ac7448892d7a2ad82f7b00f P e3d1c1c2ef5b4ca1a6ed268c8a358c3a [term 1 LEADER]: Becoming Leader. State: Replica: e3d1c1c2ef5b4ca1a6ed268c8a358c3a, State: Running, Role: LEADER
I20260808 04:40:08.131713 23162 consensus_queue.cc:237] T 73363ce91ac7448892d7a2ad82f7b00f P e3d1c1c2ef5b4ca1a6ed268c8a358c3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eef3e5b55032492194cd3df63c04ab1a" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 39177 } } peers { permanent_uuid: "02628df318bf414195901aba8b58e2d9" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 45719 } } peers { permanent_uuid: "e3d1c1c2ef5b4ca1a6ed268c8a358c3a" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 35345 } }
I20260808 04:40:08.135227 22623 catalog_manager.cc:5495] T 73363ce91ac7448892d7a2ad82f7b00f P e3d1c1c2ef5b4ca1a6ed268c8a358c3a reported cstate change: term changed from 0 to 1, leader changed from <none> to e3d1c1c2ef5b4ca1a6ed268c8a358c3a (127.20.240.193). New cstate: current_term: 1 leader_uuid: "e3d1c1c2ef5b4ca1a6ed268c8a358c3a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eef3e5b55032492194cd3df63c04ab1a" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 39177 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "02628df318bf414195901aba8b58e2d9" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 45719 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3d1c1c2ef5b4ca1a6ed268c8a358c3a" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 35345 } health_report { overall_health: HEALTHY } } }
W20260808 04:40:08.155639 23130 tablet.cc:2369] T 73363ce91ac7448892d7a2ad82f7b00f P 02628df318bf414195901aba8b58e2d9: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 04:40:08.161875 22837 tablet.cc:2369] T 73363ce91ac7448892d7a2ad82f7b00f P e3d1c1c2ef5b4ca1a6ed268c8a358c3a: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 04:40:08.167253 23153 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:08.163563 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46414 (local address 127.20.240.193:35345)
0808 04:40:08.163696 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:08.163699 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:08.163714 (+ 15us) server_negotiation.cc:407] Connection header received
0808 04:40:08.163944 (+ 230us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:08.163947 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:08.164001 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:08.164087 (+ 86us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 04:40:08.164339 (+ 252us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:08.164826 (+ 487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:08.165823 (+ 997us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:08.166058 (+ 235us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:08.166140 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:08.166440 (+ 300us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 04:40:08.166920 (+ 480us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 04:40:08.167012 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:08.167088 (+ 76us) server_negotiation.cc:299] Negotiation successful
0808 04:40:08.167141 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
W20260808 04:40:08.168287 22985 tablet.cc:2369] T 73363ce91ac7448892d7a2ad82f7b00f P eef3e5b55032492194cd3df63c04ab1a: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 04:40:08.174173 23081 raft_consensus.cc:1261] T 73363ce91ac7448892d7a2ad82f7b00f P 02628df318bf414195901aba8b58e2d9 [term 1 FOLLOWER]: Refusing update from remote peer e3d1c1c2ef5b4ca1a6ed268c8a358c3a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 04:40:08.175004 23162 consensus_queue.cc:1035] T 73363ce91ac7448892d7a2ad82f7b00f P e3d1c1c2ef5b4ca1a6ed268c8a358c3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "02628df318bf414195901aba8b58e2d9" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 45719 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 04:40:08.176578 22935 raft_consensus.cc:1261] T 73363ce91ac7448892d7a2ad82f7b00f P eef3e5b55032492194cd3df63c04ab1a [term 1 FOLLOWER]: Refusing update from remote peer e3d1c1c2ef5b4ca1a6ed268c8a358c3a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 04:40:08.177132 23162 consensus_queue.cc:1035] T 73363ce91ac7448892d7a2ad82f7b00f P e3d1c1c2ef5b4ca1a6ed268c8a358c3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "eef3e5b55032492194cd3df63c04ab1a" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 39177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 04:40:08.181735 23169 mvcc.cc:205] Tried to move back new op lower bound from 7316127777472614400 to 7316127777310646272. Current Snapshot: MvccSnapshot[applied={T|T < 7316127777472614400}]
I20260808 04:40:08.195930 22623 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:36364:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 04:40:08.196256 22623 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:36364:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 04:40:08.199046 22623 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 4ecb9ee877ff450fae91d30f2669eab4: Sending DeleteTablet for 3 replicas of tablet 73363ce91ac7448892d7a2ad82f7b00f
I20260808 04:40:08.200038 23060 tablet_service.cc:1514] Processing DeleteTablet for tablet 73363ce91ac7448892d7a2ad82f7b00f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 04:40:08 UTC) from {username='kudu', principal='kudu/127.20.240.254@KRBTEST.COM'} at 127.0.0.1:57148
I20260808 04:40:08.200021 22913 tablet_service.cc:1514] Processing DeleteTablet for tablet 73363ce91ac7448892d7a2ad82f7b00f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 04:40:08 UTC) from {username='kudu', principal='kudu/127.20.240.254@KRBTEST.COM'} at 127.0.0.1:60972
I20260808 04:40:08.200145 22767 tablet_service.cc:1514] Processing DeleteTablet for tablet 73363ce91ac7448892d7a2ad82f7b00f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 04:40:08 UTC) from {username='kudu', principal='kudu/127.20.240.254@KRBTEST.COM'} at 127.0.0.1:46402
I20260808 04:40:08.200660 23180 tablet_replica.cc:330] T 73363ce91ac7448892d7a2ad82f7b00f P e3d1c1c2ef5b4ca1a6ed268c8a358c3a: stopping tablet replica
I20260808 04:40:08.200786 23178 tablet_replica.cc:330] T 73363ce91ac7448892d7a2ad82f7b00f P eef3e5b55032492194cd3df63c04ab1a: stopping tablet replica
I20260808 04:40:08.201179 23180 raft_consensus.cc:2229] T 73363ce91ac7448892d7a2ad82f7b00f P e3d1c1c2ef5b4ca1a6ed268c8a358c3a [term 1 LEADER]: Raft consensus shutting down.
I20260808 04:40:08.201195 23178 raft_consensus.cc:2229] T 73363ce91ac7448892d7a2ad82f7b00f P eef3e5b55032492194cd3df63c04ab1a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 04:40:08.201540 23178 raft_consensus.cc:2258] T 73363ce91ac7448892d7a2ad82f7b00f P eef3e5b55032492194cd3df63c04ab1a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 04:40:08.201745 23179 tablet_replica.cc:330] T 73363ce91ac7448892d7a2ad82f7b00f P 02628df318bf414195901aba8b58e2d9: stopping tablet replica
I20260808 04:40:08.201691 22623 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:36364:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260808 04:40:08.202055 23179 raft_consensus.cc:2229] T 73363ce91ac7448892d7a2ad82f7b00f P 02628df318bf414195901aba8b58e2d9 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260808 04:40:08.202147 22623 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 04:40:08.202343 23179 raft_consensus.cc:2258] T 73363ce91ac7448892d7a2ad82f7b00f P 02628df318bf414195901aba8b58e2d9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 04:40:08.202839 23180 raft_consensus.cc:2258] T 73363ce91ac7448892d7a2ad82f7b00f P e3d1c1c2ef5b4ca1a6ed268c8a358c3a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 04:40:08.204362 23179 ts_tablet_manager.cc:1905] T 73363ce91ac7448892d7a2ad82f7b00f P 02628df318bf414195901aba8b58e2d9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 04:40:08.204376 23180 ts_tablet_manager.cc:1905] T 73363ce91ac7448892d7a2ad82f7b00f P e3d1c1c2ef5b4ca1a6ed268c8a358c3a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 04:40:08.205082 23178 ts_tablet_manager.cc:1905] T 73363ce91ac7448892d7a2ad82f7b00f P eef3e5b55032492194cd3df63c04ab1a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 04:40:08.207571 23180 ts_tablet_manager.cc:1918] T 73363ce91ac7448892d7a2ad82f7b00f P e3d1c1c2ef5b4ca1a6ed268c8a358c3a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 04:40:08.207772 23180 log.cc:1196] T 73363ce91ac7448892d7a2ad82f7b00f P e3d1c1c2ef5b4ca1a6ed268c8a358c3a: Deleting WAL directory at /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786164000593138-21443-0/minicluster-data/ts-0/wal/wals/73363ce91ac7448892d7a2ad82f7b00f
I20260808 04:40:08.208177 23180 ts_tablet_manager.cc:1939] T 73363ce91ac7448892d7a2ad82f7b00f P e3d1c1c2ef5b4ca1a6ed268c8a358c3a: Deleting consensus metadata
I20260808 04:40:08.209448 22767 tablet_service.cc:1467] Processing CreateTablet for tablet 4dd02c5c330244c8954798b8cdcbc84b (DEFAULT_TABLE table=test-table [id=ee05a5a74e5c4d008fb5ad53d3f2dfb3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 04:40:08.209748 22767 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4dd02c5c330244c8954798b8cdcbc84b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:40:08.209865 23060 tablet_service.cc:1467] Processing CreateTablet for tablet 4dd02c5c330244c8954798b8cdcbc84b (DEFAULT_TABLE table=test-table [id=ee05a5a74e5c4d008fb5ad53d3f2dfb3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 04:40:08.210101 23060 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4dd02c5c330244c8954798b8cdcbc84b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:40:08.210742 23178 ts_tablet_manager.cc:1918] T 73363ce91ac7448892d7a2ad82f7b00f P eef3e5b55032492194cd3df63c04ab1a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 04:40:08.210855 23178 log.cc:1196] T 73363ce91ac7448892d7a2ad82f7b00f P eef3e5b55032492194cd3df63c04ab1a: Deleting WAL directory at /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786164000593138-21443-0/minicluster-data/ts-1/wal/wals/73363ce91ac7448892d7a2ad82f7b00f
I20260808 04:40:08.211159 23178 ts_tablet_manager.cc:1939] T 73363ce91ac7448892d7a2ad82f7b00f P eef3e5b55032492194cd3df63c04ab1a: Deleting consensus metadata
I20260808 04:40:08.212260 23155 tablet_bootstrap.cc:492] T 4dd02c5c330244c8954798b8cdcbc84b P e3d1c1c2ef5b4ca1a6ed268c8a358c3a: Bootstrap starting.
I20260808 04:40:08.212568 22913 tablet_service.cc:1467] Processing CreateTablet for tablet 4dd02c5c330244c8954798b8cdcbc84b (DEFAULT_TABLE table=test-table [id=ee05a5a74e5c4d008fb5ad53d3f2dfb3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 04:40:08.212845 22913 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4dd02c5c330244c8954798b8cdcbc84b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:40:08.213233 23179 ts_tablet_manager.cc:1918] T 73363ce91ac7448892d7a2ad82f7b00f P 02628df318bf414195901aba8b58e2d9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 04:40:08.213331 23179 log.cc:1196] T 73363ce91ac7448892d7a2ad82f7b00f P 02628df318bf414195901aba8b58e2d9: Deleting WAL directory at /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786164000593138-21443-0/minicluster-data/ts-2/wal/wals/73363ce91ac7448892d7a2ad82f7b00f
I20260808 04:40:08.213382 23155 tablet_bootstrap.cc:654] T 4dd02c5c330244c8954798b8cdcbc84b P e3d1c1c2ef5b4ca1a6ed268c8a358c3a: Neither blocks nor log segments found. Creating new log.
I20260808 04:40:08.213646 23179 ts_tablet_manager.cc:1939] T 73363ce91ac7448892d7a2ad82f7b00f P 02628df318bf414195901aba8b58e2d9: Deleting consensus metadata
I20260808 04:40:08.214648 22609 catalog_manager.cc:4841] TS eef3e5b55032492194cd3df63c04ab1a (127.20.240.194:39177): tablet 73363ce91ac7448892d7a2ad82f7b00f (table test-table [id=3b31779783164dbb8a5a81b10fbeaf1e]) successfully deleted
I20260808 04:40:08.214819 23154 tablet_bootstrap.cc:492] T 4dd02c5c330244c8954798b8cdcbc84b P 02628df318bf414195901aba8b58e2d9: Bootstrap starting.
I20260808 04:40:08.215058 22611 catalog_manager.cc:4841] TS 02628df318bf414195901aba8b58e2d9 (127.20.240.195:45719): tablet 73363ce91ac7448892d7a2ad82f7b00f (table test-table [id=3b31779783164dbb8a5a81b10fbeaf1e]) successfully deleted
I20260808 04:40:08.215384 23156 tablet_bootstrap.cc:492] T 4dd02c5c330244c8954798b8cdcbc84b P eef3e5b55032492194cd3df63c04ab1a: Bootstrap starting.
I20260808 04:40:08.215773 23154 tablet_bootstrap.cc:654] T 4dd02c5c330244c8954798b8cdcbc84b P 02628df318bf414195901aba8b58e2d9: Neither blocks nor log segments found. Creating new log.
I20260808 04:40:08.215976 23155 tablet_bootstrap.cc:492] T 4dd02c5c330244c8954798b8cdcbc84b P e3d1c1c2ef5b4ca1a6ed268c8a358c3a: No bootstrap required, opened a new log
I20260808 04:40:08.216037 23155 ts_tablet_manager.cc:1397] T 4dd02c5c330244c8954798b8cdcbc84b P e3d1c1c2ef5b4ca1a6ed268c8a358c3a: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.002s
I20260808 04:40:08.216439 23156 tablet_bootstrap.cc:654] T 4dd02c5c330244c8954798b8cdcbc84b P eef3e5b55032492194cd3df63c04ab1a: Neither blocks nor log segments found. Creating new log.
I20260808 04:40:08.216507 23155 raft_consensus.cc:348] T 4dd02c5c330244c8954798b8cdcbc84b P e3d1c1c2ef5b4ca1a6ed268c8a358c3a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3d1c1c2ef5b4ca1a6ed268c8a358c3a" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 35345 } } peers { permanent_uuid: "eef3e5b55032492194cd3df63c04ab1a" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 39177 } } peers { permanent_uuid: "02628df318bf414195901aba8b58e2d9" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 45719 } }
I20260808 04:40:08.216660 23155 raft_consensus.cc:374] T 4dd02c5c330244c8954798b8cdcbc84b P e3d1c1c2ef5b4ca1a6ed268c8a358c3a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:40:08.216671 22609 catalog_manager.cc:4841] TS e3d1c1c2ef5b4ca1a6ed268c8a358c3a (127.20.240.193:35345): tablet 73363ce91ac7448892d7a2ad82f7b00f (table test-table [id=3b31779783164dbb8a5a81b10fbeaf1e]) successfully deleted
I20260808 04:40:08.216698 23155 raft_consensus.cc:729] T 4dd02c5c330244c8954798b8cdcbc84b P e3d1c1c2ef5b4ca1a6ed268c8a358c3a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3d1c1c2ef5b4ca1a6ed268c8a358c3a, State: Initialized, Role: FOLLOWER
I20260808 04:40:08.216830 23155 consensus_queue.cc:260] T 4dd02c5c330244c8954798b8cdcbc84b P e3d1c1c2ef5b4ca1a6ed268c8a358c3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3d1c1c2ef5b4ca1a6ed268c8a358c3a" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 35345 } } peers { permanent_uuid: "eef3e5b55032492194cd3df63c04ab1a" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 39177 } } peers { permanent_uuid: "02628df318bf414195901aba8b58e2d9" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 45719 } }
I20260808 04:40:08.216981 23154 tablet_bootstrap.cc:492] T 4dd02c5c330244c8954798b8cdcbc84b P 02628df318bf414195901aba8b58e2d9: No bootstrap required, opened a new log
I20260808 04:40:08.217051 23154 ts_tablet_manager.cc:1397] T 4dd02c5c330244c8954798b8cdcbc84b P 02628df318bf414195901aba8b58e2d9: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260808 04:40:08.217108 23155 ts_tablet_manager.cc:1428] T 4dd02c5c330244c8954798b8cdcbc84b P e3d1c1c2ef5b4ca1a6ed268c8a358c3a: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260808 04:40:08.217530 23154 raft_consensus.cc:348] T 4dd02c5c330244c8954798b8cdcbc84b P 02628df318bf414195901aba8b58e2d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3d1c1c2ef5b4ca1a6ed268c8a358c3a" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 35345 } } peers { permanent_uuid: "eef3e5b55032492194cd3df63c04ab1a" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 39177 } } peers { permanent_uuid: "02628df318bf414195901aba8b58e2d9" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 45719 } }
I20260808 04:40:08.217628 23154 raft_consensus.cc:374] T 4dd02c5c330244c8954798b8cdcbc84b P 02628df318bf414195901aba8b58e2d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:40:08.217658 23154 raft_consensus.cc:729] T 4dd02c5c330244c8954798b8cdcbc84b P 02628df318bf414195901aba8b58e2d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 02628df318bf414195901aba8b58e2d9, State: Initialized, Role: FOLLOWER
I20260808 04:40:08.217779 23154 consensus_queue.cc:260] T 4dd02c5c330244c8954798b8cdcbc84b P 02628df318bf414195901aba8b58e2d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3d1c1c2ef5b4ca1a6ed268c8a358c3a" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 35345 } } peers { permanent_uuid: "eef3e5b55032492194cd3df63c04ab1a" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 39177 } } peers { permanent_uuid: "02628df318bf414195901aba8b58e2d9" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 45719 } }
I20260808 04:40:08.218041 23154 ts_tablet_manager.cc:1428] T 4dd02c5c330244c8954798b8cdcbc84b P 02628df318bf414195901aba8b58e2d9: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260808 04:40:08.218150 23156 tablet_bootstrap.cc:492] T 4dd02c5c330244c8954798b8cdcbc84b P eef3e5b55032492194cd3df63c04ab1a: No bootstrap required, opened a new log
I20260808 04:40:08.218259 23156 ts_tablet_manager.cc:1397] T 4dd02c5c330244c8954798b8cdcbc84b P eef3e5b55032492194cd3df63c04ab1a: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260808 04:40:08.218679 23156 raft_consensus.cc:348] T 4dd02c5c330244c8954798b8cdcbc84b P eef3e5b55032492194cd3df63c04ab1a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3d1c1c2ef5b4ca1a6ed268c8a358c3a" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 35345 } } peers { permanent_uuid: "eef3e5b55032492194cd3df63c04ab1a" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 39177 } } peers { permanent_uuid: "02628df318bf414195901aba8b58e2d9" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 45719 } }
I20260808 04:40:08.218780 23156 raft_consensus.cc:374] T 4dd02c5c330244c8954798b8cdcbc84b P eef3e5b55032492194cd3df63c04ab1a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:40:08.218811 23156 raft_consensus.cc:729] T 4dd02c5c330244c8954798b8cdcbc84b P eef3e5b55032492194cd3df63c04ab1a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eef3e5b55032492194cd3df63c04ab1a, State: Initialized, Role: FOLLOWER
I20260808 04:40:08.218927 23156 consensus_queue.cc:260] T 4dd02c5c330244c8954798b8cdcbc84b P eef3e5b55032492194cd3df63c04ab1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3d1c1c2ef5b4ca1a6ed268c8a358c3a" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 35345 } } peers { permanent_uuid: "eef3e5b55032492194cd3df63c04ab1a" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 39177 } } peers { permanent_uuid: "02628df318bf414195901aba8b58e2d9" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 45719 } }
I20260808 04:40:08.219173 23156 ts_tablet_manager.cc:1428] T 4dd02c5c330244c8954798b8cdcbc84b P eef3e5b55032492194cd3df63c04ab1a: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260808 04:40:08.293877 23173 raft_consensus.cc:482] T 4dd02c5c330244c8954798b8cdcbc84b P e3d1c1c2ef5b4ca1a6ed268c8a358c3a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 04:40:08.294028 23173 raft_consensus.cc:504] T 4dd02c5c330244c8954798b8cdcbc84b P e3d1c1c2ef5b4ca1a6ed268c8a358c3a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3d1c1c2ef5b4ca1a6ed268c8a358c3a" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 35345 } } peers { permanent_uuid: "eef3e5b55032492194cd3df63c04ab1a" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 39177 } } peers { permanent_uuid: "02628df318bf414195901aba8b58e2d9" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 45719 } }
I20260808 04:40:08.294556 23173 leader_election.cc:288] T 4dd02c5c330244c8954798b8cdcbc84b P e3d1c1c2ef5b4ca1a6ed268c8a358c3a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eef3e5b55032492194cd3df63c04ab1a (127.20.240.194:39177), 02628df318bf414195901aba8b58e2d9 (127.20.240.195:45719)
I20260808 04:40:08.295038 22935 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4dd02c5c330244c8954798b8cdcbc84b" candidate_uuid: "e3d1c1c2ef5b4ca1a6ed268c8a358c3a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eef3e5b55032492194cd3df63c04ab1a" is_pre_election: true
I20260808 04:40:08.295064 23081 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4dd02c5c330244c8954798b8cdcbc84b" candidate_uuid: "e3d1c1c2ef5b4ca1a6ed268c8a358c3a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02628df318bf414195901aba8b58e2d9" is_pre_election: true
I20260808 04:40:08.295212 22935 raft_consensus.cc:2454] T 4dd02c5c330244c8954798b8cdcbc84b P eef3e5b55032492194cd3df63c04ab1a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3d1c1c2ef5b4ca1a6ed268c8a358c3a in term 0.
I20260808 04:40:08.295235 23081 raft_consensus.cc:2454] T 4dd02c5c330244c8954798b8cdcbc84b P 02628df318bf414195901aba8b58e2d9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3d1c1c2ef5b4ca1a6ed268c8a358c3a in term 0.
I20260808 04:40:08.295589 22721 leader_election.cc:302] T 4dd02c5c330244c8954798b8cdcbc84b P e3d1c1c2ef5b4ca1a6ed268c8a358c3a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02628df318bf414195901aba8b58e2d9, e3d1c1c2ef5b4ca1a6ed268c8a358c3a; no voters:
I20260808 04:40:08.295786 23173 raft_consensus.cc:2781] T 4dd02c5c330244c8954798b8cdcbc84b P e3d1c1c2ef5b4ca1a6ed268c8a358c3a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 04:40:08.295873 23173 raft_consensus.cc:482] T 4dd02c5c330244c8954798b8cdcbc84b P e3d1c1c2ef5b4ca1a6ed268c8a358c3a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 04:40:08.295928 23173 raft_consensus.cc:3037] T 4dd02c5c330244c8954798b8cdcbc84b P e3d1c1c2ef5b4ca1a6ed268c8a358c3a [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:40:08.297008 23173 raft_consensus.cc:504] T 4dd02c5c330244c8954798b8cdcbc84b P e3d1c1c2ef5b4ca1a6ed268c8a358c3a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3d1c1c2ef5b4ca1a6ed268c8a358c3a" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 35345 } } peers { permanent_uuid: "eef3e5b55032492194cd3df63c04ab1a" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 39177 } } peers { permanent_uuid: "02628df318bf414195901aba8b58e2d9" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 45719 } }
I20260808 04:40:08.297459 23173 leader_election.cc:288] T 4dd02c5c330244c8954798b8cdcbc84b P e3d1c1c2ef5b4ca1a6ed268c8a358c3a [CANDIDATE]: Term 1 election: Requested vote from peers eef3e5b55032492194cd3df63c04ab1a (127.20.240.194:39177), 02628df318bf414195901aba8b58e2d9 (127.20.240.195:45719)
I20260808 04:40:08.297832 22935 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4dd02c5c330244c8954798b8cdcbc84b" candidate_uuid: "e3d1c1c2ef5b4ca1a6ed268c8a358c3a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eef3e5b55032492194cd3df63c04ab1a"
I20260808 04:40:08.297845 23081 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4dd02c5c330244c8954798b8cdcbc84b" candidate_uuid: "e3d1c1c2ef5b4ca1a6ed268c8a358c3a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02628df318bf414195901aba8b58e2d9"
I20260808 04:40:08.297992 22935 raft_consensus.cc:3037] T 4dd02c5c330244c8954798b8cdcbc84b P eef3e5b55032492194cd3df63c04ab1a [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:40:08.297992 23081 raft_consensus.cc:3037] T 4dd02c5c330244c8954798b8cdcbc84b P 02628df318bf414195901aba8b58e2d9 [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:40:08.299188 22935 raft_consensus.cc:2454] T 4dd02c5c330244c8954798b8cdcbc84b P eef3e5b55032492194cd3df63c04ab1a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3d1c1c2ef5b4ca1a6ed268c8a358c3a in term 1.
I20260808 04:40:08.299188 23081 raft_consensus.cc:2454] T 4dd02c5c330244c8954798b8cdcbc84b P 02628df318bf414195901aba8b58e2d9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3d1c1c2ef5b4ca1a6ed268c8a358c3a in term 1.
I20260808 04:40:08.299563 22721 leader_election.cc:302] T 4dd02c5c330244c8954798b8cdcbc84b P e3d1c1c2ef5b4ca1a6ed268c8a358c3a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02628df318bf414195901aba8b58e2d9, e3d1c1c2ef5b4ca1a6ed268c8a358c3a; no voters:
I20260808 04:40:08.299903 23173 raft_consensus.cc:2781] T 4dd02c5c330244c8954798b8cdcbc84b P e3d1c1c2ef5b4ca1a6ed268c8a358c3a [term 1 FOLLOWER]: Leader election won for term 1
I20260808 04:40:08.300029 23173 raft_consensus.cc:686] T 4dd02c5c330244c8954798b8cdcbc84b P e3d1c1c2ef5b4ca1a6ed268c8a358c3a [term 1 LEADER]: Becoming Leader. State: Replica: e3d1c1c2ef5b4ca1a6ed268c8a358c3a, State: Running, Role: LEADER
I20260808 04:40:08.300180 23173 consensus_queue.cc:237] T 4dd02c5c330244c8954798b8cdcbc84b P e3d1c1c2ef5b4ca1a6ed268c8a358c3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3d1c1c2ef5b4ca1a6ed268c8a358c3a" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 35345 } } peers { permanent_uuid: "eef3e5b55032492194cd3df63c04ab1a" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 39177 } } peers { permanent_uuid: "02628df318bf414195901aba8b58e2d9" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 45719 } }
I20260808 04:40:08.301972 22624 catalog_manager.cc:5495] T 4dd02c5c330244c8954798b8cdcbc84b P e3d1c1c2ef5b4ca1a6ed268c8a358c3a reported cstate change: term changed from 0 to 1, leader changed from <none> to e3d1c1c2ef5b4ca1a6ed268c8a358c3a (127.20.240.193). New cstate: current_term: 1 leader_uuid: "e3d1c1c2ef5b4ca1a6ed268c8a358c3a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3d1c1c2ef5b4ca1a6ed268c8a358c3a" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 35345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eef3e5b55032492194cd3df63c04ab1a" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 39177 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "02628df318bf414195901aba8b58e2d9" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 45719 } health_report { overall_health: UNKNOWN } } }
Aug 08 04:40:08 dist-test-slave-vxj2 krb5kdc[22577](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164007, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.240.254@KRBTEST.COM for kudu/127.20.240.254@KRBTEST.COM
I20260808 04:40:08.356400 23190 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:08.347013 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:43933 (local address 127.0.0.1:36366)
0808 04:40:08.347359 (+ 346us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:08.347375 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:08.347481 (+ 106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:08.347794 (+ 313us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:08.347796 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:08.348165 (+ 369us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:40:08.348262 (+ 97us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:08.348268 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:08.349347 (+ 1079us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:08.349350 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:08.350227 (+ 877us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:08.350235 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:08.350684 (+ 449us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:08.350688 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:08.350779 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:08.351341 (+ 562us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:40:08.351355 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:40:08.352941 (+ 1586us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:40:08.354794 (+ 1853us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:08.354804 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:08.354811 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:08.355047 (+ 236us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:08.355328 (+ 281us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:08.355331 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:08.355333 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:08.355422 (+ 89us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:08.355800 (+ 378us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:40:08.355808 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:40:08.355921 (+ 113us) client_negotiation.cc:769] Sending connection context
0808 04:40:08.356032 (+ 111us) client_negotiation.cc:240] Negotiation successful
0808 04:40:08.356193 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":249,"thread_start_us":116,"threads_started":1}
I20260808 04:40:08.356400 22676 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:08.347126 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36366 (local address 127.20.240.254:43933)
0808 04:40:08.347288 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:08.347294 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:08.347451 (+ 157us) server_negotiation.cc:407] Connection header received
0808 04:40:08.347575 (+ 124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:08.347580 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:08.347643 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:08.347767 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:08.348384 (+ 617us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:08.349221 (+ 837us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:08.350350 (+ 1129us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:08.350564 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:08.350650 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:08.353078 (+ 2428us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:40:08.353081 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:40:08.353084 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:40:08.353114 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:40:08.354664 (+ 1550us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:08.355149 (+ 485us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:08.355154 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:08.355155 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:08.355232 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:08.355507 (+ 275us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:08.355513 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:08.355515 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:08.355693 (+ 178us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:40:08.355800 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:08.356089 (+ 289us) server_negotiation.cc:299] Negotiation successful
0808 04:40:08.356252 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":62,"server-negotiator.queue_time_us":54}
I20260808 04:40:08.360903 22624 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.20.240.254@KRBTEST.COM'} at 127.0.0.1:36366:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260808 04:40:08.361850 22624 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 04:40:08.367069 22767 tablet_service.cc:1467] Processing CreateTablet for tablet 92da9368ec9946459ebcb60a4589338b (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=32504efb25504c7881d9766ebfe9198a]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260808 04:40:08.367189 22913 tablet_service.cc:1467] Processing CreateTablet for tablet 92da9368ec9946459ebcb60a4589338b (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=32504efb25504c7881d9766ebfe9198a]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260808 04:40:08.367190 23060 tablet_service.cc:1467] Processing CreateTablet for tablet 92da9368ec9946459ebcb60a4589338b (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=32504efb25504c7881d9766ebfe9198a]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260808 04:40:08.367578 22913 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 92da9368ec9946459ebcb60a4589338b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:40:08.367587 22767 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 92da9368ec9946459ebcb60a4589338b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:40:08.367594 23060 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 92da9368ec9946459ebcb60a4589338b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:40:08.370313 23155 tablet_bootstrap.cc:492] T 92da9368ec9946459ebcb60a4589338b P e3d1c1c2ef5b4ca1a6ed268c8a358c3a: Bootstrap starting.
I20260808 04:40:08.370610 23156 tablet_bootstrap.cc:492] T 92da9368ec9946459ebcb60a4589338b P eef3e5b55032492194cd3df63c04ab1a: Bootstrap starting.
I20260808 04:40:08.371212 23155 tablet_bootstrap.cc:654] T 92da9368ec9946459ebcb60a4589338b P e3d1c1c2ef5b4ca1a6ed268c8a358c3a: Neither blocks nor log segments found. Creating new log.
I20260808 04:40:08.371639 23156 tablet_bootstrap.cc:654] T 92da9368ec9946459ebcb60a4589338b P eef3e5b55032492194cd3df63c04ab1a: Neither blocks nor log segments found. Creating new log.
I20260808 04:40:08.372272 23154 tablet_bootstrap.cc:492] T 92da9368ec9946459ebcb60a4589338b P 02628df318bf414195901aba8b58e2d9: Bootstrap starting.
I20260808 04:40:08.372488 23155 tablet_bootstrap.cc:492] T 92da9368ec9946459ebcb60a4589338b P e3d1c1c2ef5b4ca1a6ed268c8a358c3a: No bootstrap required, opened a new log
I20260808 04:40:08.372576 23155 ts_tablet_manager.cc:1397] T 92da9368ec9946459ebcb60a4589338b P e3d1c1c2ef5b4ca1a6ed268c8a358c3a: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260808 04:40:08.372848 23156 tablet_bootstrap.cc:492] T 92da9368ec9946459ebcb60a4589338b P eef3e5b55032492194cd3df63c04ab1a: No bootstrap required, opened a new log
I20260808 04:40:08.372951 23156 ts_tablet_manager.cc:1397] T 92da9368ec9946459ebcb60a4589338b P eef3e5b55032492194cd3df63c04ab1a: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260808 04:40:08.373029 23155 raft_consensus.cc:348] T 92da9368ec9946459ebcb60a4589338b P e3d1c1c2ef5b4ca1a6ed268c8a358c3a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3d1c1c2ef5b4ca1a6ed268c8a358c3a" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 35345 } } peers { permanent_uuid: "eef3e5b55032492194cd3df63c04ab1a" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 39177 } } peers { permanent_uuid: "02628df318bf414195901aba8b58e2d9" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 45719 } }
I20260808 04:40:08.373180 23155 raft_consensus.cc:374] T 92da9368ec9946459ebcb60a4589338b P e3d1c1c2ef5b4ca1a6ed268c8a358c3a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:40:08.373226 23155 raft_consensus.cc:729] T 92da9368ec9946459ebcb60a4589338b P e3d1c1c2ef5b4ca1a6ed268c8a358c3a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3d1c1c2ef5b4ca1a6ed268c8a358c3a, State: Initialized, Role: FOLLOWER
I20260808 04:40:08.373333 23154 tablet_bootstrap.cc:654] T 92da9368ec9946459ebcb60a4589338b P 02628df318bf414195901aba8b58e2d9: Neither blocks nor log segments found. Creating new log.
I20260808 04:40:08.373392 23155 consensus_queue.cc:260] T 92da9368ec9946459ebcb60a4589338b P e3d1c1c2ef5b4ca1a6ed268c8a358c3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3d1c1c2ef5b4ca1a6ed268c8a358c3a" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 35345 } } peers { permanent_uuid: "eef3e5b55032492194cd3df63c04ab1a" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 39177 } } peers { permanent_uuid: "02628df318bf414195901aba8b58e2d9" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 45719 } }
I20260808 04:40:08.373440 23156 raft_consensus.cc:348] T 92da9368ec9946459ebcb60a4589338b P eef3e5b55032492194cd3df63c04ab1a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3d1c1c2ef5b4ca1a6ed268c8a358c3a" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 35345 } } peers { permanent_uuid: "eef3e5b55032492194cd3df63c04ab1a" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 39177 } } peers { permanent_uuid: "02628df318bf414195901aba8b58e2d9" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 45719 } }
I20260808 04:40:08.373553 23156 raft_consensus.cc:374] T 92da9368ec9946459ebcb60a4589338b P eef3e5b55032492194cd3df63c04ab1a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:40:08.373594 23156 raft_consensus.cc:729] T 92da9368ec9946459ebcb60a4589338b P eef3e5b55032492194cd3df63c04ab1a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eef3e5b55032492194cd3df63c04ab1a, State: Initialized, Role: FOLLOWER
I20260808 04:40:08.373721 23156 consensus_queue.cc:260] T 92da9368ec9946459ebcb60a4589338b P eef3e5b55032492194cd3df63c04ab1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3d1c1c2ef5b4ca1a6ed268c8a358c3a" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 35345 } } peers { permanent_uuid: "eef3e5b55032492194cd3df63c04ab1a" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 39177 } } peers { permanent_uuid: "02628df318bf414195901aba8b58e2d9" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 45719 } }
I20260808 04:40:08.373768 23173 tablet_replica.cc:439] T 92da9368ec9946459ebcb60a4589338b P e3d1c1c2ef5b4ca1a6ed268c8a358c3a: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3d1c1c2ef5b4ca1a6ed268c8a358c3a" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 35345 } } peers { permanent_uuid: "eef3e5b55032492194cd3df63c04ab1a" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 39177 } } peers { permanent_uuid: "02628df318bf414195901aba8b58e2d9" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 45719 } } }
I20260808 04:40:08.373903 23173 tablet_replica.cc:442] T 92da9368ec9946459ebcb60a4589338b P e3d1c1c2ef5b4ca1a6ed268c8a358c3a: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 04:40:08.374028 23156 ts_tablet_manager.cc:1428] T 92da9368ec9946459ebcb60a4589338b P eef3e5b55032492194cd3df63c04ab1a: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260808 04:40:08.374554 23160 tablet_replica.cc:439] T 92da9368ec9946459ebcb60a4589338b P eef3e5b55032492194cd3df63c04ab1a: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3d1c1c2ef5b4ca1a6ed268c8a358c3a" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 35345 } } peers { permanent_uuid: "eef3e5b55032492194cd3df63c04ab1a" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 39177 } } peers { permanent_uuid: "02628df318bf414195901aba8b58e2d9" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 45719 } } }
I20260808 04:40:08.374722 23160 tablet_replica.cc:442] T 92da9368ec9946459ebcb60a4589338b P eef3e5b55032492194cd3df63c04ab1a: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 04:40:08.374720 23154 tablet_bootstrap.cc:492] T 92da9368ec9946459ebcb60a4589338b P 02628df318bf414195901aba8b58e2d9: No bootstrap required, opened a new log
I20260808 04:40:08.374809 23154 ts_tablet_manager.cc:1397] T 92da9368ec9946459ebcb60a4589338b P 02628df318bf414195901aba8b58e2d9: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.002s
I20260808 04:40:08.375250 23154 raft_consensus.cc:348] T 92da9368ec9946459ebcb60a4589338b P 02628df318bf414195901aba8b58e2d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3d1c1c2ef5b4ca1a6ed268c8a358c3a" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 35345 } } peers { permanent_uuid: "eef3e5b55032492194cd3df63c04ab1a" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 39177 } } peers { permanent_uuid: "02628df318bf414195901aba8b58e2d9" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 45719 } }
I20260808 04:40:08.375368 23154 raft_consensus.cc:374] T 92da9368ec9946459ebcb60a4589338b P 02628df318bf414195901aba8b58e2d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:40:08.375414 23154 raft_consensus.cc:729] T 92da9368ec9946459ebcb60a4589338b P 02628df318bf414195901aba8b58e2d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 02628df318bf414195901aba8b58e2d9, State: Initialized, Role: FOLLOWER
I20260808 04:40:08.375542 23154 consensus_queue.cc:260] T 92da9368ec9946459ebcb60a4589338b P 02628df318bf414195901aba8b58e2d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3d1c1c2ef5b4ca1a6ed268c8a358c3a" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 35345 } } peers { permanent_uuid: "eef3e5b55032492194cd3df63c04ab1a" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 39177 } } peers { permanent_uuid: "02628df318bf414195901aba8b58e2d9" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 45719 } }
I20260808 04:40:08.375633 23155 ts_tablet_manager.cc:1428] T 92da9368ec9946459ebcb60a4589338b P e3d1c1c2ef5b4ca1a6ed268c8a358c3a: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260808 04:40:08.375845 23154 ts_tablet_manager.cc:1428] T 92da9368ec9946459ebcb60a4589338b P 02628df318bf414195901aba8b58e2d9: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260808 04:40:08.375783 23161 tablet_replica.cc:439] T 92da9368ec9946459ebcb60a4589338b P 02628df318bf414195901aba8b58e2d9: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3d1c1c2ef5b4ca1a6ed268c8a358c3a" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 35345 } } peers { permanent_uuid: "eef3e5b55032492194cd3df63c04ab1a" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 39177 } } peers { permanent_uuid: "02628df318bf414195901aba8b58e2d9" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 45719 } } }
I20260808 04:40:08.375938 23161 tablet_replica.cc:442] T 92da9368ec9946459ebcb60a4589338b P 02628df318bf414195901aba8b58e2d9: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 04:40:08.397755 23161 raft_consensus.cc:482] T 92da9368ec9946459ebcb60a4589338b P 02628df318bf414195901aba8b58e2d9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 04:40:08.397897 23161 raft_consensus.cc:504] T 92da9368ec9946459ebcb60a4589338b P 02628df318bf414195901aba8b58e2d9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3d1c1c2ef5b4ca1a6ed268c8a358c3a" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 35345 } } peers { permanent_uuid: "eef3e5b55032492194cd3df63c04ab1a" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 39177 } } peers { permanent_uuid: "02628df318bf414195901aba8b58e2d9" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 45719 } }
I20260808 04:40:08.399073 23161 leader_election.cc:288] T 92da9368ec9946459ebcb60a4589338b P 02628df318bf414195901aba8b58e2d9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3d1c1c2ef5b4ca1a6ed268c8a358c3a (127.20.240.193:35345), eef3e5b55032492194cd3df63c04ab1a (127.20.240.194:39177)
I20260808 04:40:08.403492 23018 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:08.399261 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.193:35345 (local address 127.20.240.195:54999)
0808 04:40:08.399414 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:08.399430 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:08.399528 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:08.399839 (+ 311us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:08.399843 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:08.399869 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 04:40:08.400011 (+ 142us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:08.400018 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:08.401079 (+ 1061us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:08.401083 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:08.402355 (+ 1272us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:08.402364 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:08.403011 (+ 647us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:08.403014 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:08.403122 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:08.403144 (+ 22us) client_negotiation.cc:769] Sending connection context
0808 04:40:08.403276 (+ 132us) client_negotiation.cc:240] Negotiation successful
0808 04:40:08.403354 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":54,"mutex_wait_us":1}
I20260808 04:40:08.403492 23153 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:08.399433 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.240.195:54999 (local address 127.20.240.193:35345)
0808 04:40:08.399559 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:08.399566 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:08.399582 (+ 16us) server_negotiation.cc:407] Connection header received
0808 04:40:08.399645 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:08.399648 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:08.399718 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:08.399799 (+ 81us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 04:40:08.400133 (+ 334us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:08.400975 (+ 842us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:08.402478 (+ 1503us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:08.402886 (+ 408us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:08.403024 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:08.403082 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:08.403298 (+ 216us) server_negotiation.cc:299] Negotiation successful
0808 04:40:08.403388 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260808 04:40:08.403836 23194 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:08.399552 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.194:39177 (local address 127.20.240.195:41665)
0808 04:40:08.399841 (+ 289us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:08.399864 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:08.399967 (+ 103us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:08.400207 (+ 240us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:08.400210 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:08.400227 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 04:40:08.400758 (+ 531us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:08.400768 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:08.401735 (+ 967us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:08.401739 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:08.402723 (+ 984us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:08.402733 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:08.403383 (+ 650us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:08.403387 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:08.403490 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:08.403507 (+ 17us) client_negotiation.cc:769] Sending connection context
0808 04:40:08.403592 (+ 85us) client_negotiation.cc:240] Negotiation successful
0808 04:40:08.403681 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":231,"mutex_wait_us":21,"thread_start_us":83,"threads_started":1}
I20260808 04:40:08.403940 23150 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:08.399666 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.240.195:41665 (local address 127.20.240.194:39177)
0808 04:40:08.399793 (+ 127us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:08.399798 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:08.399959 (+ 161us) server_negotiation.cc:407] Connection header received
0808 04:40:08.400037 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:08.400043 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:08.400101 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:08.400175 (+ 74us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 04:40:08.400875 (+ 700us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:08.401601 (+ 726us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:08.402848 (+ 1247us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:08.403252 (+ 404us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:08.403384 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:08.403430 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:08.403738 (+ 308us) server_negotiation.cc:299] Negotiation successful
0808 04:40:08.403808 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260808 04:40:08.404095 22787 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92da9368ec9946459ebcb60a4589338b" candidate_uuid: "02628df318bf414195901aba8b58e2d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3d1c1c2ef5b4ca1a6ed268c8a358c3a" is_pre_election: true
I20260808 04:40:08.404333 22935 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92da9368ec9946459ebcb60a4589338b" candidate_uuid: "02628df318bf414195901aba8b58e2d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eef3e5b55032492194cd3df63c04ab1a" is_pre_election: true
I20260808 04:40:08.404379 22787 raft_consensus.cc:2454] T 92da9368ec9946459ebcb60a4589338b P e3d1c1c2ef5b4ca1a6ed268c8a358c3a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 02628df318bf414195901aba8b58e2d9 in term 0.
I20260808 04:40:08.404454 22935 raft_consensus.cc:2454] T 92da9368ec9946459ebcb60a4589338b P eef3e5b55032492194cd3df63c04ab1a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 02628df318bf414195901aba8b58e2d9 in term 0.
I20260808 04:40:08.404775 23011 leader_election.cc:302] T 92da9368ec9946459ebcb60a4589338b P 02628df318bf414195901aba8b58e2d9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02628df318bf414195901aba8b58e2d9, eef3e5b55032492194cd3df63c04ab1a; no voters:
I20260808 04:40:08.405102 23161 raft_consensus.cc:2781] T 92da9368ec9946459ebcb60a4589338b P 02628df318bf414195901aba8b58e2d9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 04:40:08.405212 23161 raft_consensus.cc:482] T 92da9368ec9946459ebcb60a4589338b P 02628df318bf414195901aba8b58e2d9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 04:40:08.405256 23161 raft_consensus.cc:3037] T 92da9368ec9946459ebcb60a4589338b P 02628df318bf414195901aba8b58e2d9 [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:40:08.406376 23161 raft_consensus.cc:504] T 92da9368ec9946459ebcb60a4589338b P 02628df318bf414195901aba8b58e2d9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3d1c1c2ef5b4ca1a6ed268c8a358c3a" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 35345 } } peers { permanent_uuid: "eef3e5b55032492194cd3df63c04ab1a" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 39177 } } peers { permanent_uuid: "02628df318bf414195901aba8b58e2d9" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 45719 } }
I20260808 04:40:08.406809 23161 leader_election.cc:288] T 92da9368ec9946459ebcb60a4589338b P 02628df318bf414195901aba8b58e2d9 [CANDIDATE]: Term 1 election: Requested vote from peers e3d1c1c2ef5b4ca1a6ed268c8a358c3a (127.20.240.193:35345), eef3e5b55032492194cd3df63c04ab1a (127.20.240.194:39177)
I20260808 04:40:08.407104 22787 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92da9368ec9946459ebcb60a4589338b" candidate_uuid: "02628df318bf414195901aba8b58e2d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3d1c1c2ef5b4ca1a6ed268c8a358c3a"
I20260808 04:40:08.407231 22787 raft_consensus.cc:3037] T 92da9368ec9946459ebcb60a4589338b P e3d1c1c2ef5b4ca1a6ed268c8a358c3a [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:40:08.407236 22935 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92da9368ec9946459ebcb60a4589338b" candidate_uuid: "02628df318bf414195901aba8b58e2d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eef3e5b55032492194cd3df63c04ab1a"
I20260808 04:40:08.407392 22935 raft_consensus.cc:3037] T 92da9368ec9946459ebcb60a4589338b P eef3e5b55032492194cd3df63c04ab1a [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:40:08.408442 22787 raft_consensus.cc:2454] T 92da9368ec9946459ebcb60a4589338b P e3d1c1c2ef5b4ca1a6ed268c8a358c3a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 02628df318bf414195901aba8b58e2d9 in term 1.
I20260808 04:40:08.408466 22935 raft_consensus.cc:2454] T 92da9368ec9946459ebcb60a4589338b P eef3e5b55032492194cd3df63c04ab1a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 02628df318bf414195901aba8b58e2d9 in term 1.
I20260808 04:40:08.408772 23011 leader_election.cc:302] T 92da9368ec9946459ebcb60a4589338b P 02628df318bf414195901aba8b58e2d9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02628df318bf414195901aba8b58e2d9, eef3e5b55032492194cd3df63c04ab1a; no voters:
I20260808 04:40:08.409034 23161 raft_consensus.cc:2781] T 92da9368ec9946459ebcb60a4589338b P 02628df318bf414195901aba8b58e2d9 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 04:40:08.409292 23161 raft_consensus.cc:686] T 92da9368ec9946459ebcb60a4589338b P 02628df318bf414195901aba8b58e2d9 [term 1 LEADER]: Becoming Leader. State: Replica: 02628df318bf414195901aba8b58e2d9, State: Running, Role: LEADER
I20260808 04:40:08.409557 23161 consensus_queue.cc:237] T 92da9368ec9946459ebcb60a4589338b P 02628df318bf414195901aba8b58e2d9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3d1c1c2ef5b4ca1a6ed268c8a358c3a" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 35345 } } peers { permanent_uuid: "eef3e5b55032492194cd3df63c04ab1a" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 39177 } } peers { permanent_uuid: "02628df318bf414195901aba8b58e2d9" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 45719 } }
I20260808 04:40:08.411825 23195 tablet_replica.cc:439] T 92da9368ec9946459ebcb60a4589338b P 02628df318bf414195901aba8b58e2d9: TxnStatusTablet state changed. Reason: New leader 02628df318bf414195901aba8b58e2d9. Latest consensus state: current_term: 1 leader_uuid: "02628df318bf414195901aba8b58e2d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3d1c1c2ef5b4ca1a6ed268c8a358c3a" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 35345 } } peers { permanent_uuid: "eef3e5b55032492194cd3df63c04ab1a" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 39177 } } peers { permanent_uuid: "02628df318bf414195901aba8b58e2d9" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 45719 } } }
I20260808 04:40:08.411950 23195 tablet_replica.cc:442] T 92da9368ec9946459ebcb60a4589338b P 02628df318bf414195901aba8b58e2d9: This TxnStatusTablet replica's current role is: LEADER
I20260808 04:40:08.412285 23197 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260808 04:40:08.412205 22624 catalog_manager.cc:5495] T 92da9368ec9946459ebcb60a4589338b P 02628df318bf414195901aba8b58e2d9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 02628df318bf414195901aba8b58e2d9 (127.20.240.195). New cstate: current_term: 1 leader_uuid: "02628df318bf414195901aba8b58e2d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3d1c1c2ef5b4ca1a6ed268c8a358c3a" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 35345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eef3e5b55032492194cd3df63c04ab1a" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 39177 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "02628df318bf414195901aba8b58e2d9" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 45719 } health_report { overall_health: HEALTHY } } }
I20260808 04:40:08.412487 23197 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260808 04:40:08.431919 23190 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:08.427648 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.195:45719 (local address 127.0.0.1:57152)
0808 04:40:08.427893 (+ 245us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:08.427907 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:08.428020 (+ 113us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:08.428365 (+ 345us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:08.428368 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:08.428375 (+ 7us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 04:40:08.428489 (+ 114us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:08.428499 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:08.429276 (+ 777us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:08.429282 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:08.429944 (+ 662us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:08.429953 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:08.430609 (+ 656us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:08.430613 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:08.430719 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:08.430766 (+ 47us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 04:40:08.431603 (+ 837us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 04:40:08.431622 (+ 19us) client_negotiation.cc:769] Sending connection context
0808 04:40:08.431695 (+ 73us) client_negotiation.cc:240] Negotiation successful
0808 04:40:08.431787 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":147}
I20260808 04:40:08.431919 23152 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:08.427728 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57152 (local address 127.20.240.195:45719)
0808 04:40:08.427870 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:08.427875 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:08.427952 (+ 77us) server_negotiation.cc:407] Connection header received
0808 04:40:08.428172 (+ 220us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:08.428175 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:08.428242 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:08.428342 (+ 100us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 04:40:08.428599 (+ 257us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:08.429111 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:08.430208 (+ 1097us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:08.430481 (+ 273us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:08.430594 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:08.430937 (+ 343us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 04:40:08.431507 (+ 570us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 04:40:08.431626 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:08.431705 (+ 79us) server_negotiation.cc:299] Negotiation successful
0808 04:40:08.431764 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260808 04:40:08.435405 22935 raft_consensus.cc:1261] T 92da9368ec9946459ebcb60a4589338b P eef3e5b55032492194cd3df63c04ab1a [term 1 FOLLOWER]: Refusing update from remote peer 02628df318bf414195901aba8b58e2d9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 04:40:08.435429 22787 raft_consensus.cc:1261] T 92da9368ec9946459ebcb60a4589338b P e3d1c1c2ef5b4ca1a6ed268c8a358c3a [term 1 FOLLOWER]: Refusing update from remote peer 02628df318bf414195901aba8b58e2d9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 04:40:08.435973 23161 consensus_queue.cc:1035] T 92da9368ec9946459ebcb60a4589338b P 02628df318bf414195901aba8b58e2d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eef3e5b55032492194cd3df63c04ab1a" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 39177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 04:40:08.436182 23195 consensus_queue.cc:1035] T 92da9368ec9946459ebcb60a4589338b P 02628df318bf414195901aba8b58e2d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3d1c1c2ef5b4ca1a6ed268c8a358c3a" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 35345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 04:40:08.437819 23173 tablet_replica.cc:439] T 92da9368ec9946459ebcb60a4589338b P e3d1c1c2ef5b4ca1a6ed268c8a358c3a: TxnStatusTablet state changed. Reason: New leader 02628df318bf414195901aba8b58e2d9. Latest consensus state: current_term: 1 leader_uuid: "02628df318bf414195901aba8b58e2d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3d1c1c2ef5b4ca1a6ed268c8a358c3a" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 35345 } } peers { permanent_uuid: "eef3e5b55032492194cd3df63c04ab1a" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 39177 } } peers { permanent_uuid: "02628df318bf414195901aba8b58e2d9" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 45719 } } }
I20260808 04:40:08.437929 23173 tablet_replica.cc:442] T 92da9368ec9946459ebcb60a4589338b P e3d1c1c2ef5b4ca1a6ed268c8a358c3a: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 04:40:08.438555 23160 tablet_replica.cc:439] T 92da9368ec9946459ebcb60a4589338b P eef3e5b55032492194cd3df63c04ab1a: TxnStatusTablet state changed. Reason: New leader 02628df318bf414195901aba8b58e2d9. Latest consensus state: current_term: 1 leader_uuid: "02628df318bf414195901aba8b58e2d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3d1c1c2ef5b4ca1a6ed268c8a358c3a" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 35345 } } peers { permanent_uuid: "eef3e5b55032492194cd3df63c04ab1a" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 39177 } } peers { permanent_uuid: "02628df318bf414195901aba8b58e2d9" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 45719 } } }
I20260808 04:40:08.438673 23160 tablet_replica.cc:442] T 92da9368ec9946459ebcb60a4589338b P eef3e5b55032492194cd3df63c04ab1a: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 04:40:08.440057 23195 tablet_replica.cc:439] T 92da9368ec9946459ebcb60a4589338b P 02628df318bf414195901aba8b58e2d9: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "02628df318bf414195901aba8b58e2d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3d1c1c2ef5b4ca1a6ed268c8a358c3a" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 35345 } } peers { permanent_uuid: "eef3e5b55032492194cd3df63c04ab1a" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 39177 } } peers { permanent_uuid: "02628df318bf414195901aba8b58e2d9" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 45719 } } }
I20260808 04:40:08.440205 23195 tablet_replica.cc:442] T 92da9368ec9946459ebcb60a4589338b P 02628df318bf414195901aba8b58e2d9: This TxnStatusTablet replica's current role is: LEADER
I20260808 04:40:08.441272 23173 tablet_replica.cc:439] T 92da9368ec9946459ebcb60a4589338b P e3d1c1c2ef5b4ca1a6ed268c8a358c3a: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "02628df318bf414195901aba8b58e2d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3d1c1c2ef5b4ca1a6ed268c8a358c3a" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 35345 } } peers { permanent_uuid: "eef3e5b55032492194cd3df63c04ab1a" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 39177 } } peers { permanent_uuid: "02628df318bf414195901aba8b58e2d9" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 45719 } } }
I20260808 04:40:08.441382 23173 tablet_replica.cc:442] T 92da9368ec9946459ebcb60a4589338b P e3d1c1c2ef5b4ca1a6ed268c8a358c3a: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 04:40:08.441672 23168 mvcc.cc:205] Tried to move back new op lower bound from 7316127778545606656 to 7316127778449174528. Current Snapshot: MvccSnapshot[applied={T|T < 7316127778545606656}]
I20260808 04:40:08.442577 23161 tablet_replica.cc:439] T 92da9368ec9946459ebcb60a4589338b P 02628df318bf414195901aba8b58e2d9: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "02628df318bf414195901aba8b58e2d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3d1c1c2ef5b4ca1a6ed268c8a358c3a" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 35345 } } peers { permanent_uuid: "eef3e5b55032492194cd3df63c04ab1a" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 39177 } } peers { permanent_uuid: "02628df318bf414195901aba8b58e2d9" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 45719 } } }
I20260808 04:40:08.442978 23161 tablet_replica.cc:442] T 92da9368ec9946459ebcb60a4589338b P 02628df318bf414195901aba8b58e2d9: This TxnStatusTablet replica's current role is: LEADER
I20260808 04:40:08.445142 23160 tablet_replica.cc:439] T 92da9368ec9946459ebcb60a4589338b P eef3e5b55032492194cd3df63c04ab1a: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "02628df318bf414195901aba8b58e2d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3d1c1c2ef5b4ca1a6ed268c8a358c3a" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 35345 } } peers { permanent_uuid: "eef3e5b55032492194cd3df63c04ab1a" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 39177 } } peers { permanent_uuid: "02628df318bf414195901aba8b58e2d9" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 45719 } } }
I20260808 04:40:08.445518 23160 tablet_replica.cc:442] T 92da9368ec9946459ebcb60a4589338b P eef3e5b55032492194cd3df63c04ab1a: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 04:40:08.460928 23205 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:08.456966 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.195:45719 (local address 127.20.240.193:50379)
0808 04:40:08.457309 (+ 343us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:08.457326 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:08.457445 (+ 119us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:08.457812 (+ 367us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:08.457815 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:08.457824 (+ 9us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 04:40:08.457950 (+ 126us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:08.457960 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:08.458693 (+ 733us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:08.458697 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:08.459533 (+ 836us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:08.459546 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:08.460132 (+ 586us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:08.460135 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:08.460210 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:08.460261 (+ 51us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 04:40:08.460605 (+ 344us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 04:40:08.460610 (+ 5us) client_negotiation.cc:769] Sending connection context
0808 04:40:08.460690 (+ 80us) client_negotiation.cc:240] Negotiation successful
0808 04:40:08.460789 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":226,"thread_start_us":95,"threads_started":1}
I20260808 04:40:08.460902 23152 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:08.457424 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.240.193:50379 (local address 127.20.240.195:45719)
0808 04:40:08.457569 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:08.457573 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:08.457587 (+ 14us) server_negotiation.cc:407] Connection header received
0808 04:40:08.457641 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:08.457647 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:08.457719 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:08.457794 (+ 75us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 04:40:08.458062 (+ 268us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:08.458576 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:08.459678 (+ 1102us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:08.459952 (+ 274us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:08.460022 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:08.460418 (+ 396us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 04:40:08.460510 (+ 92us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 04:40:08.460550 (+ 40us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:08.460704 (+ 154us) server_negotiation.cc:299] Negotiation successful
0808 04:40:08.460757 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260808 04:40:08.470408 23081 raft_consensus.cc:1261] T 4dd02c5c330244c8954798b8cdcbc84b P 02628df318bf414195901aba8b58e2d9 [term 1 FOLLOWER]: Refusing update from remote peer e3d1c1c2ef5b4ca1a6ed268c8a358c3a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 04:40:08.470408 22935 raft_consensus.cc:1261] T 4dd02c5c330244c8954798b8cdcbc84b P eef3e5b55032492194cd3df63c04ab1a [term 1 FOLLOWER]: Refusing update from remote peer e3d1c1c2ef5b4ca1a6ed268c8a358c3a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 04:40:08.471006 23173 consensus_queue.cc:1035] T 4dd02c5c330244c8954798b8cdcbc84b P e3d1c1c2ef5b4ca1a6ed268c8a358c3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "eef3e5b55032492194cd3df63c04ab1a" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 39177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 04:40:08.471181 23162 consensus_queue.cc:1035] T 4dd02c5c330244c8954798b8cdcbc84b P e3d1c1c2ef5b4ca1a6ed268c8a358c3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "02628df318bf414195901aba8b58e2d9" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 45719 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 04:40:08.479224 23171 mvcc.cc:205] Tried to move back new op lower bound from 7316127778690932736 to 7316127777998954496. Current Snapshot: MvccSnapshot[applied={T|T < 7316127778690932736}]
I20260808 04:40:08.499308 23210 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:08.494348 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.193:35345 (local address 127.20.240.195:38473)
0808 04:40:08.494683 (+ 335us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:08.494699 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:08.494815 (+ 116us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:08.495241 (+ 426us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:08.495245 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:08.495255 (+ 10us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 04:40:08.495390 (+ 135us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:08.495397 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:08.496518 (+ 1121us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:08.496522 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:08.497891 (+ 1369us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:08.497903 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:08.498487 (+ 584us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:08.498490 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:08.498619 (+ 129us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:08.498666 (+ 47us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 04:40:08.498986 (+ 320us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 04:40:08.498994 (+ 8us) client_negotiation.cc:769] Sending connection context
0808 04:40:08.499060 (+ 66us) client_negotiation.cc:240] Negotiation successful
0808 04:40:08.499143 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":202,"thread_start_us":111,"threads_started":1}
I20260808 04:40:08.499296 23153 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:08.494758 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.240.195:38473 (local address 127.20.240.193:35345)
0808 04:40:08.494865 (+ 107us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:08.494869 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:08.494883 (+ 14us) server_negotiation.cc:407] Connection header received
0808 04:40:08.494933 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:08.494938 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:08.494983 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:08.495082 (+ 99us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 04:40:08.495525 (+ 443us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:08.496405 (+ 880us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:08.498036 (+ 1631us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:08.498353 (+ 317us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:08.498475 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:08.498811 (+ 336us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 04:40:08.498902 (+ 91us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 04:40:08.498982 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:08.499069 (+ 87us) server_negotiation.cc:299] Negotiation successful
0808 04:40:08.499124 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260808 04:40:08.524716 22624 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:36364:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 04:40:08.524892 22624 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:36364:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 04:40:08.527037 22624 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 4ecb9ee877ff450fae91d30f2669eab4: Sending DeleteTablet for 3 replicas of tablet 4dd02c5c330244c8954798b8cdcbc84b
I20260808 04:40:08.527688 22767 tablet_service.cc:1514] Processing DeleteTablet for tablet 4dd02c5c330244c8954798b8cdcbc84b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 04:40:08 UTC) from {username='kudu', principal='kudu/127.20.240.254@KRBTEST.COM'} at 127.0.0.1:46402
I20260808 04:40:08.527910 22913 tablet_service.cc:1514] Processing DeleteTablet for tablet 4dd02c5c330244c8954798b8cdcbc84b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 04:40:08 UTC) from {username='kudu', principal='kudu/127.20.240.254@KRBTEST.COM'} at 127.0.0.1:60972
I20260808 04:40:08.528098 23180 tablet_replica.cc:330] T 4dd02c5c330244c8954798b8cdcbc84b P e3d1c1c2ef5b4ca1a6ed268c8a358c3a: stopping tablet replica
I20260808 04:40:08.528227 23180 raft_consensus.cc:2229] T 4dd02c5c330244c8954798b8cdcbc84b P e3d1c1c2ef5b4ca1a6ed268c8a358c3a [term 1 LEADER]: Raft consensus shutting down.
I20260808 04:40:08.528435 23180 raft_consensus.cc:2258] T 4dd02c5c330244c8954798b8cdcbc84b P e3d1c1c2ef5b4ca1a6ed268c8a358c3a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 04:40:08.528610 23178 tablet_replica.cc:330] T 4dd02c5c330244c8954798b8cdcbc84b P eef3e5b55032492194cd3df63c04ab1a: stopping tablet replica
I20260808 04:40:08.528724 23178 raft_consensus.cc:2229] T 4dd02c5c330244c8954798b8cdcbc84b P eef3e5b55032492194cd3df63c04ab1a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 04:40:08.528841 23178 raft_consensus.cc:2258] T 4dd02c5c330244c8954798b8cdcbc84b P eef3e5b55032492194cd3df63c04ab1a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 04:40:08.529954 23178 ts_tablet_manager.cc:1905] T 4dd02c5c330244c8954798b8cdcbc84b P eef3e5b55032492194cd3df63c04ab1a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 04:40:08.533123 23178 ts_tablet_manager.cc:1918] T 4dd02c5c330244c8954798b8cdcbc84b P eef3e5b55032492194cd3df63c04ab1a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 04:40:08.533380 23178 log.cc:1196] T 4dd02c5c330244c8954798b8cdcbc84b P eef3e5b55032492194cd3df63c04ab1a: Deleting WAL directory at /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786164000593138-21443-0/minicluster-data/ts-1/wal/wals/4dd02c5c330244c8954798b8cdcbc84b
I20260808 04:40:08.533640 23178 ts_tablet_manager.cc:1939] T 4dd02c5c330244c8954798b8cdcbc84b P eef3e5b55032492194cd3df63c04ab1a: Deleting consensus metadata
I20260808 04:40:08.533757 23180 ts_tablet_manager.cc:1905] T 4dd02c5c330244c8954798b8cdcbc84b P e3d1c1c2ef5b4ca1a6ed268c8a358c3a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 04:40:08.534420 22609 catalog_manager.cc:4841] TS eef3e5b55032492194cd3df63c04ab1a (127.20.240.194:39177): tablet 4dd02c5c330244c8954798b8cdcbc84b (table test-table [id=ee05a5a74e5c4d008fb5ad53d3f2dfb3]) successfully deleted
I20260808 04:40:08.536201 23180 ts_tablet_manager.cc:1918] T 4dd02c5c330244c8954798b8cdcbc84b P e3d1c1c2ef5b4ca1a6ed268c8a358c3a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 04:40:08.536298 23180 log.cc:1196] T 4dd02c5c330244c8954798b8cdcbc84b P e3d1c1c2ef5b4ca1a6ed268c8a358c3a: Deleting WAL directory at /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786164000593138-21443-0/minicluster-data/ts-0/wal/wals/4dd02c5c330244c8954798b8cdcbc84b
I20260808 04:40:08.536559 23180 ts_tablet_manager.cc:1939] T 4dd02c5c330244c8954798b8cdcbc84b P e3d1c1c2ef5b4ca1a6ed268c8a358c3a: Deleting consensus metadata
I20260808 04:40:08.536902 23060 tablet_service.cc:1514] Processing DeleteTablet for tablet 4dd02c5c330244c8954798b8cdcbc84b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 04:40:08 UTC) from {username='kudu', principal='kudu/127.20.240.254@KRBTEST.COM'} at 127.0.0.1:57148
I20260808 04:40:08.537122 23179 tablet_replica.cc:330] T 4dd02c5c330244c8954798b8cdcbc84b P 02628df318bf414195901aba8b58e2d9: stopping tablet replica
I20260808 04:40:08.537302 23179 raft_consensus.cc:2229] T 4dd02c5c330244c8954798b8cdcbc84b P 02628df318bf414195901aba8b58e2d9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 04:40:08.537436 23179 raft_consensus.cc:2258] T 4dd02c5c330244c8954798b8cdcbc84b P 02628df318bf414195901aba8b58e2d9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 04:40:08.537624 22609 catalog_manager.cc:4841] TS e3d1c1c2ef5b4ca1a6ed268c8a358c3a (127.20.240.193:35345): tablet 4dd02c5c330244c8954798b8cdcbc84b (table test-table [id=ee05a5a74e5c4d008fb5ad53d3f2dfb3]) successfully deleted
I20260808 04:40:08.538471 23179 ts_tablet_manager.cc:1905] T 4dd02c5c330244c8954798b8cdcbc84b P 02628df318bf414195901aba8b58e2d9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 04:40:08.541508 23179 ts_tablet_manager.cc:1918] T 4dd02c5c330244c8954798b8cdcbc84b P 02628df318bf414195901aba8b58e2d9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 04:40:08.541604 23179 log.cc:1196] T 4dd02c5c330244c8954798b8cdcbc84b P 02628df318bf414195901aba8b58e2d9: Deleting WAL directory at /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786164000593138-21443-0/minicluster-data/ts-2/wal/wals/4dd02c5c330244c8954798b8cdcbc84b
I20260808 04:40:08.541872 23179 ts_tablet_manager.cc:1939] T 4dd02c5c330244c8954798b8cdcbc84b P 02628df318bf414195901aba8b58e2d9: Deleting consensus metadata
I20260808 04:40:08.542757 22611 catalog_manager.cc:4841] TS 02628df318bf414195901aba8b58e2d9 (127.20.240.195:45719): tablet 4dd02c5c330244c8954798b8cdcbc84b (table test-table [id=ee05a5a74e5c4d008fb5ad53d3f2dfb3]) successfully deleted
Aug 08 04:40:08 dist-test-slave-vxj2 krb5kdc[22577](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164007, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.20.240.193@KRBTEST.COM
I20260808 04:40:08.548408 23153 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:08.529638 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46424 (local address 127.20.240.193:35345)
0808 04:40:08.529763 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:08.529770 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:08.537399 (+ 7629us) server_negotiation.cc:407] Connection header received
0808 04:40:08.537637 (+ 238us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:08.537643 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:08.537713 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:08.537758 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:08.538705 (+ 947us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:08.539209 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:08.540064 (+ 855us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:08.540289 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:08.540419 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:08.544484 (+ 4065us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:40:08.544497 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:40:08.544511 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:40:08.544540 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:40:08.546567 (+ 2027us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:08.547085 (+ 518us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:08.547090 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:08.547091 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:08.547169 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:08.547468 (+ 299us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:08.547470 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:08.547472 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:08.547726 (+ 254us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:40:08.547893 (+ 167us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:08.548115 (+ 222us) server_negotiation.cc:299] Negotiation successful
0808 04:40:08.548222 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
W20260808 04:40:08.549137 22829 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.SetFlag from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:46424
I20260808 04:40:08.559230 22676 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:08.551189 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36370 (local address 127.20.240.254:43933)
0808 04:40:08.551363 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:08.551368 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:08.551386 (+ 18us) server_negotiation.cc:407] Connection header received
0808 04:40:08.551459 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:08.551462 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:08.551511 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:08.551596 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:08.552289 (+ 693us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:08.553097 (+ 808us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:08.553943 (+ 846us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:08.554303 (+ 360us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:08.554416 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:08.555800 (+ 1384us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:40:08.555805 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:40:08.555808 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:40:08.555838 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:40:08.557431 (+ 1593us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:08.557831 (+ 400us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:08.557835 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:08.557837 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:08.557931 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:08.558286 (+ 355us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:08.558289 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:08.558291 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:08.558521 (+ 230us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:40:08.558649 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:08.558935 (+ 286us) server_negotiation.cc:299] Negotiation successful
0808 04:40:08.559064 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
W20260808 04:40:08.559736 22624 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:36370
I20260808 04:40:08.561067 21443 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu with pid 22701
I20260808 04:40:08.571688 21443 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu with pid 22846
I20260808 04:40:08.582424 21443 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu with pid 22993
I20260808 04:40:08.590492 21443 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu with pid 22591
2026-08-08T04:40:08Z chronyd exiting
[ OK ] SecurityITest.SmokeTestAsAuthorizedUser (2919 ms)
[ RUN ] SecurityITest.TxnSmokeWithDifferentUserTypes
Loading random data
Initializing database '/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786164000593138-21443-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 04:40:08 dist-test-slave-vxj2 krb5kdc[23218](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 04:40:08 dist-test-slave-vxj2 krb5kdc[23218](info): set up 2 sockets
Aug 08 04:40:08 dist-test-slave-vxj2 krb5kdc[23218](info): commencing operation
krb5kdc: starting...
W20260808 04:40:09.685400 21443 mini_kdc.cc:121] Time spent starting KDC: real 1.069s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786164000593138-21443-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786164000593138-21443-0/krb5kdc/test-user.keytab.
Aug 08 04:40:09 dist-test-slave-vxj2 krb5kdc[23218](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164009, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T04:40:09Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T04:40:09Z Disabled control of system clock
WARNING: no policy specified for kudu/127.20.240.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.240.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.240.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.254.keytab.
Entry for principal kudu/127.20.240.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.254.keytab.
I20260808 04:40:09.812721 21443 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
/tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786164000593138-21443-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786164000593138-21443-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786164000593138-21443-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786164000593138-21443-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.240.254:36383
--webserver_interface=127.20.240.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.254.keytab
--principal=kudu/127.20.240.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.240.212:38159
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.240.254:36383
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786164000593138-21443-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786164000593138-21443-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786164000593138-21443-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 04:40:09.928366 23231 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:40:09.928697 23231 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:40:09.928781 23231 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:40:09.932780 23231 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 04:40:09.932878 23231 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260808 04:40:09.932911 23231 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:40:09.932962 23231 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:40:09.933003 23231 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 04:40:09.933039 23231 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 04:40:09.938395 23231 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.240.212:38159
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786164000593138-21443-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786164000593138-21443-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.240.254:36383
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.254.keytab
--principal=kudu/127.20.240.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.240.254:36383
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786164000593138-21443-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.240.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23231
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786164000593138-21443-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 04:05:18 UTC on ccycloud.quasar-drfdgt.root.comops.site
build id 4574101
I20260808 04:40:09.939628 23231 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:40:09.940732 23231 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:40:09.949761 23236 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:40:09.949752 23239 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:40:09.949878 23237 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:40:09.950177 23231 server_base.cc:1034] running on GCE node
I20260808 04:40:09.950776 23231 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:40:09.951961 23231 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:40:09.953215 23231 hybrid_clock.cc:648] HybridClock initialized: now 1786164009953161 us; error 45 us; skew 500 ppm
Aug 08 04:40:09 dist-test-slave-vxj2 krb5kdc[23218](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164009, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.240.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:40:09.962456 23231 init.cc:377] Logged in from keytab as kudu/127.20.240.254@KRBTEST.COM (short username kudu)
I20260808 04:40:09.963455 23231 webserver.cc:460] Webserver started at http://127.20.240.254:38045/ using document root <none> and password file <none>
I20260808 04:40:09.964083 23231 fs_manager.cc:359] Metadata directory not provided
I20260808 04:40:09.964181 23231 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:40:09.964432 23231 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 04:40:09.966722 23231 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786164000593138-21443-0/minicluster-data/master-0/data/instance:
uuid: "cc10ed40a4bf4b58aba57fcd15d2eb48"
format_stamp: "Formatted at 2026-08-08 04:40:09 on dist-test-slave-vxj2"
server_key: "085b6ca0285f6fe178fbbdd00f287e05"
server_key_iv: "aac1676f9591eddc66937ac9851c02b4"
server_key_version: "encryptionkey@0"
I20260808 04:40:09.967448 23231 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786164000593138-21443-0/minicluster-data/master-0/wal/instance:
uuid: "cc10ed40a4bf4b58aba57fcd15d2eb48"
format_stamp: "Formatted at 2026-08-08 04:40:09 on dist-test-slave-vxj2"
server_key: "085b6ca0285f6fe178fbbdd00f287e05"
server_key_iv: "aac1676f9591eddc66937ac9851c02b4"
server_key_version: "encryptionkey@0"
I20260808 04:40:09.971694 23231 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.004s
I20260808 04:40:09.974375 23248 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:09.975726 23231 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260808 04:40:09.975914 23231 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786164000593138-21443-0/minicluster-data/master-0/data,/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786164000593138-21443-0/minicluster-data/master-0/wal
uuid: "cc10ed40a4bf4b58aba57fcd15d2eb48"
format_stamp: "Formatted at 2026-08-08 04:40:09 on dist-test-slave-vxj2"
server_key: "085b6ca0285f6fe178fbbdd00f287e05"
server_key_iv: "aac1676f9591eddc66937ac9851c02b4"
server_key_version: "encryptionkey@0"
I20260808 04:40:09.976051 23231 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786164000593138-21443-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786164000593138-21443-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786164000593138-21443-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:40:09.988166 23231 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:40:09.991313 23231 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:40:09.991539 23231 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:40:09.999784 23231 rpc_server.cc:307] RPC server started. Bound to: 127.20.240.254:36383
I20260808 04:40:09.999774 23313 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.240.254:36383 every 8 connection(s)
I20260808 04:40:10.000852 23231 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786164000593138-21443-0/minicluster-data/master-0/data/info.pb
I20260808 04:40:10.004122 23314 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:40:10.010037 21443 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu as pid 23231
I20260808 04:40:10.010149 21443 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786164000593138-21443-0/minicluster-data/master-0/wal/instance
I20260808 04:40:10.010326 23314 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cc10ed40a4bf4b58aba57fcd15d2eb48: Bootstrap starting.
I20260808 04:40:10.010468 21443 external_mini_cluster.cc:1428] Setting key 2271468a027545cb52d197fa2502542f
I20260808 04:40:10.013563 23314 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P cc10ed40a4bf4b58aba57fcd15d2eb48: Neither blocks nor log segments found. Creating new log.
I20260808 04:40:10.014425 23314 log.cc:824] T 00000000000000000000000000000000 P cc10ed40a4bf4b58aba57fcd15d2eb48: Log is configured to *not* fsync() on all Append() calls
I20260808 04:40:10.016793 23314 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cc10ed40a4bf4b58aba57fcd15d2eb48: No bootstrap required, opened a new log
Aug 08 04:40:10 dist-test-slave-vxj2 krb5kdc[23218](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164009, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.240.254@KRBTEST.COM
I20260808 04:40:10.021521 23314 raft_consensus.cc:348] T 00000000000000000000000000000000 P cc10ed40a4bf4b58aba57fcd15d2eb48 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cc10ed40a4bf4b58aba57fcd15d2eb48" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 36383 } }
I20260808 04:40:10.021904 23314 raft_consensus.cc:374] T 00000000000000000000000000000000 P cc10ed40a4bf4b58aba57fcd15d2eb48 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:40:10.021997 23314 raft_consensus.cc:729] T 00000000000000000000000000000000 P cc10ed40a4bf4b58aba57fcd15d2eb48 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc10ed40a4bf4b58aba57fcd15d2eb48, State: Initialized, Role: FOLLOWER
I20260808 04:40:10.022668 23314 consensus_queue.cc:260] T 00000000000000000000000000000000 P cc10ed40a4bf4b58aba57fcd15d2eb48 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cc10ed40a4bf4b58aba57fcd15d2eb48" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 36383 } }
I20260808 04:40:10.022862 23314 raft_consensus.cc:388] T 00000000000000000000000000000000 P cc10ed40a4bf4b58aba57fcd15d2eb48 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 04:40:10.022974 23314 raft_consensus.cc:482] T 00000000000000000000000000000000 P cc10ed40a4bf4b58aba57fcd15d2eb48 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 04:40:10.023084 23314 raft_consensus.cc:3037] T 00000000000000000000000000000000 P cc10ed40a4bf4b58aba57fcd15d2eb48 [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:40:10.024152 23314 raft_consensus.cc:504] T 00000000000000000000000000000000 P cc10ed40a4bf4b58aba57fcd15d2eb48 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cc10ed40a4bf4b58aba57fcd15d2eb48" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 36383 } }
I20260808 04:40:10.024533 23314 leader_election.cc:302] T 00000000000000000000000000000000 P cc10ed40a4bf4b58aba57fcd15d2eb48 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: cc10ed40a4bf4b58aba57fcd15d2eb48; no voters:
I20260808 04:40:10.024919 23314 leader_election.cc:288] T 00000000000000000000000000000000 P cc10ed40a4bf4b58aba57fcd15d2eb48 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 04:40:10.025015 23319 raft_consensus.cc:2781] T 00000000000000000000000000000000 P cc10ed40a4bf4b58aba57fcd15d2eb48 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 04:40:10.025306 23319 raft_consensus.cc:686] T 00000000000000000000000000000000 P cc10ed40a4bf4b58aba57fcd15d2eb48 [term 1 LEADER]: Becoming Leader. State: Replica: cc10ed40a4bf4b58aba57fcd15d2eb48, State: Running, Role: LEADER
I20260808 04:40:10.025635 23319 consensus_queue.cc:237] T 00000000000000000000000000000000 P cc10ed40a4bf4b58aba57fcd15d2eb48 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cc10ed40a4bf4b58aba57fcd15d2eb48" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 36383 } }
I20260808 04:40:10.026517 23314 sys_catalog.cc:564] T 00000000000000000000000000000000 P cc10ed40a4bf4b58aba57fcd15d2eb48 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 04:40:10.026897 23319 sys_catalog.cc:455] T 00000000000000000000000000000000 P cc10ed40a4bf4b58aba57fcd15d2eb48 [sys.catalog]: SysCatalogTable state changed. Reason: New leader cc10ed40a4bf4b58aba57fcd15d2eb48. Latest consensus state: current_term: 1 leader_uuid: "cc10ed40a4bf4b58aba57fcd15d2eb48" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cc10ed40a4bf4b58aba57fcd15d2eb48" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 36383 } } }
I20260808 04:40:10.027040 23319 sys_catalog.cc:458] T 00000000000000000000000000000000 P cc10ed40a4bf4b58aba57fcd15d2eb48 [sys.catalog]: This master's current role is: LEADER
I20260808 04:40:10.027477 23320 sys_catalog.cc:455] T 00000000000000000000000000000000 P cc10ed40a4bf4b58aba57fcd15d2eb48 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "cc10ed40a4bf4b58aba57fcd15d2eb48" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cc10ed40a4bf4b58aba57fcd15d2eb48" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 36383 } } }
I20260808 04:40:10.027633 23320 sys_catalog.cc:458] T 00000000000000000000000000000000 P cc10ed40a4bf4b58aba57fcd15d2eb48 [sys.catalog]: This master's current role is: LEADER
I20260808 04:40:10.027968 23317 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:10.012288 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35016 (local address 127.20.240.254:36383)
0808 04:40:10.012818 (+ 530us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:10.012843 (+ 25us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:10.012882 (+ 39us) server_negotiation.cc:407] Connection header received
0808 04:40:10.013632 (+ 750us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:10.013653 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:10.014081 (+ 428us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:10.014380 (+ 299us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:10.015306 (+ 926us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:10.016307 (+ 1001us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:10.017552 (+ 1245us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:10.018034 (+ 482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:10.018168 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:10.021090 (+ 2922us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:40:10.021095 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:40:10.021111 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:40:10.021142 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:40:10.023497 (+ 2355us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:10.023992 (+ 495us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:10.023998 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:10.024004 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:10.024132 (+ 128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:10.024481 (+ 349us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:10.024484 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:10.024486 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:10.025324 (+ 838us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:40:10.026367 (+ 1043us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:10.026513 (+ 146us) server_negotiation.cc:299] Negotiation successful
0808 04:40:10.026845 (+ 332us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":364,"thread_start_us":196,"threads_started":1}
W20260808 04:40:10.031761 23334 catalog_manager.cc:1558] T 00000000000000000000000000000000 P cc10ed40a4bf4b58aba57fcd15d2eb48: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 04:40:10.031847 23334 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 04:40:10.031929 23323 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 04:40:10.032646 23323 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 04:40:10.038957 23323 catalog_manager.cc:1347] Generated new cluster ID: 05289fa835474a0094cf33797e5a5329
I20260808 04:40:10.039049 23323 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 04:40:10.050243 23323 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 04:40:10.051823 23323 catalog_manager.cc:1504] Loading token signing keys...
I20260808 04:40:10.062189 23323 catalog_manager.cc:5868] T 00000000000000000000000000000000 P cc10ed40a4bf4b58aba57fcd15d2eb48: Generated new TSK 0
I20260808 04:40:10.063201 23323 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.20.240.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.240.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.240.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.193.keytab.
Entry for principal kudu/127.20.240.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.193.keytab.
I20260808 04:40:10.097483 21443 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
/tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786164000593138-21443-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786164000593138-21443-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786164000593138-21443-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786164000593138-21443-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.240.193:0
--local_ip_for_outbound_sockets=127.20.240.193
--webserver_interface=127.20.240.193
--webserver_port=0
--tserver_master_addrs=127.20.240.254:36383
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.193.keytab
--principal=kudu/127.20.240.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.240.212:38159
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786164000593138-21443-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786164000593138-21443-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786164000593138-21443-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 04:40:10.215521 23341 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:40:10.215808 23341 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:40:10.215905 23341 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:40:10.220068 23341 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:40:10.220160 23341 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:40:10.220204 23341 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260808 04:40:10.220219 23341 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260808 04:40:10.220301 23341 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.240.193
I20260808 04:40:10.226136 23341 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.240.212:38159
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786164000593138-21443-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786164000593138-21443-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.193.keytab
--principal=kudu/127.20.240.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.240.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786164000593138-21443-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.240.193
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.20.240.254:36383
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23341
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.240.193
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786164000593138-21443-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 04:05:18 UTC on ccycloud.quasar-drfdgt.root.comops.site
build id 4574101
I20260808 04:40:10.227478 23341 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:40:10.228622 23341 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:40:10.239197 23346 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:40:10.239181 23349 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:40:10.239202 23347 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:40:10.239595 23341 server_base.cc:1034] running on GCE node
I20260808 04:40:10.240053 23341 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:40:10.240801 23341 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:40:10.242019 23341 hybrid_clock.cc:648] HybridClock initialized: now 1786164010242002 us; error 25 us; skew 500 ppm
Aug 08 04:40:10 dist-test-slave-vxj2 krb5kdc[23218](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164010, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.240.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:40:10.245223 23341 init.cc:377] Logged in from keytab as kudu/127.20.240.193@KRBTEST.COM (short username kudu)
I20260808 04:40:10.246145 23341 webserver.cc:460] Webserver started at http://127.20.240.193:38855/ using document root <none> and password file <none>
I20260808 04:40:10.246803 23341 fs_manager.cc:359] Metadata directory not provided
I20260808 04:40:10.246927 23341 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:40:10.247197 23341 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 04:40:10.249612 23341 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786164000593138-21443-0/minicluster-data/ts-0/data/instance:
uuid: "27da82a1c2d3446f95f7ecd5d9405358"
format_stamp: "Formatted at 2026-08-08 04:40:10 on dist-test-slave-vxj2"
server_key: "c4afd307a78b946560065a070760ce61"
server_key_iv: "33d190fa58df9324195f1a05798bbd69"
server_key_version: "encryptionkey@0"
I20260808 04:40:10.250258 23341 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786164000593138-21443-0/minicluster-data/ts-0/wal/instance:
uuid: "27da82a1c2d3446f95f7ecd5d9405358"
format_stamp: "Formatted at 2026-08-08 04:40:10 on dist-test-slave-vxj2"
server_key: "c4afd307a78b946560065a070760ce61"
server_key_iv: "33d190fa58df9324195f1a05798bbd69"
server_key_version: "encryptionkey@0"
I20260808 04:40:10.254626 23341 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260808 04:40:10.257468 23356 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:10.258940 23341 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260808 04:40:10.259116 23341 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786164000593138-21443-0/minicluster-data/ts-0/data,/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786164000593138-21443-0/minicluster-data/ts-0/wal
uuid: "27da82a1c2d3446f95f7ecd5d9405358"
format_stamp: "Formatted at 2026-08-08 04:40:10 on dist-test-slave-vxj2"
server_key: "c4afd307a78b946560065a070760ce61"
server_key_iv: "33d190fa58df9324195f1a05798bbd69"
server_key_version: "encryptionkey@0"
I20260808 04:40:10.259260 23341 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786164000593138-21443-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786164000593138-21443-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786164000593138-21443-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:40:10.269452 23341 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:40:10.272714 23341 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:40:10.272945 23341 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:40:10.274586 23341 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 04:40:10.274665 23341 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:10.274732 23341 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 04:40:10.274775 23341 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 08 04:40:10 dist-test-slave-vxj2 krb5kdc[23218](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164010, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.240.193@KRBTEST.COM for kudu/127.20.240.254@KRBTEST.COM
I20260808 04:40:10.286167 23341 rpc_server.cc:307] RPC server started. Bound to: 127.20.240.193:36077
I20260808 04:40:10.286512 23477 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.240.193:36077 every 8 connection(s)
I20260808 04:40:10.287379 23341 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786164000593138-21443-0/minicluster-data/ts-0/data/info.pb
I20260808 04:40:10.289939 23317 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:10.275587 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.240.193:40519 (local address 127.20.240.254:36383)
0808 04:40:10.275769 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:10.275774 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:10.276666 (+ 892us) server_negotiation.cc:407] Connection header received
0808 04:40:10.277898 (+ 1232us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:10.277902 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:10.277975 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:10.278076 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:10.279459 (+ 1383us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:10.280393 (+ 934us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:10.282006 (+ 1613us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:10.282472 (+ 466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:10.282597 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:10.285683 (+ 3086us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:40:10.285687 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:40:10.285691 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:40:10.285729 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:40:10.287569 (+ 1840us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:10.288282 (+ 713us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:10.288293 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:10.288295 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:10.288381 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:10.288765 (+ 384us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:10.288768 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:10.288769 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:10.289062 (+ 293us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:40:10.289232 (+ 170us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:10.289692 (+ 460us) server_negotiation.cc:299] Negotiation successful
0808 04:40:10.289804 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260808 04:40:10.290786 23366 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:10.275994 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:36383 (local address 127.20.240.193:40519)
0808 04:40:10.276481 (+ 487us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:10.276535 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:10.277655 (+ 1120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:10.278252 (+ 597us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:10.278258 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:10.278609 (+ 351us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:40:10.279289 (+ 680us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:10.279311 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:10.280534 (+ 1223us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:10.280537 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:10.281823 (+ 1286us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:10.281841 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:10.282648 (+ 807us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:10.282653 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:10.282881 (+ 228us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:10.283580 (+ 699us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:40:10.283597 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:40:10.285500 (+ 1903us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:40:10.287684 (+ 2184us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:10.287689 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:10.287701 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:10.288143 (+ 442us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:10.288489 (+ 346us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:10.288492 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:10.288493 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:10.288636 (+ 143us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:10.289238 (+ 602us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:40:10.289244 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:40:10.289470 (+ 226us) client_negotiation.cc:769] Sending connection context
0808 04:40:10.289615 (+ 145us) client_negotiation.cc:240] Negotiation successful
0808 04:40:10.289914 (+ 299us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":287,"thread_start_us":148,"threads_started":1}
I20260808 04:40:10.292137 23478 heartbeater.cc:347] Connected to a master server at 127.20.240.254:36383
I20260808 04:40:10.292292 23478 heartbeater.cc:464] Registering TS with master...
I20260808 04:40:10.292809 23478 heartbeater.cc:511] Master 127.20.240.254:36383 requested a full tablet report, sending...
I20260808 04:40:10.294380 23264 ts_manager.cc:194] Registered new tserver with Master: 27da82a1c2d3446f95f7ecd5d9405358 (127.20.240.193:36077)
I20260808 04:40:10.294909 21443 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu as pid 23341
I20260808 04:40:10.295024 21443 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786164000593138-21443-0/minicluster-data/ts-0/wal/instance
I20260808 04:40:10.295328 21443 external_mini_cluster.cc:1428] Setting key ee85f92d8da1be4f4a2c702d2d4ae44b
I20260808 04:40:10.295790 23264 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.240.193@KRBTEST.COM'} at 127.20.240.193:40519
I20260808 04:40:10.302300 23317 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:10.294420 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.240.193:59705 (local address 127.20.240.254:36383)
0808 04:40:10.294546 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:10.294550 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:10.294663 (+ 113us) server_negotiation.cc:407] Connection header received
0808 04:40:10.294778 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:10.294781 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:10.294820 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:10.294903 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:10.295433 (+ 530us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:10.296135 (+ 702us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:10.297198 (+ 1063us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:10.297442 (+ 244us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:10.297564 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:10.298866 (+ 1302us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:40:10.298869 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:40:10.298871 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:40:10.298894 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:40:10.300336 (+ 1442us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:10.300893 (+ 557us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:10.300901 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:10.300904 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:10.301007 (+ 103us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:10.301391 (+ 384us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:10.301393 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:10.301395 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:10.301575 (+ 180us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:40:10.301654 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:10.302051 (+ 397us) server_negotiation.cc:299] Negotiation successful
0808 04:40:10.302169 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260808 04:40:10.302455 23484 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:10.294297 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:36383 (local address 127.20.240.193:59705)
0808 04:40:10.294567 (+ 270us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:10.294583 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:10.294690 (+ 107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:10.294942 (+ 252us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:10.294945 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:10.295167 (+ 222us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:40:10.295305 (+ 138us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:10.295312 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:10.296292 (+ 980us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:10.296295 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:10.297053 (+ 758us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:10.297062 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:10.297560 (+ 498us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:10.297563 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:10.297665 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:10.298202 (+ 537us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:40:10.298214 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:40:10.298710 (+ 496us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:40:10.300452 (+ 1742us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:10.300459 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:10.300464 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:10.300752 (+ 288us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:10.301115 (+ 363us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:10.301122 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:10.301126 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:10.301288 (+ 162us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:10.301678 (+ 390us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:40:10.301684 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:40:10.301809 (+ 125us) client_negotiation.cc:769] Sending connection context
0808 04:40:10.301956 (+ 147us) client_negotiation.cc:240] Negotiation successful
0808 04:40:10.302141 (+ 185us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":181,"mutex_wait_us":2,"thread_start_us":103,"threads_started":1}
WARNING: no policy specified for kudu/127.20.240.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.240.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.240.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.194.keytab.
Entry for principal kudu/127.20.240.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.194.keytab.
I20260808 04:40:10.325502 21443 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
/tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786164000593138-21443-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786164000593138-21443-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786164000593138-21443-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786164000593138-21443-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.240.194:0
--local_ip_for_outbound_sockets=127.20.240.194
--webserver_interface=127.20.240.194
--webserver_port=0
--tserver_master_addrs=127.20.240.254:36383
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.194.keytab
--principal=kudu/127.20.240.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.240.212:38159
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786164000593138-21443-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786164000593138-21443-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786164000593138-21443-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 04:40:10.440121 23487 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:40:10.440407 23487 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:40:10.440455 23487 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:40:10.444729 23487 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:40:10.444792 23487 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:40:10.444875 23487 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260808 04:40:10.444926 23487 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260808 04:40:10.445024 23487 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.240.194
I20260808 04:40:10.450645 23487 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.240.212:38159
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786164000593138-21443-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786164000593138-21443-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.194.keytab
--principal=kudu/127.20.240.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.240.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786164000593138-21443-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.240.194
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.20.240.254:36383
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23487
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.240.194
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786164000593138-21443-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 04:05:18 UTC on ccycloud.quasar-drfdgt.root.comops.site
build id 4574101
I20260808 04:40:10.451748 23487 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:40:10.452782 23487 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:40:10.462411 23492 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:40:10.462607 23487 server_base.cc:1034] running on GCE node
W20260808 04:40:10.462455 23495 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:40:10.462411 23493 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:40:10.463203 23487 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:40:10.463920 23487 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:40:10.465086 23487 hybrid_clock.cc:648] HybridClock initialized: now 1786164010465042 us; error 52 us; skew 500 ppm
Aug 08 04:40:10 dist-test-slave-vxj2 krb5kdc[23218](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164010, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.240.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:40:10.467896 23487 init.cc:377] Logged in from keytab as kudu/127.20.240.194@KRBTEST.COM (short username kudu)
I20260808 04:40:10.468739 23487 webserver.cc:460] Webserver started at http://127.20.240.194:40795/ using document root <none> and password file <none>
I20260808 04:40:10.469331 23487 fs_manager.cc:359] Metadata directory not provided
I20260808 04:40:10.469405 23487 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:40:10.469570 23487 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 04:40:10.471670 23487 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786164000593138-21443-0/minicluster-data/ts-1/data/instance:
uuid: "9a10e81aa6db43e6b4cf0cdac04b5166"
format_stamp: "Formatted at 2026-08-08 04:40:10 on dist-test-slave-vxj2"
server_key: "8191dbd068a3db86e2a40d26927740ed"
server_key_iv: "f9fb03da2af5db33c9e7e721261807cd"
server_key_version: "encryptionkey@0"
I20260808 04:40:10.472225 23487 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786164000593138-21443-0/minicluster-data/ts-1/wal/instance:
uuid: "9a10e81aa6db43e6b4cf0cdac04b5166"
format_stamp: "Formatted at 2026-08-08 04:40:10 on dist-test-slave-vxj2"
server_key: "8191dbd068a3db86e2a40d26927740ed"
server_key_iv: "f9fb03da2af5db33c9e7e721261807cd"
server_key_version: "encryptionkey@0"
I20260808 04:40:10.476135 23487 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.004s
I20260808 04:40:10.479017 23502 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:10.480486 23487 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260808 04:40:10.480612 23487 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786164000593138-21443-0/minicluster-data/ts-1/data,/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786164000593138-21443-0/minicluster-data/ts-1/wal
uuid: "9a10e81aa6db43e6b4cf0cdac04b5166"
format_stamp: "Formatted at 2026-08-08 04:40:10 on dist-test-slave-vxj2"
server_key: "8191dbd068a3db86e2a40d26927740ed"
server_key_iv: "f9fb03da2af5db33c9e7e721261807cd"
server_key_version: "encryptionkey@0"
I20260808 04:40:10.480721 23487 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786164000593138-21443-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786164000593138-21443-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786164000593138-21443-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:40:10.493490 23487 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:40:10.496393 23487 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:40:10.496604 23487 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:40:10.498229 23487 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 04:40:10.498286 23487 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:10.498327 23487 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 04:40:10.498386 23487 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 08 04:40:10 dist-test-slave-vxj2 krb5kdc[23218](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164010, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.240.194@KRBTEST.COM for kudu/127.20.240.254@KRBTEST.COM
I20260808 04:40:10.510936 23487 rpc_server.cc:307] RPC server started. Bound to: 127.20.240.194:40955
I20260808 04:40:10.510957 23622 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.240.194:40955 every 8 connection(s)
I20260808 04:40:10.512050 23487 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786164000593138-21443-0/minicluster-data/ts-1/data/info.pb
I20260808 04:40:10.512483 21443 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu as pid 23487
I20260808 04:40:10.512607 21443 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786164000593138-21443-0/minicluster-data/ts-1/wal/instance
I20260808 04:40:10.512943 21443 external_mini_cluster.cc:1428] Setting key abbbf1fa4289f1acc88e270cb85d6ac7
I20260808 04:40:10.514211 23317 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:10.499020 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.240.194:40291 (local address 127.20.240.254:36383)
0808 04:40:10.499206 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:10.499212 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:10.500091 (+ 879us) server_negotiation.cc:407] Connection header received
0808 04:40:10.501391 (+ 1300us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:10.501396 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:10.501464 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:10.501582 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:10.502919 (+ 1337us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:10.503468 (+ 549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:10.504717 (+ 1249us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:10.504951 (+ 234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:10.505066 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:10.509570 (+ 4504us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:40:10.509577 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:40:10.509580 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:40:10.509618 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:40:10.511357 (+ 1739us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:10.512029 (+ 672us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:10.512032 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:10.512034 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:10.512148 (+ 114us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:10.512614 (+ 466us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:10.512617 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:10.512619 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:10.512911 (+ 292us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:40:10.513052 (+ 141us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:10.513890 (+ 838us) server_negotiation.cc:299] Negotiation successful
0808 04:40:10.514036 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260808 04:40:10.515260 23511 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:10.499410 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:36383 (local address 127.20.240.194:40291)
0808 04:40:10.499904 (+ 494us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:10.499965 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:10.501097 (+ 1132us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:10.501764 (+ 667us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:10.501771 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:10.502264 (+ 493us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:40:10.502755 (+ 491us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:10.502770 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:10.503607 (+ 837us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:10.503610 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:10.504584 (+ 974us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:10.504594 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:10.505115 (+ 521us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:10.505119 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:10.505356 (+ 237us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:10.506010 (+ 654us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:40:10.506035 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:40:10.509338 (+ 3303us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:40:10.511518 (+ 2180us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:10.511524 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:10.511538 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:10.511912 (+ 374us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:10.512287 (+ 375us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:10.512290 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:10.512292 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:10.512480 (+ 188us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:10.513067 (+ 587us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:40:10.513076 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:40:10.513580 (+ 504us) client_negotiation.cc:769] Sending connection context
0808 04:40:10.513840 (+ 260us) client_negotiation.cc:240] Negotiation successful
0808 04:40:10.514177 (+ 337us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":263,"thread_start_us":108,"threads_started":1}
I20260808 04:40:10.517107 23623 heartbeater.cc:347] Connected to a master server at 127.20.240.254:36383
I20260808 04:40:10.517331 23623 heartbeater.cc:464] Registering TS with master...
I20260808 04:40:10.517997 23623 heartbeater.cc:511] Master 127.20.240.254:36383 requested a full tablet report, sending...
I20260808 04:40:10.519143 23265 ts_manager.cc:194] Registered new tserver with Master: 9a10e81aa6db43e6b4cf0cdac04b5166 (127.20.240.194:40955)
I20260808 04:40:10.519979 23265 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.240.194@KRBTEST.COM'} at 127.20.240.194:40291
WARNING: no policy specified for kudu/127.20.240.195@KRBTEST.COM; defaulting to no policy
I20260808 04:40:10.527661 23630 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:10.518965 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:36383 (local address 127.20.240.194:49235)
0808 04:40:10.519312 (+ 347us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:10.519329 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:10.519428 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:10.519661 (+ 233us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:10.519665 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:10.519925 (+ 260us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:40:10.520087 (+ 162us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:10.520098 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:10.520966 (+ 868us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:10.520973 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:10.522170 (+ 1197us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:10.522183 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:10.522649 (+ 466us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:10.522656 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:10.522772 (+ 116us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:10.523301 (+ 529us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:40:10.523318 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:40:10.523793 (+ 475us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:40:10.525780 (+ 1987us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:10.525784 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:10.525786 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:10.525984 (+ 198us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:10.526350 (+ 366us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:10.526353 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:10.526357 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:10.526462 (+ 105us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:10.527019 (+ 557us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:40:10.527021 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:40:10.527101 (+ 80us) client_negotiation.cc:769] Sending connection context
0808 04:40:10.527194 (+ 93us) client_negotiation.cc:240] Negotiation successful
0808 04:40:10.527311 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":220,"mutex_wait_us":61,"thread_start_us":100,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.240.195@KRBTEST.COM" created.
I20260808 04:40:10.527688 23317 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:10.519022 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.240.194:49235 (local address 127.20.240.254:36383)
0808 04:40:10.519144 (+ 122us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:10.519149 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:10.519394 (+ 245us) server_negotiation.cc:407] Connection header received
0808 04:40:10.519514 (+ 120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:10.519516 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:10.519553 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:10.519617 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:10.520200 (+ 583us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:10.520814 (+ 614us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:10.522305 (+ 1491us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:10.522524 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:10.522606 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:10.523939 (+ 1333us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:40:10.523941 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:40:10.523944 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:40:10.523965 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:40:10.525673 (+ 1708us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:10.526083 (+ 410us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:10.526086 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:10.526087 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:10.526232 (+ 145us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:10.526575 (+ 343us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:10.526578 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:10.526579 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:10.526905 (+ 326us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:40:10.526989 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:10.527298 (+ 309us) server_negotiation.cc:299] Negotiation successful
0808 04:40:10.527475 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":3,"server-negotiator.queue_time_us":46}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.240.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.195.keytab.
Entry for principal kudu/127.20.240.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.195.keytab.
I20260808 04:40:10.544665 21443 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
/tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786164000593138-21443-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786164000593138-21443-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786164000593138-21443-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786164000593138-21443-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.240.195:0
--local_ip_for_outbound_sockets=127.20.240.195
--webserver_interface=127.20.240.195
--webserver_port=0
--tserver_master_addrs=127.20.240.254:36383
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.195.keytab
--principal=kudu/127.20.240.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.240.212:38159
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786164000593138-21443-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786164000593138-21443-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786164000593138-21443-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 04:40:10.660811 23632 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:40:10.661073 23632 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:40:10.661123 23632 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:40:10.665481 23632 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:40:10.665541 23632 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:40:10.665611 23632 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260808 04:40:10.665647 23632 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260808 04:40:10.665714 23632 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.240.195
I20260808 04:40:10.671141 23632 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.240.212:38159
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786164000593138-21443-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786164000593138-21443-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.195.keytab
--principal=kudu/127.20.240.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.240.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786164000593138-21443-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.240.195
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.20.240.254:36383
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23632
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.240.195
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786164000593138-21443-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 04:05:18 UTC on ccycloud.quasar-drfdgt.root.comops.site
build id 4574101
I20260808 04:40:10.672282 23632 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:40:10.673404 23632 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:40:10.683595 23637 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:40:10.683598 23640 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:40:10.683640 23632 server_base.cc:1034] running on GCE node
W20260808 04:40:10.683600 23638 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:40:10.684288 23632 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:40:10.685037 23632 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:40:10.686229 23632 hybrid_clock.cc:648] HybridClock initialized: now 1786164010686194 us; error 47 us; skew 500 ppm
Aug 08 04:40:10 dist-test-slave-vxj2 krb5kdc[23218](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164010, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.240.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:40:10.689332 23632 init.cc:377] Logged in from keytab as kudu/127.20.240.195@KRBTEST.COM (short username kudu)
I20260808 04:40:10.690451 23632 webserver.cc:460] Webserver started at http://127.20.240.195:33183/ using document root <none> and password file <none>
I20260808 04:40:10.691048 23632 fs_manager.cc:359] Metadata directory not provided
I20260808 04:40:10.691144 23632 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:40:10.691385 23632 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 04:40:10.693881 23632 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786164000593138-21443-0/minicluster-data/ts-2/data/instance:
uuid: "7e50b4a48b5649a6ae754f453671aafc"
format_stamp: "Formatted at 2026-08-08 04:40:10 on dist-test-slave-vxj2"
server_key: "c633ea26d98a98afb522ee7e0e502741"
server_key_iv: "6e0a13d0e2c4bb336df188bddee850f2"
server_key_version: "encryptionkey@0"
I20260808 04:40:10.694499 23632 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786164000593138-21443-0/minicluster-data/ts-2/wal/instance:
uuid: "7e50b4a48b5649a6ae754f453671aafc"
format_stamp: "Formatted at 2026-08-08 04:40:10 on dist-test-slave-vxj2"
server_key: "c633ea26d98a98afb522ee7e0e502741"
server_key_iv: "6e0a13d0e2c4bb336df188bddee850f2"
server_key_version: "encryptionkey@0"
I20260808 04:40:10.698477 23632 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260808 04:40:10.700913 23647 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:10.702302 23632 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 04:40:10.702435 23632 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786164000593138-21443-0/minicluster-data/ts-2/data,/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786164000593138-21443-0/minicluster-data/ts-2/wal
uuid: "7e50b4a48b5649a6ae754f453671aafc"
format_stamp: "Formatted at 2026-08-08 04:40:10 on dist-test-slave-vxj2"
server_key: "c633ea26d98a98afb522ee7e0e502741"
server_key_iv: "6e0a13d0e2c4bb336df188bddee850f2"
server_key_version: "encryptionkey@0"
I20260808 04:40:10.702553 23632 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786164000593138-21443-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786164000593138-21443-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786164000593138-21443-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:40:10.722507 23632 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:40:10.726011 23632 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:40:10.726248 23632 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:40:10.727941 23632 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 04:40:10.728029 23632 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:10.728120 23632 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 04:40:10.728152 23632 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 08 04:40:10 dist-test-slave-vxj2 krb5kdc[23218](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164010, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.240.195@KRBTEST.COM for kudu/127.20.240.254@KRBTEST.COM
I20260808 04:40:10.739487 23632 rpc_server.cc:307] RPC server started. Bound to: 127.20.240.195:38143
I20260808 04:40:10.740399 23632 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786164000593138-21443-0/minicluster-data/ts-2/data/info.pb
I20260808 04:40:10.741189 23766 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.240.195:38143 every 8 connection(s)
I20260808 04:40:10.741775 21443 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu as pid 23632
I20260808 04:40:10.741914 21443 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786164000593138-21443-0/minicluster-data/ts-2/wal/instance
I20260808 04:40:10.742192 21443 external_mini_cluster.cc:1428] Setting key ec19c00cf3a0b2859f08c454247a0d6b
I20260808 04:40:10.742667 23317 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:10.728843 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.240.195:51005 (local address 127.20.240.254:36383)
0808 04:40:10.729005 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:10.729010 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:10.730034 (+ 1024us) server_negotiation.cc:407] Connection header received
0808 04:40:10.731366 (+ 1332us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:10.731387 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:10.731453 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:10.731563 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:10.733313 (+ 1750us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:10.733898 (+ 585us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:10.735094 (+ 1196us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:10.735511 (+ 417us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:10.735656 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:10.738820 (+ 3164us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:40:10.738823 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:40:10.738825 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:40:10.738852 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:40:10.740488 (+ 1636us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:10.741054 (+ 566us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:10.741058 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:10.741060 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:10.741184 (+ 124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:10.741550 (+ 366us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:10.741553 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:10.741555 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:10.741752 (+ 197us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:40:10.741862 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:10.742364 (+ 502us) server_negotiation.cc:299] Negotiation successful
0808 04:40:10.742495 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260808 04:40:10.743518 23656 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:10.729336 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:36383 (local address 127.20.240.195:51005)
0808 04:40:10.729847 (+ 511us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:10.729910 (+ 63us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:10.731115 (+ 1205us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:10.731759 (+ 644us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:10.731771 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:10.732280 (+ 509us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:40:10.733097 (+ 817us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:10.733123 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:10.734016 (+ 893us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:10.734020 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:10.734954 (+ 934us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:10.734966 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:10.735733 (+ 767us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:10.735738 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:10.735972 (+ 234us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:10.736621 (+ 649us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:40:10.736637 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:40:10.738639 (+ 2002us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:40:10.740591 (+ 1952us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:10.740597 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:10.740612 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:10.740931 (+ 319us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:10.741293 (+ 362us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:10.741296 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:10.741298 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:10.741439 (+ 141us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:10.741870 (+ 431us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:40:10.741878 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:40:10.742112 (+ 234us) client_negotiation.cc:769] Sending connection context
0808 04:40:10.742295 (+ 183us) client_negotiation.cc:240] Negotiation successful
0808 04:40:10.742617 (+ 322us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":273,"thread_start_us":109,"threads_started":1}
I20260808 04:40:10.744881 23767 heartbeater.cc:347] Connected to a master server at 127.20.240.254:36383
I20260808 04:40:10.745041 23767 heartbeater.cc:464] Registering TS with master...
I20260808 04:40:10.745639 23767 heartbeater.cc:511] Master 127.20.240.254:36383 requested a full tablet report, sending...
I20260808 04:40:10.746608 23265 ts_manager.cc:194] Registered new tserver with Master: 7e50b4a48b5649a6ae754f453671aafc (127.20.240.195:38143)
I20260808 04:40:10.747344 23265 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.240.195@KRBTEST.COM'} at 127.20.240.195:51005
I20260808 04:40:10.754104 23317 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:10.746861 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.240.195:43851 (local address 127.20.240.254:36383)
0808 04:40:10.746979 (+ 118us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:10.746982 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:10.747220 (+ 238us) server_negotiation.cc:407] Connection header received
0808 04:40:10.747354 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:10.747357 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:10.747404 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:10.747482 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:10.748089 (+ 607us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:10.748591 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:10.749501 (+ 910us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:10.749744 (+ 243us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:10.749862 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:10.750926 (+ 1064us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:40:10.750930 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:40:10.750932 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:40:10.750957 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:40:10.752252 (+ 1295us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:10.752736 (+ 484us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:10.752740 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:10.752742 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:10.752846 (+ 104us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:10.753214 (+ 368us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:10.753218 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:10.753220 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:10.753411 (+ 191us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:40:10.753533 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:10.753827 (+ 294us) server_negotiation.cc:299] Negotiation successful
0808 04:40:10.753944 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260808 04:40:10.754120 23773 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:10.746875 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:36383 (local address 127.20.240.195:43851)
0808 04:40:10.747138 (+ 263us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:10.747149 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:10.747260 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:10.747496 (+ 236us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:10.747498 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:10.747837 (+ 339us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:40:10.747968 (+ 131us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:10.747982 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:10.748713 (+ 731us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:10.748717 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:10.749360 (+ 643us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:10.749369 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:10.749858 (+ 489us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:10.749862 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:10.749957 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:10.750472 (+ 515us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:40:10.750492 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:40:10.750784 (+ 292us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:40:10.752397 (+ 1613us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:10.752401 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:10.752403 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:10.752617 (+ 214us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:10.752958 (+ 341us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:10.752961 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:10.752963 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:10.753065 (+ 102us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:10.753521 (+ 456us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:40:10.753525 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:40:10.753632 (+ 107us) client_negotiation.cc:769] Sending connection context
0808 04:40:10.753754 (+ 122us) client_negotiation.cc:240] Negotiation successful
0808 04:40:10.753912 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":197,"thread_start_us":98,"threads_started":1}
I20260808 04:40:10.756541 21443 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 08 04:40:10 dist-test-slave-vxj2 krb5kdc[23218](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164010, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 08 04:40:10 dist-test-slave-vxj2 krb5kdc[23218](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164010, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.240.254@KRBTEST.COM
I20260808 04:40:10.783344 23317 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:10.774775 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35024 (local address 127.20.240.254:36383)
0808 04:40:10.774948 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:10.774952 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:10.774966 (+ 14us) server_negotiation.cc:407] Connection header received
0808 04:40:10.775009 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:10.775011 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:10.775050 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:10.775120 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:10.775891 (+ 771us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:10.776408 (+ 517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:10.777291 (+ 883us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:10.777502 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:10.777580 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:10.780241 (+ 2661us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:40:10.780244 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:40:10.780246 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:40:10.780270 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:40:10.781669 (+ 1399us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:10.782117 (+ 448us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:10.782120 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:10.782121 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:10.782197 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:10.782481 (+ 284us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:10.782484 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:10.782485 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:10.782682 (+ 197us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:40:10.782802 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:10.782998 (+ 196us) server_negotiation.cc:299] Negotiation successful
0808 04:40:10.783101 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260808 04:40:10.786798 23265 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35024:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 04:40:10.790066 23265 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 04:40:10.803974 23787 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:10.798837 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54070 (local address 127.20.240.195:38143)
0808 04:40:10.799158 (+ 321us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:10.799168 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:10.799190 (+ 22us) server_negotiation.cc:407] Connection header received
0808 04:40:10.799393 (+ 203us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:10.799399 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:10.799614 (+ 215us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:10.799772 (+ 158us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 04:40:10.800280 (+ 508us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:10.801275 (+ 995us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:10.802543 (+ 1268us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:10.803288 (+ 745us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:10.803446 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:10.803588 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:10.803716 (+ 128us) server_negotiation.cc:299] Negotiation successful
0808 04:40:10.803813 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":215,"thread_start_us":132,"threads_started":1}
I20260808 04:40:10.803962 23786 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:10.798678 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.195:38143 (local address 127.0.0.1:54070)
0808 04:40:10.799029 (+ 351us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:10.799075 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:10.799200 (+ 125us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:10.799953 (+ 753us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:10.799960 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:10.799984 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 04:40:10.800135 (+ 151us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:10.800143 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:10.801381 (+ 1238us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:10.801387 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:10.802411 (+ 1024us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:10.802420 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:10.803417 (+ 997us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:10.803421 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:10.803531 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:10.803566 (+ 35us) client_negotiation.cc:769] Sending connection context
0808 04:40:10.803684 (+ 118us) client_negotiation.cc:240] Negotiation successful
0808 04:40:10.803807 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":187,"thread_start_us":109,"threads_started":1}
I20260808 04:40:10.805104 23790 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:10.799415 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.193:36077 (local address 127.0.0.1:33868)
0808 04:40:10.800032 (+ 617us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:10.800046 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:10.800136 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:10.800915 (+ 779us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:10.800918 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:10.800936 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 04:40:10.801065 (+ 129us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:10.801071 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:10.802530 (+ 1459us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:10.802533 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:10.803646 (+ 1113us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:10.803652 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:10.804692 (+ 1040us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:10.804695 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:10.804783 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:10.804805 (+ 22us) client_negotiation.cc:769] Sending connection context
0808 04:40:10.804913 (+ 108us) client_negotiation.cc:240] Negotiation successful
0808 04:40:10.804977 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":550,"thread_start_us":92,"threads_started":1}
I20260808 04:40:10.805227 23789 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:10.799575 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33868 (local address 127.20.240.193:36077)
0808 04:40:10.800523 (+ 948us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:10.800529 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:10.800547 (+ 18us) server_negotiation.cc:407] Connection header received
0808 04:40:10.800611 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:10.800615 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:10.800761 (+ 146us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:10.801243 (+ 482us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 04:40:10.801375 (+ 132us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:10.802414 (+ 1039us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:10.803786 (+ 1372us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:10.804583 (+ 797us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:10.804710 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:10.804827 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:10.804959 (+ 132us) server_negotiation.cc:299] Negotiation successful
0808 04:40:10.805048 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":850,"thread_start_us":89,"threads_started":1}
I20260808 04:40:10.807742 23408 tablet_service.cc:1467] Processing CreateTablet for tablet 2bb97e28cb4f45cc8b81986741725ee1 (DEFAULT_TABLE table=test-table [id=092795b405bb4970a1d83480f405b365]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 04:40:10.807749 23698 tablet_service.cc:1467] Processing CreateTablet for tablet 2bb97e28cb4f45cc8b81986741725ee1 (DEFAULT_TABLE table=test-table [id=092795b405bb4970a1d83480f405b365]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 04:40:10.808912 23408 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2bb97e28cb4f45cc8b81986741725ee1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:40:10.808917 23698 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2bb97e28cb4f45cc8b81986741725ee1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:40:10.813299 23791 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:10.800107 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48970 (local address 127.20.240.194:40955)
0808 04:40:10.800419 (+ 312us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:10.800431 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:10.800454 (+ 23us) server_negotiation.cc:407] Connection header received
0808 04:40:10.800525 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:10.800530 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:10.800702 (+ 172us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:10.800854 (+ 152us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 04:40:10.801075 (+ 221us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:10.802222 (+ 1147us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:10.803771 (+ 1549us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:10.804583 (+ 812us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:10.804723 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:10.804827 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:10.805235 (+ 408us) server_negotiation.cc:299] Negotiation successful
0808 04:40:10.805339 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":209,"thread_start_us":102,"threads_started":1}
I20260808 04:40:10.813757 23788 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:10.799744 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.194:40955 (local address 127.0.0.1:48970)
0808 04:40:10.800216 (+ 472us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:10.800231 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:10.800316 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:10.800853 (+ 537us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:10.800856 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:10.800874 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 04:40:10.800956 (+ 82us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:10.800961 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:10.802351 (+ 1390us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:10.802354 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:10.803622 (+ 1268us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:10.803633 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:10.804924 (+ 1291us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:10.804928 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:10.805018 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:10.805041 (+ 23us) client_negotiation.cc:769] Sending connection context
0808 04:40:10.805114 (+ 73us) client_negotiation.cc:240] Negotiation successful
0808 04:40:10.813601 (+ 8487us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":393,"thread_start_us":83,"threads_started":1}
I20260808 04:40:10.816756 23792 tablet_bootstrap.cc:492] T 2bb97e28cb4f45cc8b81986741725ee1 P 27da82a1c2d3446f95f7ecd5d9405358: Bootstrap starting.
I20260808 04:40:10.816708 23555 tablet_service.cc:1467] Processing CreateTablet for tablet 2bb97e28cb4f45cc8b81986741725ee1 (DEFAULT_TABLE table=test-table [id=092795b405bb4970a1d83480f405b365]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 04:40:10.817993 23555 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2bb97e28cb4f45cc8b81986741725ee1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:40:10.818070 23793 tablet_bootstrap.cc:492] T 2bb97e28cb4f45cc8b81986741725ee1 P 7e50b4a48b5649a6ae754f453671aafc: Bootstrap starting.
I20260808 04:40:10.819196 23792 tablet_bootstrap.cc:654] T 2bb97e28cb4f45cc8b81986741725ee1 P 27da82a1c2d3446f95f7ecd5d9405358: Neither blocks nor log segments found. Creating new log.
I20260808 04:40:10.819794 23793 tablet_bootstrap.cc:654] T 2bb97e28cb4f45cc8b81986741725ee1 P 7e50b4a48b5649a6ae754f453671aafc: Neither blocks nor log segments found. Creating new log.
I20260808 04:40:10.820084 23792 log.cc:824] T 2bb97e28cb4f45cc8b81986741725ee1 P 27da82a1c2d3446f95f7ecd5d9405358: Log is configured to *not* fsync() on all Append() calls
I20260808 04:40:10.820575 23793 log.cc:824] T 2bb97e28cb4f45cc8b81986741725ee1 P 7e50b4a48b5649a6ae754f453671aafc: Log is configured to *not* fsync() on all Append() calls
I20260808 04:40:10.822331 23792 tablet_bootstrap.cc:492] T 2bb97e28cb4f45cc8b81986741725ee1 P 27da82a1c2d3446f95f7ecd5d9405358: No bootstrap required, opened a new log
I20260808 04:40:10.822412 23793 tablet_bootstrap.cc:492] T 2bb97e28cb4f45cc8b81986741725ee1 P 7e50b4a48b5649a6ae754f453671aafc: No bootstrap required, opened a new log
I20260808 04:40:10.822557 23793 ts_tablet_manager.cc:1397] T 2bb97e28cb4f45cc8b81986741725ee1 P 7e50b4a48b5649a6ae754f453671aafc: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260808 04:40:10.822552 23792 ts_tablet_manager.cc:1397] T 2bb97e28cb4f45cc8b81986741725ee1 P 27da82a1c2d3446f95f7ecd5d9405358: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260808 04:40:10.825528 23796 tablet_bootstrap.cc:492] T 2bb97e28cb4f45cc8b81986741725ee1 P 9a10e81aa6db43e6b4cf0cdac04b5166: Bootstrap starting.
I20260808 04:40:10.826855 23793 raft_consensus.cc:348] T 2bb97e28cb4f45cc8b81986741725ee1 P 7e50b4a48b5649a6ae754f453671aafc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e50b4a48b5649a6ae754f453671aafc" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 38143 } } peers { permanent_uuid: "27da82a1c2d3446f95f7ecd5d9405358" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 36077 } } peers { permanent_uuid: "9a10e81aa6db43e6b4cf0cdac04b5166" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 40955 } }
I20260808 04:40:10.827155 23793 raft_consensus.cc:374] T 2bb97e28cb4f45cc8b81986741725ee1 P 7e50b4a48b5649a6ae754f453671aafc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:40:10.827208 23793 raft_consensus.cc:729] T 2bb97e28cb4f45cc8b81986741725ee1 P 7e50b4a48b5649a6ae754f453671aafc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e50b4a48b5649a6ae754f453671aafc, State: Initialized, Role: FOLLOWER
I20260808 04:40:10.827306 23792 raft_consensus.cc:348] T 2bb97e28cb4f45cc8b81986741725ee1 P 27da82a1c2d3446f95f7ecd5d9405358 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e50b4a48b5649a6ae754f453671aafc" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 38143 } } peers { permanent_uuid: "27da82a1c2d3446f95f7ecd5d9405358" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 36077 } } peers { permanent_uuid: "9a10e81aa6db43e6b4cf0cdac04b5166" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 40955 } }
I20260808 04:40:10.827582 23792 raft_consensus.cc:374] T 2bb97e28cb4f45cc8b81986741725ee1 P 27da82a1c2d3446f95f7ecd5d9405358 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:40:10.827658 23792 raft_consensus.cc:729] T 2bb97e28cb4f45cc8b81986741725ee1 P 27da82a1c2d3446f95f7ecd5d9405358 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 27da82a1c2d3446f95f7ecd5d9405358, State: Initialized, Role: FOLLOWER
I20260808 04:40:10.827682 23793 consensus_queue.cc:260] T 2bb97e28cb4f45cc8b81986741725ee1 P 7e50b4a48b5649a6ae754f453671aafc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e50b4a48b5649a6ae754f453671aafc" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 38143 } } peers { permanent_uuid: "27da82a1c2d3446f95f7ecd5d9405358" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 36077 } } peers { permanent_uuid: "9a10e81aa6db43e6b4cf0cdac04b5166" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 40955 } }
I20260808 04:40:10.828074 23792 consensus_queue.cc:260] T 2bb97e28cb4f45cc8b81986741725ee1 P 27da82a1c2d3446f95f7ecd5d9405358 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e50b4a48b5649a6ae754f453671aafc" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 38143 } } peers { permanent_uuid: "27da82a1c2d3446f95f7ecd5d9405358" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 36077 } } peers { permanent_uuid: "9a10e81aa6db43e6b4cf0cdac04b5166" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 40955 } }
I20260808 04:40:10.828493 23767 heartbeater.cc:503] Master 127.20.240.254:36383 was elected leader, sending a full tablet report...
I20260808 04:40:10.828779 23793 ts_tablet_manager.cc:1428] T 2bb97e28cb4f45cc8b81986741725ee1 P 7e50b4a48b5649a6ae754f453671aafc: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260808 04:40:10.829052 23792 ts_tablet_manager.cc:1428] T 2bb97e28cb4f45cc8b81986741725ee1 P 27da82a1c2d3446f95f7ecd5d9405358: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20260808 04:40:10.829079 23796 tablet_bootstrap.cc:654] T 2bb97e28cb4f45cc8b81986741725ee1 P 9a10e81aa6db43e6b4cf0cdac04b5166: Neither blocks nor log segments found. Creating new log.
I20260808 04:40:10.829419 23478 heartbeater.cc:503] Master 127.20.240.254:36383 was elected leader, sending a full tablet report...
I20260808 04:40:10.830046 23796 log.cc:824] T 2bb97e28cb4f45cc8b81986741725ee1 P 9a10e81aa6db43e6b4cf0cdac04b5166: Log is configured to *not* fsync() on all Append() calls
I20260808 04:40:10.832391 23796 tablet_bootstrap.cc:492] T 2bb97e28cb4f45cc8b81986741725ee1 P 9a10e81aa6db43e6b4cf0cdac04b5166: No bootstrap required, opened a new log
I20260808 04:40:10.832623 23796 ts_tablet_manager.cc:1397] T 2bb97e28cb4f45cc8b81986741725ee1 P 9a10e81aa6db43e6b4cf0cdac04b5166: Time spent bootstrapping tablet: real 0.007s user 0.004s sys 0.000s
I20260808 04:40:10.835769 23796 raft_consensus.cc:348] T 2bb97e28cb4f45cc8b81986741725ee1 P 9a10e81aa6db43e6b4cf0cdac04b5166 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e50b4a48b5649a6ae754f453671aafc" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 38143 } } peers { permanent_uuid: "27da82a1c2d3446f95f7ecd5d9405358" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 36077 } } peers { permanent_uuid: "9a10e81aa6db43e6b4cf0cdac04b5166" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 40955 } }
I20260808 04:40:10.836019 23796 raft_consensus.cc:374] T 2bb97e28cb4f45cc8b81986741725ee1 P 9a10e81aa6db43e6b4cf0cdac04b5166 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:40:10.836077 23796 raft_consensus.cc:729] T 2bb97e28cb4f45cc8b81986741725ee1 P 9a10e81aa6db43e6b4cf0cdac04b5166 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a10e81aa6db43e6b4cf0cdac04b5166, State: Initialized, Role: FOLLOWER
I20260808 04:40:10.836537 23796 consensus_queue.cc:260] T 2bb97e28cb4f45cc8b81986741725ee1 P 9a10e81aa6db43e6b4cf0cdac04b5166 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e50b4a48b5649a6ae754f453671aafc" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 38143 } } peers { permanent_uuid: "27da82a1c2d3446f95f7ecd5d9405358" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 36077 } } peers { permanent_uuid: "9a10e81aa6db43e6b4cf0cdac04b5166" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 40955 } }
I20260808 04:40:10.837252 23623 heartbeater.cc:503] Master 127.20.240.254:36383 was elected leader, sending a full tablet report...
I20260808 04:40:10.837617 23796 ts_tablet_manager.cc:1428] T 2bb97e28cb4f45cc8b81986741725ee1 P 9a10e81aa6db43e6b4cf0cdac04b5166: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20260808 04:40:10.894562 23798 raft_consensus.cc:482] T 2bb97e28cb4f45cc8b81986741725ee1 P 27da82a1c2d3446f95f7ecd5d9405358 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 04:40:10.894799 23798 raft_consensus.cc:504] T 2bb97e28cb4f45cc8b81986741725ee1 P 27da82a1c2d3446f95f7ecd5d9405358 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e50b4a48b5649a6ae754f453671aafc" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 38143 } } peers { permanent_uuid: "27da82a1c2d3446f95f7ecd5d9405358" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 36077 } } peers { permanent_uuid: "9a10e81aa6db43e6b4cf0cdac04b5166" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 40955 } }
I20260808 04:40:10.896149 23798 leader_election.cc:288] T 2bb97e28cb4f45cc8b81986741725ee1 P 27da82a1c2d3446f95f7ecd5d9405358 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e50b4a48b5649a6ae754f453671aafc (127.20.240.195:38143), 9a10e81aa6db43e6b4cf0cdac04b5166 (127.20.240.194:40955)
I20260808 04:40:10.900533 23791 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:10.896978 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.240.193:57717 (local address 127.20.240.194:40955)
0808 04:40:10.897104 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:10.897109 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:10.897350 (+ 241us) server_negotiation.cc:407] Connection header received
0808 04:40:10.897441 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:10.897444 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:10.897491 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:10.897569 (+ 78us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 04:40:10.897912 (+ 343us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:10.898459 (+ 547us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:10.899507 (+ 1048us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:10.899929 (+ 422us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:10.900052 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:10.900113 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:10.900308 (+ 195us) server_negotiation.cc:299] Negotiation successful
0808 04:40:10.900397 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260808 04:40:10.900552 23787 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:10.896580 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.240.193:53719 (local address 127.20.240.195:38143)
0808 04:40:10.896735 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:10.896742 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:10.896836 (+ 94us) server_negotiation.cc:407] Connection header received
0808 04:40:10.897076 (+ 240us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:10.897079 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:10.897136 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:10.897218 (+ 82us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 04:40:10.897702 (+ 484us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:10.898305 (+ 603us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:10.899552 (+ 1247us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:10.899947 (+ 395us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:10.900086 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:10.900141 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:10.900363 (+ 222us) server_negotiation.cc:299] Negotiation successful
0808 04:40:10.900445 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260808 04:40:10.900557 23801 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:10.896405 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.195:38143 (local address 127.20.240.193:53719)
0808 04:40:10.896721 (+ 316us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:10.896735 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:10.896937 (+ 202us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:10.897389 (+ 452us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:10.897393 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:10.897416 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 04:40:10.897570 (+ 154us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:10.897577 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:10.898421 (+ 844us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:10.898425 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:10.899390 (+ 965us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:10.899400 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:10.900090 (+ 690us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:10.900093 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:10.900208 (+ 115us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:10.900225 (+ 17us) client_negotiation.cc:769] Sending connection context
0808 04:40:10.900320 (+ 95us) client_negotiation.cc:240] Negotiation successful
0808 04:40:10.900390 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":235,"mutex_wait_us":60,"thread_start_us":120,"threads_started":1}
I20260808 04:40:10.900565 23802 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:10.896825 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.194:40955 (local address 127.20.240.193:57717)
0808 04:40:10.897235 (+ 410us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:10.897249 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:10.897355 (+ 106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:10.897593 (+ 238us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:10.897596 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:10.897615 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 04:40:10.897782 (+ 167us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:10.897789 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:10.898573 (+ 784us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:10.898576 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:10.899377 (+ 801us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:10.899386 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:10.900061 (+ 675us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:10.900065 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:10.900168 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:10.900199 (+ 31us) client_negotiation.cc:769] Sending connection context
0808 04:40:10.900260 (+ 61us) client_negotiation.cc:240] Negotiation successful
0808 04:40:10.900350 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":350,"mutex_wait_us":3,"thread_start_us":95,"threads_started":1}
I20260808 04:40:10.901621 23719 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2bb97e28cb4f45cc8b81986741725ee1" candidate_uuid: "27da82a1c2d3446f95f7ecd5d9405358" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e50b4a48b5649a6ae754f453671aafc" is_pre_election: true
I20260808 04:40:10.901620 23575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2bb97e28cb4f45cc8b81986741725ee1" candidate_uuid: "27da82a1c2d3446f95f7ecd5d9405358" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a10e81aa6db43e6b4cf0cdac04b5166" is_pre_election: true
I20260808 04:40:10.901965 23719 raft_consensus.cc:2454] T 2bb97e28cb4f45cc8b81986741725ee1 P 7e50b4a48b5649a6ae754f453671aafc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27da82a1c2d3446f95f7ecd5d9405358 in term 0.
I20260808 04:40:10.901965 23575 raft_consensus.cc:2454] T 2bb97e28cb4f45cc8b81986741725ee1 P 9a10e81aa6db43e6b4cf0cdac04b5166 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27da82a1c2d3446f95f7ecd5d9405358 in term 0.
I20260808 04:40:10.902468 23360 leader_election.cc:302] T 2bb97e28cb4f45cc8b81986741725ee1 P 27da82a1c2d3446f95f7ecd5d9405358 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27da82a1c2d3446f95f7ecd5d9405358, 7e50b4a48b5649a6ae754f453671aafc; no voters:
I20260808 04:40:10.902741 23798 raft_consensus.cc:2781] T 2bb97e28cb4f45cc8b81986741725ee1 P 27da82a1c2d3446f95f7ecd5d9405358 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 04:40:10.902834 23798 raft_consensus.cc:482] T 2bb97e28cb4f45cc8b81986741725ee1 P 27da82a1c2d3446f95f7ecd5d9405358 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 04:40:10.902886 23798 raft_consensus.cc:3037] T 2bb97e28cb4f45cc8b81986741725ee1 P 27da82a1c2d3446f95f7ecd5d9405358 [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:40:10.903980 23798 raft_consensus.cc:504] T 2bb97e28cb4f45cc8b81986741725ee1 P 27da82a1c2d3446f95f7ecd5d9405358 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e50b4a48b5649a6ae754f453671aafc" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 38143 } } peers { permanent_uuid: "27da82a1c2d3446f95f7ecd5d9405358" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 36077 } } peers { permanent_uuid: "9a10e81aa6db43e6b4cf0cdac04b5166" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 40955 } }
I20260808 04:40:10.904346 23798 leader_election.cc:288] T 2bb97e28cb4f45cc8b81986741725ee1 P 27da82a1c2d3446f95f7ecd5d9405358 [CANDIDATE]: Term 1 election: Requested vote from peers 7e50b4a48b5649a6ae754f453671aafc (127.20.240.195:38143), 9a10e81aa6db43e6b4cf0cdac04b5166 (127.20.240.194:40955)
I20260808 04:40:10.904718 23719 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2bb97e28cb4f45cc8b81986741725ee1" candidate_uuid: "27da82a1c2d3446f95f7ecd5d9405358" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e50b4a48b5649a6ae754f453671aafc"
I20260808 04:40:10.904850 23719 raft_consensus.cc:3037] T 2bb97e28cb4f45cc8b81986741725ee1 P 7e50b4a48b5649a6ae754f453671aafc [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:40:10.904850 23575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2bb97e28cb4f45cc8b81986741725ee1" candidate_uuid: "27da82a1c2d3446f95f7ecd5d9405358" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a10e81aa6db43e6b4cf0cdac04b5166"
I20260808 04:40:10.905040 23575 raft_consensus.cc:3037] T 2bb97e28cb4f45cc8b81986741725ee1 P 9a10e81aa6db43e6b4cf0cdac04b5166 [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:40:10.906067 23719 raft_consensus.cc:2454] T 2bb97e28cb4f45cc8b81986741725ee1 P 7e50b4a48b5649a6ae754f453671aafc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27da82a1c2d3446f95f7ecd5d9405358 in term 1.
I20260808 04:40:10.906318 23575 raft_consensus.cc:2454] T 2bb97e28cb4f45cc8b81986741725ee1 P 9a10e81aa6db43e6b4cf0cdac04b5166 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27da82a1c2d3446f95f7ecd5d9405358 in term 1.
I20260808 04:40:10.906414 23360 leader_election.cc:302] T 2bb97e28cb4f45cc8b81986741725ee1 P 27da82a1c2d3446f95f7ecd5d9405358 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27da82a1c2d3446f95f7ecd5d9405358, 7e50b4a48b5649a6ae754f453671aafc; no voters:
I20260808 04:40:10.906638 23798 raft_consensus.cc:2781] T 2bb97e28cb4f45cc8b81986741725ee1 P 27da82a1c2d3446f95f7ecd5d9405358 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 04:40:10.906906 23798 raft_consensus.cc:686] T 2bb97e28cb4f45cc8b81986741725ee1 P 27da82a1c2d3446f95f7ecd5d9405358 [term 1 LEADER]: Becoming Leader. State: Replica: 27da82a1c2d3446f95f7ecd5d9405358, State: Running, Role: LEADER
I20260808 04:40:10.907277 23798 consensus_queue.cc:237] T 2bb97e28cb4f45cc8b81986741725ee1 P 27da82a1c2d3446f95f7ecd5d9405358 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e50b4a48b5649a6ae754f453671aafc" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 38143 } } peers { permanent_uuid: "27da82a1c2d3446f95f7ecd5d9405358" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 36077 } } peers { permanent_uuid: "9a10e81aa6db43e6b4cf0cdac04b5166" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 40955 } }
I20260808 04:40:10.910773 23263 catalog_manager.cc:5495] T 2bb97e28cb4f45cc8b81986741725ee1 P 27da82a1c2d3446f95f7ecd5d9405358 reported cstate change: term changed from 0 to 1, leader changed from <none> to 27da82a1c2d3446f95f7ecd5d9405358 (127.20.240.193). New cstate: current_term: 1 leader_uuid: "27da82a1c2d3446f95f7ecd5d9405358" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e50b4a48b5649a6ae754f453671aafc" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 38143 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "27da82a1c2d3446f95f7ecd5d9405358" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 36077 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9a10e81aa6db43e6b4cf0cdac04b5166" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 40955 } health_report { overall_health: UNKNOWN } } }
Aug 08 04:40:10 dist-test-slave-vxj2 krb5kdc[23218](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164009, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.240.254@KRBTEST.COM for kudu/127.20.240.254@KRBTEST.COM
I20260808 04:40:10.952008 23317 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:10.943092 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35036 (local address 127.20.240.254:36383)
0808 04:40:10.943264 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:10.943270 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:10.943502 (+ 232us) server_negotiation.cc:407] Connection header received
0808 04:40:10.943665 (+ 163us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:10.943668 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:10.943711 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:10.943798 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:10.944493 (+ 695us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:10.945082 (+ 589us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:10.945932 (+ 850us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:10.946198 (+ 266us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:10.946308 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:10.948790 (+ 2482us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:40:10.948794 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:40:10.948796 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:40:10.948819 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:40:10.950280 (+ 1461us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:10.950742 (+ 462us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:10.950745 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:10.950748 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:10.950832 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:10.951083 (+ 251us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:10.951085 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:10.951086 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:10.951279 (+ 193us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:40:10.951355 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:10.951700 (+ 345us) server_negotiation.cc:299] Negotiation successful
0808 04:40:10.951855 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":43,"server-negotiator.queue_time_us":68}
I20260808 04:40:10.952092 23811 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:10.943062 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:36383 (local address 127.0.0.1:35036)
0808 04:40:10.943405 (+ 343us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:10.943418 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:10.943568 (+ 150us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:10.943815 (+ 247us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:10.943818 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:10.944276 (+ 458us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:40:10.944372 (+ 96us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:10.944379 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:10.945213 (+ 834us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:10.945220 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:10.945769 (+ 549us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:10.945777 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:10.946315 (+ 538us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:10.946318 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:10.946406 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:10.947039 (+ 633us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:40:10.947051 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:40:10.948621 (+ 1570us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:40:10.950397 (+ 1776us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:10.950406 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:10.950412 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:10.950652 (+ 240us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:10.950922 (+ 270us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:10.950925 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:10.950926 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:10.951004 (+ 78us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:10.951404 (+ 400us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:40:10.951410 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:40:10.951527 (+ 117us) client_negotiation.cc:769] Sending connection context
0808 04:40:10.951644 (+ 117us) client_negotiation.cc:240] Negotiation successful
0808 04:40:10.951801 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":265,"thread_start_us":133,"threads_started":1}
I20260808 04:40:10.956296 23263 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.20.240.254@KRBTEST.COM'} at 127.0.0.1:35036:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260808 04:40:10.957020 23263 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 04:40:10.962347 23698 tablet_service.cc:1467] Processing CreateTablet for tablet 98615f3dc2e44a0bb7bda5583a5813b9 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=22716c59469f478e85c514c61e4104da]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260808 04:40:10.962136 23408 tablet_service.cc:1467] Processing CreateTablet for tablet 98615f3dc2e44a0bb7bda5583a5813b9 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=22716c59469f478e85c514c61e4104da]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260808 04:40:10.962242 23555 tablet_service.cc:1467] Processing CreateTablet for tablet 98615f3dc2e44a0bb7bda5583a5813b9 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=22716c59469f478e85c514c61e4104da]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260808 04:40:10.962978 23408 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 98615f3dc2e44a0bb7bda5583a5813b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:40:10.962975 23698 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 98615f3dc2e44a0bb7bda5583a5813b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:40:10.962993 23555 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 98615f3dc2e44a0bb7bda5583a5813b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:40:10.965832 23796 tablet_bootstrap.cc:492] T 98615f3dc2e44a0bb7bda5583a5813b9 P 9a10e81aa6db43e6b4cf0cdac04b5166: Bootstrap starting.
I20260808 04:40:10.966027 23793 tablet_bootstrap.cc:492] T 98615f3dc2e44a0bb7bda5583a5813b9 P 7e50b4a48b5649a6ae754f453671aafc: Bootstrap starting.
I20260808 04:40:10.966286 23792 tablet_bootstrap.cc:492] T 98615f3dc2e44a0bb7bda5583a5813b9 P 27da82a1c2d3446f95f7ecd5d9405358: Bootstrap starting.
I20260808 04:40:10.966948 23796 tablet_bootstrap.cc:654] T 98615f3dc2e44a0bb7bda5583a5813b9 P 9a10e81aa6db43e6b4cf0cdac04b5166: Neither blocks nor log segments found. Creating new log.
I20260808 04:40:10.966949 23793 tablet_bootstrap.cc:654] T 98615f3dc2e44a0bb7bda5583a5813b9 P 7e50b4a48b5649a6ae754f453671aafc: Neither blocks nor log segments found. Creating new log.
I20260808 04:40:10.967149 23792 tablet_bootstrap.cc:654] T 98615f3dc2e44a0bb7bda5583a5813b9 P 27da82a1c2d3446f95f7ecd5d9405358: Neither blocks nor log segments found. Creating new log.
I20260808 04:40:10.968449 23793 tablet_bootstrap.cc:492] T 98615f3dc2e44a0bb7bda5583a5813b9 P 7e50b4a48b5649a6ae754f453671aafc: No bootstrap required, opened a new log
I20260808 04:40:10.968545 23793 ts_tablet_manager.cc:1397] T 98615f3dc2e44a0bb7bda5583a5813b9 P 7e50b4a48b5649a6ae754f453671aafc: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260808 04:40:10.968986 23792 tablet_bootstrap.cc:492] T 98615f3dc2e44a0bb7bda5583a5813b9 P 27da82a1c2d3446f95f7ecd5d9405358: No bootstrap required, opened a new log
I20260808 04:40:10.969028 23796 tablet_bootstrap.cc:492] T 98615f3dc2e44a0bb7bda5583a5813b9 P 9a10e81aa6db43e6b4cf0cdac04b5166: No bootstrap required, opened a new log
I20260808 04:40:10.969069 23792 ts_tablet_manager.cc:1397] T 98615f3dc2e44a0bb7bda5583a5813b9 P 27da82a1c2d3446f95f7ecd5d9405358: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260808 04:40:10.969009 23793 raft_consensus.cc:348] T 98615f3dc2e44a0bb7bda5583a5813b9 P 7e50b4a48b5649a6ae754f453671aafc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27da82a1c2d3446f95f7ecd5d9405358" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 36077 } } peers { permanent_uuid: "9a10e81aa6db43e6b4cf0cdac04b5166" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 40955 } } peers { permanent_uuid: "7e50b4a48b5649a6ae754f453671aafc" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 38143 } }
I20260808 04:40:10.969098 23796 ts_tablet_manager.cc:1397] T 98615f3dc2e44a0bb7bda5583a5813b9 P 9a10e81aa6db43e6b4cf0cdac04b5166: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260808 04:40:10.969113 23793 raft_consensus.cc:374] T 98615f3dc2e44a0bb7bda5583a5813b9 P 7e50b4a48b5649a6ae754f453671aafc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:40:10.969135 23793 raft_consensus.cc:729] T 98615f3dc2e44a0bb7bda5583a5813b9 P 7e50b4a48b5649a6ae754f453671aafc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e50b4a48b5649a6ae754f453671aafc, State: Initialized, Role: FOLLOWER
I20260808 04:40:10.969357 23793 consensus_queue.cc:260] T 98615f3dc2e44a0bb7bda5583a5813b9 P 7e50b4a48b5649a6ae754f453671aafc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27da82a1c2d3446f95f7ecd5d9405358" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 36077 } } peers { permanent_uuid: "9a10e81aa6db43e6b4cf0cdac04b5166" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 40955 } } peers { permanent_uuid: "7e50b4a48b5649a6ae754f453671aafc" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 38143 } }
I20260808 04:40:10.969583 23796 raft_consensus.cc:348] T 98615f3dc2e44a0bb7bda5583a5813b9 P 9a10e81aa6db43e6b4cf0cdac04b5166 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27da82a1c2d3446f95f7ecd5d9405358" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 36077 } } peers { permanent_uuid: "9a10e81aa6db43e6b4cf0cdac04b5166" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 40955 } } peers { permanent_uuid: "7e50b4a48b5649a6ae754f453671aafc" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 38143 } }
I20260808 04:40:10.969696 23796 raft_consensus.cc:374] T 98615f3dc2e44a0bb7bda5583a5813b9 P 9a10e81aa6db43e6b4cf0cdac04b5166 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:40:10.969641 23797 tablet_replica.cc:439] T 98615f3dc2e44a0bb7bda5583a5813b9 P 7e50b4a48b5649a6ae754f453671aafc: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27da82a1c2d3446f95f7ecd5d9405358" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 36077 } } peers { permanent_uuid: "9a10e81aa6db43e6b4cf0cdac04b5166" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 40955 } } peers { permanent_uuid: "7e50b4a48b5649a6ae754f453671aafc" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 38143 } } }
I20260808 04:40:10.969734 23796 raft_consensus.cc:729] T 98615f3dc2e44a0bb7bda5583a5813b9 P 9a10e81aa6db43e6b4cf0cdac04b5166 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a10e81aa6db43e6b4cf0cdac04b5166, State: Initialized, Role: FOLLOWER
I20260808 04:40:10.969772 23797 tablet_replica.cc:442] T 98615f3dc2e44a0bb7bda5583a5813b9 P 7e50b4a48b5649a6ae754f453671aafc: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 04:40:10.969735 23792 raft_consensus.cc:348] T 98615f3dc2e44a0bb7bda5583a5813b9 P 27da82a1c2d3446f95f7ecd5d9405358 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27da82a1c2d3446f95f7ecd5d9405358" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 36077 } } peers { permanent_uuid: "9a10e81aa6db43e6b4cf0cdac04b5166" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 40955 } } peers { permanent_uuid: "7e50b4a48b5649a6ae754f453671aafc" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 38143 } }
I20260808 04:40:10.969839 23792 raft_consensus.cc:374] T 98615f3dc2e44a0bb7bda5583a5813b9 P 27da82a1c2d3446f95f7ecd5d9405358 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:40:10.969872 23792 raft_consensus.cc:729] T 98615f3dc2e44a0bb7bda5583a5813b9 P 27da82a1c2d3446f95f7ecd5d9405358 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 27da82a1c2d3446f95f7ecd5d9405358, State: Initialized, Role: FOLLOWER
I20260808 04:40:10.969887 23796 consensus_queue.cc:260] T 98615f3dc2e44a0bb7bda5583a5813b9 P 9a10e81aa6db43e6b4cf0cdac04b5166 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27da82a1c2d3446f95f7ecd5d9405358" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 36077 } } peers { permanent_uuid: "9a10e81aa6db43e6b4cf0cdac04b5166" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 40955 } } peers { permanent_uuid: "7e50b4a48b5649a6ae754f453671aafc" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 38143 } }
I20260808 04:40:10.970050 23792 consensus_queue.cc:260] T 98615f3dc2e44a0bb7bda5583a5813b9 P 27da82a1c2d3446f95f7ecd5d9405358 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27da82a1c2d3446f95f7ecd5d9405358" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 36077 } } peers { permanent_uuid: "9a10e81aa6db43e6b4cf0cdac04b5166" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 40955 } } peers { permanent_uuid: "7e50b4a48b5649a6ae754f453671aafc" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 38143 } }
I20260808 04:40:10.970171 23796 ts_tablet_manager.cc:1428] T 98615f3dc2e44a0bb7bda5583a5813b9 P 9a10e81aa6db43e6b4cf0cdac04b5166: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260808 04:40:10.970281 23798 tablet_replica.cc:439] T 98615f3dc2e44a0bb7bda5583a5813b9 P 27da82a1c2d3446f95f7ecd5d9405358: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27da82a1c2d3446f95f7ecd5d9405358" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 36077 } } peers { permanent_uuid: "9a10e81aa6db43e6b4cf0cdac04b5166" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 40955 } } peers { permanent_uuid: "7e50b4a48b5649a6ae754f453671aafc" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 38143 } } }
I20260808 04:40:10.970419 23798 tablet_replica.cc:442] T 98615f3dc2e44a0bb7bda5583a5813b9 P 27da82a1c2d3446f95f7ecd5d9405358: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 04:40:10.970643 23792 ts_tablet_manager.cc:1428] T 98615f3dc2e44a0bb7bda5583a5813b9 P 27da82a1c2d3446f95f7ecd5d9405358: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260808 04:40:10.970798 23793 ts_tablet_manager.cc:1428] T 98615f3dc2e44a0bb7bda5583a5813b9 P 7e50b4a48b5649a6ae754f453671aafc: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260808 04:40:10.970144 23800 tablet_replica.cc:439] T 98615f3dc2e44a0bb7bda5583a5813b9 P 9a10e81aa6db43e6b4cf0cdac04b5166: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27da82a1c2d3446f95f7ecd5d9405358" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 36077 } } peers { permanent_uuid: "9a10e81aa6db43e6b4cf0cdac04b5166" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 40955 } } peers { permanent_uuid: "7e50b4a48b5649a6ae754f453671aafc" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 38143 } } }
I20260808 04:40:10.970872 23800 tablet_replica.cc:442] T 98615f3dc2e44a0bb7bda5583a5813b9 P 9a10e81aa6db43e6b4cf0cdac04b5166: This TxnStatusTablet replica's current role is: FOLLOWER
W20260808 04:40:10.991577 23768 tablet.cc:2369] T 2bb97e28cb4f45cc8b81986741725ee1 P 7e50b4a48b5649a6ae754f453671aafc: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 04:40:11.014111 23624 tablet.cc:2369] T 2bb97e28cb4f45cc8b81986741725ee1 P 9a10e81aa6db43e6b4cf0cdac04b5166: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 04:40:11.038960 23479 tablet.cc:2369] T 2bb97e28cb4f45cc8b81986741725ee1 P 27da82a1c2d3446f95f7ecd5d9405358: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 04:40:11.205824 23798 raft_consensus.cc:482] T 98615f3dc2e44a0bb7bda5583a5813b9 P 27da82a1c2d3446f95f7ecd5d9405358 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 04:40:11.206024 23798 raft_consensus.cc:504] T 98615f3dc2e44a0bb7bda5583a5813b9 P 27da82a1c2d3446f95f7ecd5d9405358 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27da82a1c2d3446f95f7ecd5d9405358" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 36077 } } peers { permanent_uuid: "9a10e81aa6db43e6b4cf0cdac04b5166" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 40955 } } peers { permanent_uuid: "7e50b4a48b5649a6ae754f453671aafc" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 38143 } }
I20260808 04:40:11.206547 23798 leader_election.cc:288] T 98615f3dc2e44a0bb7bda5583a5813b9 P 27da82a1c2d3446f95f7ecd5d9405358 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9a10e81aa6db43e6b4cf0cdac04b5166 (127.20.240.194:40955), 7e50b4a48b5649a6ae754f453671aafc (127.20.240.195:38143)
I20260808 04:40:11.207127 23575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98615f3dc2e44a0bb7bda5583a5813b9" candidate_uuid: "27da82a1c2d3446f95f7ecd5d9405358" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a10e81aa6db43e6b4cf0cdac04b5166" is_pre_election: true
I20260808 04:40:11.207166 23719 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98615f3dc2e44a0bb7bda5583a5813b9" candidate_uuid: "27da82a1c2d3446f95f7ecd5d9405358" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e50b4a48b5649a6ae754f453671aafc" is_pre_election: true
I20260808 04:40:11.207307 23719 raft_consensus.cc:2454] T 98615f3dc2e44a0bb7bda5583a5813b9 P 7e50b4a48b5649a6ae754f453671aafc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27da82a1c2d3446f95f7ecd5d9405358 in term 0.
I20260808 04:40:11.207336 23575 raft_consensus.cc:2454] T 98615f3dc2e44a0bb7bda5583a5813b9 P 9a10e81aa6db43e6b4cf0cdac04b5166 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27da82a1c2d3446f95f7ecd5d9405358 in term 0.
I20260808 04:40:11.207669 23360 leader_election.cc:302] T 98615f3dc2e44a0bb7bda5583a5813b9 P 27da82a1c2d3446f95f7ecd5d9405358 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27da82a1c2d3446f95f7ecd5d9405358, 9a10e81aa6db43e6b4cf0cdac04b5166; no voters:
I20260808 04:40:11.207851 23798 raft_consensus.cc:2781] T 98615f3dc2e44a0bb7bda5583a5813b9 P 27da82a1c2d3446f95f7ecd5d9405358 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 04:40:11.207921 23798 raft_consensus.cc:482] T 98615f3dc2e44a0bb7bda5583a5813b9 P 27da82a1c2d3446f95f7ecd5d9405358 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 04:40:11.207971 23798 raft_consensus.cc:3037] T 98615f3dc2e44a0bb7bda5583a5813b9 P 27da82a1c2d3446f95f7ecd5d9405358 [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:40:11.209102 23798 raft_consensus.cc:504] T 98615f3dc2e44a0bb7bda5583a5813b9 P 27da82a1c2d3446f95f7ecd5d9405358 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27da82a1c2d3446f95f7ecd5d9405358" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 36077 } } peers { permanent_uuid: "9a10e81aa6db43e6b4cf0cdac04b5166" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 40955 } } peers { permanent_uuid: "7e50b4a48b5649a6ae754f453671aafc" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 38143 } }
I20260808 04:40:11.209622 23798 leader_election.cc:288] T 98615f3dc2e44a0bb7bda5583a5813b9 P 27da82a1c2d3446f95f7ecd5d9405358 [CANDIDATE]: Term 1 election: Requested vote from peers 9a10e81aa6db43e6b4cf0cdac04b5166 (127.20.240.194:40955), 7e50b4a48b5649a6ae754f453671aafc (127.20.240.195:38143)
I20260808 04:40:11.210094 23575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98615f3dc2e44a0bb7bda5583a5813b9" candidate_uuid: "27da82a1c2d3446f95f7ecd5d9405358" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a10e81aa6db43e6b4cf0cdac04b5166"
I20260808 04:40:11.210222 23575 raft_consensus.cc:3037] T 98615f3dc2e44a0bb7bda5583a5813b9 P 9a10e81aa6db43e6b4cf0cdac04b5166 [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:40:11.210178 23719 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98615f3dc2e44a0bb7bda5583a5813b9" candidate_uuid: "27da82a1c2d3446f95f7ecd5d9405358" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e50b4a48b5649a6ae754f453671aafc"
I20260808 04:40:11.210384 23719 raft_consensus.cc:3037] T 98615f3dc2e44a0bb7bda5583a5813b9 P 7e50b4a48b5649a6ae754f453671aafc [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:40:11.211372 23575 raft_consensus.cc:2454] T 98615f3dc2e44a0bb7bda5583a5813b9 P 9a10e81aa6db43e6b4cf0cdac04b5166 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27da82a1c2d3446f95f7ecd5d9405358 in term 1.
I20260808 04:40:11.211597 23719 raft_consensus.cc:2454] T 98615f3dc2e44a0bb7bda5583a5813b9 P 7e50b4a48b5649a6ae754f453671aafc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27da82a1c2d3446f95f7ecd5d9405358 in term 1.
I20260808 04:40:11.211779 23360 leader_election.cc:302] T 98615f3dc2e44a0bb7bda5583a5813b9 P 27da82a1c2d3446f95f7ecd5d9405358 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27da82a1c2d3446f95f7ecd5d9405358, 9a10e81aa6db43e6b4cf0cdac04b5166; no voters:
I20260808 04:40:11.212034 23798 raft_consensus.cc:2781] T 98615f3dc2e44a0bb7bda5583a5813b9 P 27da82a1c2d3446f95f7ecd5d9405358 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 04:40:11.212152 23798 raft_consensus.cc:686] T 98615f3dc2e44a0bb7bda5583a5813b9 P 27da82a1c2d3446f95f7ecd5d9405358 [term 1 LEADER]: Becoming Leader. State: Replica: 27da82a1c2d3446f95f7ecd5d9405358, State: Running, Role: LEADER
I20260808 04:40:11.212313 23798 consensus_queue.cc:237] T 98615f3dc2e44a0bb7bda5583a5813b9 P 27da82a1c2d3446f95f7ecd5d9405358 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27da82a1c2d3446f95f7ecd5d9405358" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 36077 } } peers { permanent_uuid: "9a10e81aa6db43e6b4cf0cdac04b5166" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 40955 } } peers { permanent_uuid: "7e50b4a48b5649a6ae754f453671aafc" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 38143 } }
I20260808 04:40:11.213025 23803 tablet_replica.cc:439] T 98615f3dc2e44a0bb7bda5583a5813b9 P 27da82a1c2d3446f95f7ecd5d9405358: TxnStatusTablet state changed. Reason: New leader 27da82a1c2d3446f95f7ecd5d9405358. Latest consensus state: current_term: 1 leader_uuid: "27da82a1c2d3446f95f7ecd5d9405358" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27da82a1c2d3446f95f7ecd5d9405358" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 36077 } } peers { permanent_uuid: "9a10e81aa6db43e6b4cf0cdac04b5166" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 40955 } } peers { permanent_uuid: "7e50b4a48b5649a6ae754f453671aafc" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 38143 } } }
I20260808 04:40:11.213171 23803 tablet_replica.cc:442] T 98615f3dc2e44a0bb7bda5583a5813b9 P 27da82a1c2d3446f95f7ecd5d9405358: This TxnStatusTablet replica's current role is: LEADER
I20260808 04:40:11.213557 23817 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260808 04:40:11.213850 23817 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260808 04:40:11.214389 23264 catalog_manager.cc:5495] T 98615f3dc2e44a0bb7bda5583a5813b9 P 27da82a1c2d3446f95f7ecd5d9405358 reported cstate change: term changed from 0 to 1, leader changed from <none> to 27da82a1c2d3446f95f7ecd5d9405358 (127.20.240.193). New cstate: current_term: 1 leader_uuid: "27da82a1c2d3446f95f7ecd5d9405358" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27da82a1c2d3446f95f7ecd5d9405358" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 36077 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9a10e81aa6db43e6b4cf0cdac04b5166" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 40955 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e50b4a48b5649a6ae754f453671aafc" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 38143 } health_report { overall_health: UNKNOWN } } }
I20260808 04:40:11.269277 23789 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:11.265077 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33882 (local address 127.20.240.193:36077)
0808 04:40:11.265237 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:11.265240 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:11.265254 (+ 14us) server_negotiation.cc:407] Connection header received
0808 04:40:11.265346 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:11.265348 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:11.265408 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:11.265505 (+ 97us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 04:40:11.265793 (+ 288us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:11.266395 (+ 602us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:11.267631 (+ 1236us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:11.267886 (+ 255us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:11.267969 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:11.268312 (+ 343us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 04:40:11.268763 (+ 451us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 04:40:11.268907 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:11.269020 (+ 113us) server_negotiation.cc:299] Negotiation successful
0808 04:40:11.269080 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260808 04:40:11.269276 23811 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:11.264872 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.193:36077 (local address 127.0.0.1:33882)
0808 04:40:11.265024 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:11.265039 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:11.265163 (+ 124us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:11.265545 (+ 382us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:11.265548 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:11.265557 (+ 9us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 04:40:11.265678 (+ 121us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:11.265684 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:11.266522 (+ 838us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:11.266526 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:11.267510 (+ 984us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:11.267522 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:11.267998 (+ 476us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:11.268002 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:11.268105 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:11.268165 (+ 60us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 04:40:11.268905 (+ 740us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 04:40:11.268921 (+ 16us) client_negotiation.cc:769] Sending connection context
0808 04:40:11.268996 (+ 75us) client_negotiation.cc:240] Negotiation successful
0808 04:40:11.269093 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":41}
I20260808 04:40:11.275853 23575 raft_consensus.cc:1261] T 98615f3dc2e44a0bb7bda5583a5813b9 P 9a10e81aa6db43e6b4cf0cdac04b5166 [term 1 FOLLOWER]: Refusing update from remote peer 27da82a1c2d3446f95f7ecd5d9405358: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 04:40:11.275887 23719 raft_consensus.cc:1261] T 98615f3dc2e44a0bb7bda5583a5813b9 P 7e50b4a48b5649a6ae754f453671aafc [term 1 FOLLOWER]: Refusing update from remote peer 27da82a1c2d3446f95f7ecd5d9405358: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 04:40:11.276716 23798 consensus_queue.cc:1035] T 98615f3dc2e44a0bb7bda5583a5813b9 P 27da82a1c2d3446f95f7ecd5d9405358 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e50b4a48b5649a6ae754f453671aafc" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 38143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 04:40:11.277040 23803 consensus_queue.cc:1035] T 98615f3dc2e44a0bb7bda5583a5813b9 P 27da82a1c2d3446f95f7ecd5d9405358 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a10e81aa6db43e6b4cf0cdac04b5166" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 40955 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 04:40:11.282266 23800 tablet_replica.cc:439] T 98615f3dc2e44a0bb7bda5583a5813b9 P 9a10e81aa6db43e6b4cf0cdac04b5166: TxnStatusTablet state changed. Reason: New leader 27da82a1c2d3446f95f7ecd5d9405358. Latest consensus state: current_term: 1 leader_uuid: "27da82a1c2d3446f95f7ecd5d9405358" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27da82a1c2d3446f95f7ecd5d9405358" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 36077 } } peers { permanent_uuid: "9a10e81aa6db43e6b4cf0cdac04b5166" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 40955 } } peers { permanent_uuid: "7e50b4a48b5649a6ae754f453671aafc" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 38143 } } }
I20260808 04:40:11.282440 23800 tablet_replica.cc:442] T 98615f3dc2e44a0bb7bda5583a5813b9 P 9a10e81aa6db43e6b4cf0cdac04b5166: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 04:40:11.283427 23797 tablet_replica.cc:439] T 98615f3dc2e44a0bb7bda5583a5813b9 P 7e50b4a48b5649a6ae754f453671aafc: TxnStatusTablet state changed. Reason: New leader 27da82a1c2d3446f95f7ecd5d9405358. Latest consensus state: current_term: 1 leader_uuid: "27da82a1c2d3446f95f7ecd5d9405358" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27da82a1c2d3446f95f7ecd5d9405358" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 36077 } } peers { permanent_uuid: "9a10e81aa6db43e6b4cf0cdac04b5166" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 40955 } } peers { permanent_uuid: "7e50b4a48b5649a6ae754f453671aafc" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 38143 } } }
I20260808 04:40:11.283584 23797 tablet_replica.cc:442] T 98615f3dc2e44a0bb7bda5583a5813b9 P 7e50b4a48b5649a6ae754f453671aafc: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 04:40:11.286669 23803 tablet_replica.cc:439] T 98615f3dc2e44a0bb7bda5583a5813b9 P 27da82a1c2d3446f95f7ecd5d9405358: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "27da82a1c2d3446f95f7ecd5d9405358" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27da82a1c2d3446f95f7ecd5d9405358" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 36077 } } peers { permanent_uuid: "9a10e81aa6db43e6b4cf0cdac04b5166" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 40955 } } peers { permanent_uuid: "7e50b4a48b5649a6ae754f453671aafc" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 38143 } } }
I20260808 04:40:11.286821 23803 tablet_replica.cc:442] T 98615f3dc2e44a0bb7bda5583a5813b9 P 27da82a1c2d3446f95f7ecd5d9405358: This TxnStatusTablet replica's current role is: LEADER
I20260808 04:40:11.287106 23797 tablet_replica.cc:439] T 98615f3dc2e44a0bb7bda5583a5813b9 P 7e50b4a48b5649a6ae754f453671aafc: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "27da82a1c2d3446f95f7ecd5d9405358" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27da82a1c2d3446f95f7ecd5d9405358" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 36077 } } peers { permanent_uuid: "9a10e81aa6db43e6b4cf0cdac04b5166" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 40955 } } peers { permanent_uuid: "7e50b4a48b5649a6ae754f453671aafc" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 38143 } } }
I20260808 04:40:11.287212 23797 tablet_replica.cc:442] T 98615f3dc2e44a0bb7bda5583a5813b9 P 7e50b4a48b5649a6ae754f453671aafc: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 04:40:11.287484 23822 mvcc.cc:205] Tried to move back new op lower bound from 7316127790177665024 to 7316127789926895616. Current Snapshot: MvccSnapshot[applied={T|T < 7316127790177665024}]
I20260808 04:40:11.289233 23820 mvcc.cc:205] Tried to move back new op lower bound from 7316127790177665024 to 7316127789926895616. Current Snapshot: MvccSnapshot[applied={T|T < 7316127790177665024}]
I20260808 04:40:11.289399 23803 tablet_replica.cc:439] T 98615f3dc2e44a0bb7bda5583a5813b9 P 27da82a1c2d3446f95f7ecd5d9405358: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "27da82a1c2d3446f95f7ecd5d9405358" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27da82a1c2d3446f95f7ecd5d9405358" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 36077 } } peers { permanent_uuid: "9a10e81aa6db43e6b4cf0cdac04b5166" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 40955 } } peers { permanent_uuid: "7e50b4a48b5649a6ae754f453671aafc" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 38143 } } }
I20260808 04:40:11.289505 23803 tablet_replica.cc:442] T 98615f3dc2e44a0bb7bda5583a5813b9 P 27da82a1c2d3446f95f7ecd5d9405358: This TxnStatusTablet replica's current role is: LEADER
I20260808 04:40:11.291508 23800 tablet_replica.cc:439] T 98615f3dc2e44a0bb7bda5583a5813b9 P 9a10e81aa6db43e6b4cf0cdac04b5166: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "27da82a1c2d3446f95f7ecd5d9405358" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27da82a1c2d3446f95f7ecd5d9405358" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 36077 } } peers { permanent_uuid: "9a10e81aa6db43e6b4cf0cdac04b5166" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 40955 } } peers { permanent_uuid: "7e50b4a48b5649a6ae754f453671aafc" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 38143 } } }
I20260808 04:40:11.291640 23800 tablet_replica.cc:442] T 98615f3dc2e44a0bb7bda5583a5813b9 P 9a10e81aa6db43e6b4cf0cdac04b5166: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 04:40:11.297268 23821 mvcc.cc:205] Tried to move back new op lower bound from 7316127790177665024 to 7316127789926895616. Current Snapshot: MvccSnapshot[applied={T|T < 7316127790177665024 or (T in {7316127790177665024})}]
I20260808 04:40:11.307197 23789 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:11.302758 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33898 (local address 127.20.240.193:36077)
0808 04:40:11.302942 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:11.302946 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:11.303223 (+ 277us) server_negotiation.cc:407] Connection header received
0808 04:40:11.303364 (+ 141us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:11.303367 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:11.303443 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:11.303533 (+ 90us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 04:40:11.303811 (+ 278us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:11.304574 (+ 763us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:11.305895 (+ 1321us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:11.306271 (+ 376us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:11.306401 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:11.306659 (+ 258us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 04:40:11.306773 (+ 114us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 04:40:11.306857 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:11.306995 (+ 138us) server_negotiation.cc:299] Negotiation successful
0808 04:40:11.307051 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260808 04:40:11.319890 23789 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:11.315377 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.240.193:49505 (local address 127.20.240.193:36077)
0808 04:40:11.315504 (+ 127us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:11.315509 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:11.315732 (+ 223us) server_negotiation.cc:407] Connection header received
0808 04:40:11.315890 (+ 158us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:11.315893 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:11.315934 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:11.315997 (+ 63us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 04:40:11.316287 (+ 290us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:11.316872 (+ 585us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:11.318241 (+ 1369us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:11.318644 (+ 403us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:11.318774 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:11.319255 (+ 481us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 04:40:11.319382 (+ 127us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 04:40:11.319481 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:11.319647 (+ 166us) server_negotiation.cc:299] Negotiation successful
0808 04:40:11.319696 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":5,"server-negotiator.queue_time_us":52}
I20260808 04:40:11.319947 23833 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:11.315293 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.193:36077 (local address 127.20.240.193:49505)
0808 04:40:11.315632 (+ 339us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:11.315648 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:11.315773 (+ 125us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:11.316038 (+ 265us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:11.316041 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:11.316051 (+ 10us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 04:40:11.316166 (+ 115us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:11.316173 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:11.316976 (+ 803us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:11.316979 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:11.318089 (+ 1110us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:11.318102 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:11.318790 (+ 688us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:11.318794 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:11.318985 (+ 191us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:11.319047 (+ 62us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 04:40:11.319495 (+ 448us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 04:40:11.319503 (+ 8us) client_negotiation.cc:769] Sending connection context
0808 04:40:11.319612 (+ 109us) client_negotiation.cc:240] Negotiation successful
0808 04:40:11.319696 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":232,"mutex_wait_us":31,"thread_start_us":105,"threads_started":1}
I20260808 04:40:11.328181 23827 consensus_queue.cc:1035] T 2bb97e28cb4f45cc8b81986741725ee1 P 27da82a1c2d3446f95f7ecd5d9405358 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a10e81aa6db43e6b4cf0cdac04b5166" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 40955 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 04:40:11.328758 23719 raft_consensus.cc:1261] T 2bb97e28cb4f45cc8b81986741725ee1 P 7e50b4a48b5649a6ae754f453671aafc [term 1 FOLLOWER]: Refusing update from remote peer 27da82a1c2d3446f95f7ecd5d9405358: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 04:40:11.329248 23827 consensus_queue.cc:1035] T 2bb97e28cb4f45cc8b81986741725ee1 P 27da82a1c2d3446f95f7ecd5d9405358 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e50b4a48b5649a6ae754f453671aafc" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 38143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 04:40:11.376801 23265 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35024:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 04:40:11.377030 23265 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35024:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 04:40:11.379719 23265 catalog_manager.cc:5782] T 00000000000000000000000000000000 P cc10ed40a4bf4b58aba57fcd15d2eb48: Sending DeleteTablet for 3 replicas of tablet 2bb97e28cb4f45cc8b81986741725ee1
I20260808 04:40:11.380861 23698 tablet_service.cc:1514] Processing DeleteTablet for tablet 2bb97e28cb4f45cc8b81986741725ee1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 04:40:11 UTC) from {username='kudu', principal='kudu/127.20.240.254@KRBTEST.COM'} at 127.0.0.1:54070
I20260808 04:40:11.381676 23408 tablet_service.cc:1514] Processing DeleteTablet for tablet 2bb97e28cb4f45cc8b81986741725ee1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 04:40:11 UTC) from {username='kudu', principal='kudu/127.20.240.254@KRBTEST.COM'} at 127.0.0.1:33868
I20260808 04:40:11.382405 23837 tablet_replica.cc:330] T 2bb97e28cb4f45cc8b81986741725ee1 P 7e50b4a48b5649a6ae754f453671aafc: stopping tablet replica
I20260808 04:40:11.382428 23838 tablet_replica.cc:330] T 2bb97e28cb4f45cc8b81986741725ee1 P 27da82a1c2d3446f95f7ecd5d9405358: stopping tablet replica
I20260808 04:40:11.382925 23837 raft_consensus.cc:2229] T 2bb97e28cb4f45cc8b81986741725ee1 P 7e50b4a48b5649a6ae754f453671aafc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 04:40:11.382928 23838 raft_consensus.cc:2229] T 2bb97e28cb4f45cc8b81986741725ee1 P 27da82a1c2d3446f95f7ecd5d9405358 [term 1 LEADER]: Raft consensus shutting down.
I20260808 04:40:11.383354 23837 raft_consensus.cc:2258] T 2bb97e28cb4f45cc8b81986741725ee1 P 7e50b4a48b5649a6ae754f453671aafc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 04:40:11.383476 23838 raft_consensus.cc:2258] T 2bb97e28cb4f45cc8b81986741725ee1 P 27da82a1c2d3446f95f7ecd5d9405358 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 04:40:11.384999 23555 tablet_service.cc:1514] Processing DeleteTablet for tablet 2bb97e28cb4f45cc8b81986741725ee1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 04:40:11 UTC) from {username='kudu', principal='kudu/127.20.240.254@KRBTEST.COM'} at 127.0.0.1:48970
I20260808 04:40:11.385905 23839 tablet_replica.cc:330] T 2bb97e28cb4f45cc8b81986741725ee1 P 9a10e81aa6db43e6b4cf0cdac04b5166: stopping tablet replica
I20260808 04:40:11.386328 23839 raft_consensus.cc:2229] T 2bb97e28cb4f45cc8b81986741725ee1 P 9a10e81aa6db43e6b4cf0cdac04b5166 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 04:40:11.386659 23839 raft_consensus.cc:2258] T 2bb97e28cb4f45cc8b81986741725ee1 P 9a10e81aa6db43e6b4cf0cdac04b5166 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 04:40:11.387015 23265 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35024:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 04:40:11.387571 23265 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 04:40:11.388654 23839 ts_tablet_manager.cc:1905] T 2bb97e28cb4f45cc8b81986741725ee1 P 9a10e81aa6db43e6b4cf0cdac04b5166: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 04:40:11.392280 23838 ts_tablet_manager.cc:1905] T 2bb97e28cb4f45cc8b81986741725ee1 P 27da82a1c2d3446f95f7ecd5d9405358: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 04:40:11.392855 23839 ts_tablet_manager.cc:1918] T 2bb97e28cb4f45cc8b81986741725ee1 P 9a10e81aa6db43e6b4cf0cdac04b5166: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 04:40:11.393050 23839 log.cc:1196] T 2bb97e28cb4f45cc8b81986741725ee1 P 9a10e81aa6db43e6b4cf0cdac04b5166: Deleting WAL directory at /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786164000593138-21443-0/minicluster-data/ts-1/wal/wals/2bb97e28cb4f45cc8b81986741725ee1
I20260808 04:40:11.393635 23839 ts_tablet_manager.cc:1939] T 2bb97e28cb4f45cc8b81986741725ee1 P 9a10e81aa6db43e6b4cf0cdac04b5166: Deleting consensus metadata
I20260808 04:40:11.394485 23408 tablet_service.cc:1467] Processing CreateTablet for tablet d5e999a722ea405d88e6ca9f260e5cd1 (DEFAULT_TABLE table=test-table [id=d60608535a4643e9b6fc6b52da9b7b72]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 04:40:11.394775 23408 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d5e999a722ea405d88e6ca9f260e5cd1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:40:11.395243 23252 catalog_manager.cc:4841] TS 9a10e81aa6db43e6b4cf0cdac04b5166 (127.20.240.194:40955): tablet 2bb97e28cb4f45cc8b81986741725ee1 (table test-table [id=092795b405bb4970a1d83480f405b365]) successfully deleted
I20260808 04:40:11.395653 23838 ts_tablet_manager.cc:1918] T 2bb97e28cb4f45cc8b81986741725ee1 P 27da82a1c2d3446f95f7ecd5d9405358: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 04:40:11.395766 23838 log.cc:1196] T 2bb97e28cb4f45cc8b81986741725ee1 P 27da82a1c2d3446f95f7ecd5d9405358: Deleting WAL directory at /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786164000593138-21443-0/minicluster-data/ts-0/wal/wals/2bb97e28cb4f45cc8b81986741725ee1
I20260808 04:40:11.396153 23838 ts_tablet_manager.cc:1939] T 2bb97e28cb4f45cc8b81986741725ee1 P 27da82a1c2d3446f95f7ecd5d9405358: Deleting consensus metadata
I20260808 04:40:11.396914 23792 tablet_bootstrap.cc:492] T d5e999a722ea405d88e6ca9f260e5cd1 P 27da82a1c2d3446f95f7ecd5d9405358: Bootstrap starting.
I20260808 04:40:11.397233 23698 tablet_service.cc:1467] Processing CreateTablet for tablet d5e999a722ea405d88e6ca9f260e5cd1 (DEFAULT_TABLE table=test-table [id=d60608535a4643e9b6fc6b52da9b7b72]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 04:40:11.397516 23698 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d5e999a722ea405d88e6ca9f260e5cd1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:40:11.397831 23792 tablet_bootstrap.cc:654] T d5e999a722ea405d88e6ca9f260e5cd1 P 27da82a1c2d3446f95f7ecd5d9405358: Neither blocks nor log segments found. Creating new log.
I20260808 04:40:11.399111 23792 tablet_bootstrap.cc:492] T d5e999a722ea405d88e6ca9f260e5cd1 P 27da82a1c2d3446f95f7ecd5d9405358: No bootstrap required, opened a new log
I20260808 04:40:11.399199 23792 ts_tablet_manager.cc:1397] T d5e999a722ea405d88e6ca9f260e5cd1 P 27da82a1c2d3446f95f7ecd5d9405358: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 04:40:11.399606 23792 raft_consensus.cc:348] T d5e999a722ea405d88e6ca9f260e5cd1 P 27da82a1c2d3446f95f7ecd5d9405358 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27da82a1c2d3446f95f7ecd5d9405358" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 36077 } } peers { permanent_uuid: "9a10e81aa6db43e6b4cf0cdac04b5166" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 40955 } } peers { permanent_uuid: "7e50b4a48b5649a6ae754f453671aafc" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 38143 } }
I20260808 04:40:11.399737 23792 raft_consensus.cc:374] T d5e999a722ea405d88e6ca9f260e5cd1 P 27da82a1c2d3446f95f7ecd5d9405358 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:40:11.399772 23792 raft_consensus.cc:729] T d5e999a722ea405d88e6ca9f260e5cd1 P 27da82a1c2d3446f95f7ecd5d9405358 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 27da82a1c2d3446f95f7ecd5d9405358, State: Initialized, Role: FOLLOWER
I20260808 04:40:11.399886 23792 consensus_queue.cc:260] T d5e999a722ea405d88e6ca9f260e5cd1 P 27da82a1c2d3446f95f7ecd5d9405358 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27da82a1c2d3446f95f7ecd5d9405358" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 36077 } } peers { permanent_uuid: "9a10e81aa6db43e6b4cf0cdac04b5166" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 40955 } } peers { permanent_uuid: "7e50b4a48b5649a6ae754f453671aafc" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 38143 } }
I20260808 04:40:11.400025 23793 tablet_bootstrap.cc:492] T d5e999a722ea405d88e6ca9f260e5cd1 P 7e50b4a48b5649a6ae754f453671aafc: Bootstrap starting.
I20260808 04:40:11.400164 23792 ts_tablet_manager.cc:1428] T d5e999a722ea405d88e6ca9f260e5cd1 P 27da82a1c2d3446f95f7ecd5d9405358: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260808 04:40:11.400971 23793 tablet_bootstrap.cc:654] T d5e999a722ea405d88e6ca9f260e5cd1 P 7e50b4a48b5649a6ae754f453671aafc: Neither blocks nor log segments found. Creating new log.
I20260808 04:40:11.402252 23252 catalog_manager.cc:4841] TS 27da82a1c2d3446f95f7ecd5d9405358 (127.20.240.193:36077): tablet 2bb97e28cb4f45cc8b81986741725ee1 (table test-table [id=092795b405bb4970a1d83480f405b365]) successfully deleted
I20260808 04:40:11.402622 23555 tablet_service.cc:1467] Processing CreateTablet for tablet d5e999a722ea405d88e6ca9f260e5cd1 (DEFAULT_TABLE table=test-table [id=d60608535a4643e9b6fc6b52da9b7b72]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 04:40:11.402863 23555 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d5e999a722ea405d88e6ca9f260e5cd1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:40:11.404734 23796 tablet_bootstrap.cc:492] T d5e999a722ea405d88e6ca9f260e5cd1 P 9a10e81aa6db43e6b4cf0cdac04b5166: Bootstrap starting.
I20260808 04:40:11.405426 23793 tablet_bootstrap.cc:492] T d5e999a722ea405d88e6ca9f260e5cd1 P 7e50b4a48b5649a6ae754f453671aafc: No bootstrap required, opened a new log
I20260808 04:40:11.405534 23793 ts_tablet_manager.cc:1397] T d5e999a722ea405d88e6ca9f260e5cd1 P 7e50b4a48b5649a6ae754f453671aafc: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.000s
I20260808 04:40:11.405807 23796 tablet_bootstrap.cc:654] T d5e999a722ea405d88e6ca9f260e5cd1 P 9a10e81aa6db43e6b4cf0cdac04b5166: Neither blocks nor log segments found. Creating new log.
I20260808 04:40:11.406103 23793 raft_consensus.cc:348] T d5e999a722ea405d88e6ca9f260e5cd1 P 7e50b4a48b5649a6ae754f453671aafc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27da82a1c2d3446f95f7ecd5d9405358" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 36077 } } peers { permanent_uuid: "9a10e81aa6db43e6b4cf0cdac04b5166" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 40955 } } peers { permanent_uuid: "7e50b4a48b5649a6ae754f453671aafc" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 38143 } }
I20260808 04:40:11.406236 23793 raft_consensus.cc:374] T d5e999a722ea405d88e6ca9f260e5cd1 P 7e50b4a48b5649a6ae754f453671aafc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:40:11.406298 23793 raft_consensus.cc:729] T d5e999a722ea405d88e6ca9f260e5cd1 P 7e50b4a48b5649a6ae754f453671aafc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e50b4a48b5649a6ae754f453671aafc, State: Initialized, Role: FOLLOWER
I20260808 04:40:11.407220 23793 consensus_queue.cc:260] T d5e999a722ea405d88e6ca9f260e5cd1 P 7e50b4a48b5649a6ae754f453671aafc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27da82a1c2d3446f95f7ecd5d9405358" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 36077 } } peers { permanent_uuid: "9a10e81aa6db43e6b4cf0cdac04b5166" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 40955 } } peers { permanent_uuid: "7e50b4a48b5649a6ae754f453671aafc" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 38143 } }
I20260808 04:40:11.407473 23837 ts_tablet_manager.cc:1905] T 2bb97e28cb4f45cc8b81986741725ee1 P 7e50b4a48b5649a6ae754f453671aafc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 04:40:11.408201 23793 ts_tablet_manager.cc:1428] T d5e999a722ea405d88e6ca9f260e5cd1 P 7e50b4a48b5649a6ae754f453671aafc: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20260808 04:40:11.410388 23837 ts_tablet_manager.cc:1918] T 2bb97e28cb4f45cc8b81986741725ee1 P 7e50b4a48b5649a6ae754f453671aafc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 04:40:11.410493 23837 log.cc:1196] T 2bb97e28cb4f45cc8b81986741725ee1 P 7e50b4a48b5649a6ae754f453671aafc: Deleting WAL directory at /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786164000593138-21443-0/minicluster-data/ts-2/wal/wals/2bb97e28cb4f45cc8b81986741725ee1
I20260808 04:40:11.410790 23837 ts_tablet_manager.cc:1939] T 2bb97e28cb4f45cc8b81986741725ee1 P 7e50b4a48b5649a6ae754f453671aafc: Deleting consensus metadata
I20260808 04:40:11.411919 23252 catalog_manager.cc:4841] TS 7e50b4a48b5649a6ae754f453671aafc (127.20.240.195:38143): tablet 2bb97e28cb4f45cc8b81986741725ee1 (table test-table [id=092795b405bb4970a1d83480f405b365]) successfully deleted
I20260808 04:40:11.412516 23796 tablet_bootstrap.cc:492] T d5e999a722ea405d88e6ca9f260e5cd1 P 9a10e81aa6db43e6b4cf0cdac04b5166: No bootstrap required, opened a new log
I20260808 04:40:11.412650 23796 ts_tablet_manager.cc:1397] T d5e999a722ea405d88e6ca9f260e5cd1 P 9a10e81aa6db43e6b4cf0cdac04b5166: Time spent bootstrapping tablet: real 0.008s user 0.000s sys 0.002s
I20260808 04:40:11.413075 23796 raft_consensus.cc:348] T d5e999a722ea405d88e6ca9f260e5cd1 P 9a10e81aa6db43e6b4cf0cdac04b5166 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27da82a1c2d3446f95f7ecd5d9405358" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 36077 } } peers { permanent_uuid: "9a10e81aa6db43e6b4cf0cdac04b5166" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 40955 } } peers { permanent_uuid: "7e50b4a48b5649a6ae754f453671aafc" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 38143 } }
I20260808 04:40:11.413260 23796 raft_consensus.cc:374] T d5e999a722ea405d88e6ca9f260e5cd1 P 9a10e81aa6db43e6b4cf0cdac04b5166 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:40:11.413331 23796 raft_consensus.cc:729] T d5e999a722ea405d88e6ca9f260e5cd1 P 9a10e81aa6db43e6b4cf0cdac04b5166 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a10e81aa6db43e6b4cf0cdac04b5166, State: Initialized, Role: FOLLOWER
I20260808 04:40:11.413489 23796 consensus_queue.cc:260] T d5e999a722ea405d88e6ca9f260e5cd1 P 9a10e81aa6db43e6b4cf0cdac04b5166 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27da82a1c2d3446f95f7ecd5d9405358" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 36077 } } peers { permanent_uuid: "9a10e81aa6db43e6b4cf0cdac04b5166" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 40955 } } peers { permanent_uuid: "7e50b4a48b5649a6ae754f453671aafc" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 38143 } }
I20260808 04:40:11.413807 23796 ts_tablet_manager.cc:1428] T d5e999a722ea405d88e6ca9f260e5cd1 P 9a10e81aa6db43e6b4cf0cdac04b5166: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260808 04:40:11.424773 23797 raft_consensus.cc:482] T d5e999a722ea405d88e6ca9f260e5cd1 P 7e50b4a48b5649a6ae754f453671aafc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 04:40:11.424925 23797 raft_consensus.cc:504] T d5e999a722ea405d88e6ca9f260e5cd1 P 7e50b4a48b5649a6ae754f453671aafc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27da82a1c2d3446f95f7ecd5d9405358" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 36077 } } peers { permanent_uuid: "9a10e81aa6db43e6b4cf0cdac04b5166" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 40955 } } peers { permanent_uuid: "7e50b4a48b5649a6ae754f453671aafc" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 38143 } }
I20260808 04:40:11.426122 23797 leader_election.cc:288] T d5e999a722ea405d88e6ca9f260e5cd1 P 7e50b4a48b5649a6ae754f453671aafc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 27da82a1c2d3446f95f7ecd5d9405358 (127.20.240.193:36077), 9a10e81aa6db43e6b4cf0cdac04b5166 (127.20.240.194:40955)
I20260808 04:40:11.431166 23846 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:11.426871 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.240.195:47063 (local address 127.20.240.194:40955)
0808 04:40:11.427118 (+ 247us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:11.427125 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:11.427612 (+ 487us) server_negotiation.cc:407] Connection header received
0808 04:40:11.427834 (+ 222us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:11.427837 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:11.427890 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:11.427981 (+ 91us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 04:40:11.428291 (+ 310us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:11.429058 (+ 767us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:11.430172 (+ 1114us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:11.430591 (+ 419us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:11.430723 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:11.430781 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:11.430956 (+ 175us) server_negotiation.cc:299] Negotiation successful
0808 04:40:11.431026 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":166,"thread_start_us":58,"threads_started":1}
I20260808 04:40:11.431191 23844 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:11.426720 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.194:40955 (local address 127.20.240.195:47063)
0808 04:40:11.427531 (+ 811us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:11.427545 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:11.427652 (+ 107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:11.428002 (+ 350us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:11.428005 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:11.428021 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 04:40:11.428181 (+ 160us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:11.428188 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:11.429227 (+ 1039us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:11.429230 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:11.430043 (+ 813us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:11.430052 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:11.430715 (+ 663us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:11.430719 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:11.430818 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:11.430841 (+ 23us) client_negotiation.cc:769] Sending connection context
0808 04:40:11.430939 (+ 98us) client_negotiation.cc:240] Negotiation successful
0808 04:40:11.431013 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":732,"mutex_wait_us":1,"thread_start_us":134,"threads_started":1}
I20260808 04:40:11.431686 23575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d5e999a722ea405d88e6ca9f260e5cd1" candidate_uuid: "7e50b4a48b5649a6ae754f453671aafc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a10e81aa6db43e6b4cf0cdac04b5166" is_pre_election: true
I20260808 04:40:11.431875 23575 raft_consensus.cc:2454] T d5e999a722ea405d88e6ca9f260e5cd1 P 9a10e81aa6db43e6b4cf0cdac04b5166 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e50b4a48b5649a6ae754f453671aafc in term 0.
I20260808 04:40:11.432286 23789 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:11.426524 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.240.195:49393 (local address 127.20.240.193:36077)
0808 04:40:11.426671 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:11.426676 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:11.427356 (+ 680us) server_negotiation.cc:407] Connection header received
0808 04:40:11.427966 (+ 610us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:11.427973 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:11.428030 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:11.428106 (+ 76us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 04:40:11.428437 (+ 331us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:11.429275 (+ 838us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:11.430707 (+ 1432us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:11.431319 (+ 612us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:11.431408 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:11.431454 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:11.432071 (+ 617us) server_negotiation.cc:299] Negotiation successful
0808 04:40:11.432155 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260808 04:40:11.432299 23651 leader_election.cc:302] T d5e999a722ea405d88e6ca9f260e5cd1 P 7e50b4a48b5649a6ae754f453671aafc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e50b4a48b5649a6ae754f453671aafc, 9a10e81aa6db43e6b4cf0cdac04b5166; no voters:
I20260808 04:40:11.432596 23797 raft_consensus.cc:2781] T d5e999a722ea405d88e6ca9f260e5cd1 P 7e50b4a48b5649a6ae754f453671aafc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 04:40:11.432691 23797 raft_consensus.cc:482] T d5e999a722ea405d88e6ca9f260e5cd1 P 7e50b4a48b5649a6ae754f453671aafc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 04:40:11.432862 23797 raft_consensus.cc:3037] T d5e999a722ea405d88e6ca9f260e5cd1 P 7e50b4a48b5649a6ae754f453671aafc [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:40:11.433027 23843 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:11.426336 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.193:36077 (local address 127.20.240.195:49393)
0808 04:40:11.427258 (+ 922us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:11.427271 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:11.427832 (+ 561us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:11.428126 (+ 294us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:11.428129 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:11.428149 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 04:40:11.428277 (+ 128us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:11.428284 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:11.429421 (+ 1137us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:11.429424 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:11.430567 (+ 1143us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:11.430576 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:11.431791 (+ 1215us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:11.431796 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:11.431912 (+ 116us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:11.431938 (+ 26us) client_negotiation.cc:769] Sending connection context
0808 04:40:11.432511 (+ 573us) client_negotiation.cc:240] Negotiation successful
0808 04:40:11.432594 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":851,"thread_start_us":78,"threads_started":1}
I20260808 04:40:11.434173 23797 raft_consensus.cc:504] T d5e999a722ea405d88e6ca9f260e5cd1 P 7e50b4a48b5649a6ae754f453671aafc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27da82a1c2d3446f95f7ecd5d9405358" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 36077 } } peers { permanent_uuid: "9a10e81aa6db43e6b4cf0cdac04b5166" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 40955 } } peers { permanent_uuid: "7e50b4a48b5649a6ae754f453671aafc" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 38143 } }
I20260808 04:40:11.434558 23797 leader_election.cc:288] T d5e999a722ea405d88e6ca9f260e5cd1 P 7e50b4a48b5649a6ae754f453671aafc [CANDIDATE]: Term 1 election: Requested vote from peers 27da82a1c2d3446f95f7ecd5d9405358 (127.20.240.193:36077), 9a10e81aa6db43e6b4cf0cdac04b5166 (127.20.240.194:40955)
I20260808 04:40:11.434641 23428 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d5e999a722ea405d88e6ca9f260e5cd1" candidate_uuid: "7e50b4a48b5649a6ae754f453671aafc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27da82a1c2d3446f95f7ecd5d9405358" is_pre_election: true
I20260808 04:40:11.434902 23428 raft_consensus.cc:2454] T d5e999a722ea405d88e6ca9f260e5cd1 P 27da82a1c2d3446f95f7ecd5d9405358 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e50b4a48b5649a6ae754f453671aafc in term 0.
I20260808 04:40:11.435096 23427 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d5e999a722ea405d88e6ca9f260e5cd1" candidate_uuid: "7e50b4a48b5649a6ae754f453671aafc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27da82a1c2d3446f95f7ecd5d9405358"
I20260808 04:40:11.435209 23427 raft_consensus.cc:3037] T d5e999a722ea405d88e6ca9f260e5cd1 P 27da82a1c2d3446f95f7ecd5d9405358 [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:40:11.435256 23575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d5e999a722ea405d88e6ca9f260e5cd1" candidate_uuid: "7e50b4a48b5649a6ae754f453671aafc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a10e81aa6db43e6b4cf0cdac04b5166"
I20260808 04:40:11.435390 23575 raft_consensus.cc:3037] T d5e999a722ea405d88e6ca9f260e5cd1 P 9a10e81aa6db43e6b4cf0cdac04b5166 [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:40:11.436326 23575 raft_consensus.cc:2454] T d5e999a722ea405d88e6ca9f260e5cd1 P 9a10e81aa6db43e6b4cf0cdac04b5166 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e50b4a48b5649a6ae754f453671aafc in term 1.
I20260808 04:40:11.436372 23427 raft_consensus.cc:2454] T d5e999a722ea405d88e6ca9f260e5cd1 P 27da82a1c2d3446f95f7ecd5d9405358 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e50b4a48b5649a6ae754f453671aafc in term 1.
I20260808 04:40:11.436645 23651 leader_election.cc:302] T d5e999a722ea405d88e6ca9f260e5cd1 P 7e50b4a48b5649a6ae754f453671aafc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27da82a1c2d3446f95f7ecd5d9405358, 7e50b4a48b5649a6ae754f453671aafc; no voters:
I20260808 04:40:11.436868 23797 raft_consensus.cc:2781] T d5e999a722ea405d88e6ca9f260e5cd1 P 7e50b4a48b5649a6ae754f453671aafc [term 1 FOLLOWER]: Leader election won for term 1
I20260808 04:40:11.437088 23797 raft_consensus.cc:686] T d5e999a722ea405d88e6ca9f260e5cd1 P 7e50b4a48b5649a6ae754f453671aafc [term 1 LEADER]: Becoming Leader. State: Replica: 7e50b4a48b5649a6ae754f453671aafc, State: Running, Role: LEADER
I20260808 04:40:11.437381 23797 consensus_queue.cc:237] T d5e999a722ea405d88e6ca9f260e5cd1 P 7e50b4a48b5649a6ae754f453671aafc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27da82a1c2d3446f95f7ecd5d9405358" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 36077 } } peers { permanent_uuid: "9a10e81aa6db43e6b4cf0cdac04b5166" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 40955 } } peers { permanent_uuid: "7e50b4a48b5649a6ae754f453671aafc" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 38143 } }
I20260808 04:40:11.439894 23265 catalog_manager.cc:5495] T d5e999a722ea405d88e6ca9f260e5cd1 P 7e50b4a48b5649a6ae754f453671aafc reported cstate change: term changed from 0 to 1, leader changed from <none> to 7e50b4a48b5649a6ae754f453671aafc (127.20.240.195). New cstate: current_term: 1 leader_uuid: "7e50b4a48b5649a6ae754f453671aafc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27da82a1c2d3446f95f7ecd5d9405358" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 36077 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9a10e81aa6db43e6b4cf0cdac04b5166" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 40955 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e50b4a48b5649a6ae754f453671aafc" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 38143 } health_report { overall_health: HEALTHY } } }
I20260808 04:40:11.461921 23849 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:11.458111 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54082 (local address 127.20.240.195:38143)
0808 04:40:11.458416 (+ 305us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:11.458424 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:11.458436 (+ 12us) server_negotiation.cc:407] Connection header received
0808 04:40:11.458509 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:11.458511 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:11.458559 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:11.458685 (+ 126us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 04:40:11.458924 (+ 239us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:11.459483 (+ 559us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:11.460302 (+ 819us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:11.460553 (+ 251us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:11.460660 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:11.460968 (+ 308us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 04:40:11.461504 (+ 536us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 04:40:11.461633 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:11.461691 (+ 58us) server_negotiation.cc:299] Negotiation successful
0808 04:40:11.461745 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":228,"thread_start_us":116,"threads_started":1}
I20260808 04:40:11.473835 23789 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:11.469732 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.240.195:50699 (local address 127.20.240.193:36077)
0808 04:40:11.469899 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:11.469904 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:11.470036 (+ 132us) server_negotiation.cc:407] Connection header received
0808 04:40:11.470201 (+ 165us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:11.470204 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:11.470262 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:11.470346 (+ 84us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 04:40:11.470624 (+ 278us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:11.471135 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:11.472568 (+ 1433us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:11.472889 (+ 321us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:11.472996 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:11.473360 (+ 364us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 04:40:11.473445 (+ 85us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 04:40:11.473523 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:11.473618 (+ 95us) server_negotiation.cc:299] Negotiation successful
0808 04:40:11.473672 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260808 04:40:11.473837 23852 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:11.469617 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.193:36077 (local address 127.20.240.195:50699)
0808 04:40:11.469934 (+ 317us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:11.469956 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:11.470092 (+ 136us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:11.470371 (+ 279us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:11.470374 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:11.470382 (+ 8us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 04:40:11.470509 (+ 127us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:11.470514 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:11.471247 (+ 733us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:11.471254 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:11.472439 (+ 1185us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:11.472449 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:11.473007 (+ 558us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:11.473010 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:11.473109 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:11.473211 (+ 102us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 04:40:11.473539 (+ 328us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 04:40:11.473547 (+ 8us) client_negotiation.cc:769] Sending connection context
0808 04:40:11.473609 (+ 62us) client_negotiation.cc:240] Negotiation successful
0808 04:40:11.473690 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":212,"thread_start_us":107,"threads_started":1}
I20260808 04:40:11.481037 23427 raft_consensus.cc:1261] T d5e999a722ea405d88e6ca9f260e5cd1 P 27da82a1c2d3446f95f7ecd5d9405358 [term 1 FOLLOWER]: Refusing update from remote peer 7e50b4a48b5649a6ae754f453671aafc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 04:40:11.481071 23575 raft_consensus.cc:1261] T d5e999a722ea405d88e6ca9f260e5cd1 P 9a10e81aa6db43e6b4cf0cdac04b5166 [term 1 FOLLOWER]: Refusing update from remote peer 7e50b4a48b5649a6ae754f453671aafc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 04:40:11.481640 23797 consensus_queue.cc:1035] T d5e999a722ea405d88e6ca9f260e5cd1 P 7e50b4a48b5649a6ae754f453671aafc [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a10e81aa6db43e6b4cf0cdac04b5166" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 40955 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 04:40:11.481906 23847 consensus_queue.cc:1035] T d5e999a722ea405d88e6ca9f260e5cd1 P 7e50b4a48b5649a6ae754f453671aafc [LEADER]: Connected to new peer: Peer: permanent_uuid: "27da82a1c2d3446f95f7ecd5d9405358" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 36077 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 04:40:11.501621 23833 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:11.497501 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.195:38143 (local address 127.20.240.193:40901)
0808 04:40:11.497751 (+ 250us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:11.497767 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:11.497849 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:11.498200 (+ 351us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:11.498203 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:11.498210 (+ 7us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 04:40:11.498307 (+ 97us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:11.498313 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:11.499300 (+ 987us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:11.499303 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:11.500215 (+ 912us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:11.500225 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:11.500840 (+ 615us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:11.500844 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:11.500933 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:11.500968 (+ 35us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 04:40:11.501316 (+ 348us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 04:40:11.501323 (+ 7us) client_negotiation.cc:769] Sending connection context
0808 04:40:11.501382 (+ 59us) client_negotiation.cc:240] Negotiation successful
0808 04:40:11.501473 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":154}
I20260808 04:40:11.502003 23849 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:11.497682 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.240.193:40901 (local address 127.20.240.195:38143)
0808 04:40:11.497790 (+ 108us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:11.497797 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:11.497811 (+ 14us) server_negotiation.cc:407] Connection header received
0808 04:40:11.497961 (+ 150us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:11.497964 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:11.498018 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:11.498086 (+ 68us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 04:40:11.498432 (+ 346us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:11.499176 (+ 744us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:11.500358 (+ 1182us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:11.500701 (+ 343us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:11.500815 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:11.501104 (+ 289us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 04:40:11.501214 (+ 110us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 04:40:11.501277 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:11.501792 (+ 515us) server_negotiation.cc:299] Negotiation successful
0808 04:40:11.501884 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
W20260808 04:40:11.502697 23822 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260808 04:40:13.078145 23264 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35024:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 04:40:13.078320 23264 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35024:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 04:40:13.081100 23264 catalog_manager.cc:5782] T 00000000000000000000000000000000 P cc10ed40a4bf4b58aba57fcd15d2eb48: Sending DeleteTablet for 3 replicas of tablet d5e999a722ea405d88e6ca9f260e5cd1
I20260808 04:40:13.081771 23408 tablet_service.cc:1514] Processing DeleteTablet for tablet d5e999a722ea405d88e6ca9f260e5cd1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 04:40:13 UTC) from {username='kudu', principal='kudu/127.20.240.254@KRBTEST.COM'} at 127.0.0.1:33868
I20260808 04:40:13.081826 23555 tablet_service.cc:1514] Processing DeleteTablet for tablet d5e999a722ea405d88e6ca9f260e5cd1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 04:40:13 UTC) from {username='kudu', principal='kudu/127.20.240.254@KRBTEST.COM'} at 127.0.0.1:48970
I20260808 04:40:13.081948 23698 tablet_service.cc:1514] Processing DeleteTablet for tablet d5e999a722ea405d88e6ca9f260e5cd1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 04:40:13 UTC) from {username='kudu', principal='kudu/127.20.240.254@KRBTEST.COM'} at 127.0.0.1:54070
I20260808 04:40:13.082165 23880 tablet_replica.cc:330] T d5e999a722ea405d88e6ca9f260e5cd1 P 9a10e81aa6db43e6b4cf0cdac04b5166: stopping tablet replica
I20260808 04:40:13.082305 23880 raft_consensus.cc:2229] T d5e999a722ea405d88e6ca9f260e5cd1 P 9a10e81aa6db43e6b4cf0cdac04b5166 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 04:40:13.082340 23882 tablet_replica.cc:330] T d5e999a722ea405d88e6ca9f260e5cd1 P 7e50b4a48b5649a6ae754f453671aafc: stopping tablet replica
I20260808 04:40:13.082441 23880 raft_consensus.cc:2258] T d5e999a722ea405d88e6ca9f260e5cd1 P 9a10e81aa6db43e6b4cf0cdac04b5166 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 04:40:13.082520 23882 raft_consensus.cc:2229] T d5e999a722ea405d88e6ca9f260e5cd1 P 7e50b4a48b5649a6ae754f453671aafc [term 1 LEADER]: Raft consensus shutting down.
I20260808 04:40:13.082677 23881 tablet_replica.cc:330] T d5e999a722ea405d88e6ca9f260e5cd1 P 27da82a1c2d3446f95f7ecd5d9405358: stopping tablet replica
I20260808 04:40:13.082865 23881 raft_consensus.cc:2229] T d5e999a722ea405d88e6ca9f260e5cd1 P 27da82a1c2d3446f95f7ecd5d9405358 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 04:40:13.082914 23882 raft_consensus.cc:2258] T d5e999a722ea405d88e6ca9f260e5cd1 P 7e50b4a48b5649a6ae754f453671aafc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 04:40:13.083060 23881 raft_consensus.cc:2258] T d5e999a722ea405d88e6ca9f260e5cd1 P 27da82a1c2d3446f95f7ecd5d9405358 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 04:40:13.084156 23882 ts_tablet_manager.cc:1905] T d5e999a722ea405d88e6ca9f260e5cd1 P 7e50b4a48b5649a6ae754f453671aafc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 04:40:13.085032 23881 ts_tablet_manager.cc:1905] T d5e999a722ea405d88e6ca9f260e5cd1 P 27da82a1c2d3446f95f7ecd5d9405358: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 04:40:13.085901 23880 ts_tablet_manager.cc:1905] T d5e999a722ea405d88e6ca9f260e5cd1 P 9a10e81aa6db43e6b4cf0cdac04b5166: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 04:40:13.087396 23882 ts_tablet_manager.cc:1918] T d5e999a722ea405d88e6ca9f260e5cd1 P 7e50b4a48b5649a6ae754f453671aafc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260808 04:40:13.087491 23882 log.cc:1196] T d5e999a722ea405d88e6ca9f260e5cd1 P 7e50b4a48b5649a6ae754f453671aafc: Deleting WAL directory at /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786164000593138-21443-0/minicluster-data/ts-2/wal/wals/d5e999a722ea405d88e6ca9f260e5cd1
I20260808 04:40:13.087821 23882 ts_tablet_manager.cc:1939] T d5e999a722ea405d88e6ca9f260e5cd1 P 7e50b4a48b5649a6ae754f453671aafc: Deleting consensus metadata
I20260808 04:40:13.088349 23881 ts_tablet_manager.cc:1918] T d5e999a722ea405d88e6ca9f260e5cd1 P 27da82a1c2d3446f95f7ecd5d9405358: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260808 04:40:13.088456 23881 log.cc:1196] T d5e999a722ea405d88e6ca9f260e5cd1 P 27da82a1c2d3446f95f7ecd5d9405358: Deleting WAL directory at /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786164000593138-21443-0/minicluster-data/ts-0/wal/wals/d5e999a722ea405d88e6ca9f260e5cd1
I20260808 04:40:13.088760 23881 ts_tablet_manager.cc:1939] T d5e999a722ea405d88e6ca9f260e5cd1 P 27da82a1c2d3446f95f7ecd5d9405358: Deleting consensus metadata
I20260808 04:40:13.088724 23252 catalog_manager.cc:4841] TS 7e50b4a48b5649a6ae754f453671aafc (127.20.240.195:38143): tablet d5e999a722ea405d88e6ca9f260e5cd1 (table test-table [id=d60608535a4643e9b6fc6b52da9b7b72]) successfully deleted
I20260808 04:40:13.089015 23880 ts_tablet_manager.cc:1918] T d5e999a722ea405d88e6ca9f260e5cd1 P 9a10e81aa6db43e6b4cf0cdac04b5166: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260808 04:40:13.089105 23880 log.cc:1196] T d5e999a722ea405d88e6ca9f260e5cd1 P 9a10e81aa6db43e6b4cf0cdac04b5166: Deleting WAL directory at /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786164000593138-21443-0/minicluster-data/ts-1/wal/wals/d5e999a722ea405d88e6ca9f260e5cd1
I20260808 04:40:13.089438 23880 ts_tablet_manager.cc:1939] T d5e999a722ea405d88e6ca9f260e5cd1 P 9a10e81aa6db43e6b4cf0cdac04b5166: Deleting consensus metadata
I20260808 04:40:13.089649 23252 catalog_manager.cc:4841] TS 27da82a1c2d3446f95f7ecd5d9405358 (127.20.240.193:36077): tablet d5e999a722ea405d88e6ca9f260e5cd1 (table test-table [id=d60608535a4643e9b6fc6b52da9b7b72]) successfully deleted
I20260808 04:40:13.090272 23252 catalog_manager.cc:4841] TS 9a10e81aa6db43e6b4cf0cdac04b5166 (127.20.240.194:40955): tablet d5e999a722ea405d88e6ca9f260e5cd1 (table test-table [id=d60608535a4643e9b6fc6b52da9b7b72]) successfully deleted
Aug 08 04:40:13 dist-test-slave-vxj2 krb5kdc[23218](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164013, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 08 04:40:13 dist-test-slave-vxj2 krb5kdc[23218](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164013, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.20.240.254@KRBTEST.COM
I20260808 04:40:13.113662 23890 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:13.104216 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35052 (local address 127.20.240.254:36383)
0808 04:40:13.104575 (+ 359us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:13.104582 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:13.104598 (+ 16us) server_negotiation.cc:407] Connection header received
0808 04:40:13.104698 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:13.104700 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:13.104744 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:13.104822 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:13.105694 (+ 872us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:13.106287 (+ 593us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:13.107194 (+ 907us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:13.107422 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:13.107520 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:13.110145 (+ 2625us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:40:13.110148 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:40:13.110150 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:40:13.110175 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:40:13.111687 (+ 1512us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:13.112111 (+ 424us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:13.112114 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:13.112116 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:13.112194 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:13.112561 (+ 367us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:13.112565 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:13.112566 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:13.112794 (+ 228us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:40:13.112913 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:13.113302 (+ 389us) server_negotiation.cc:299] Negotiation successful
0808 04:40:13.113427 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":283,"thread_start_us":139,"threads_started":1}
I20260808 04:40:13.116636 23264 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:35052:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 04:40:13.117122 23264 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 04:40:13.121971 23408 tablet_service.cc:1467] Processing CreateTablet for tablet 1ce7ef1ce9974f268da33890990b625d (DEFAULT_TABLE table=test-table [id=21f9d30bc7744905a618089d6a0d8608]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 04:40:13.122040 23698 tablet_service.cc:1467] Processing CreateTablet for tablet 1ce7ef1ce9974f268da33890990b625d (DEFAULT_TABLE table=test-table [id=21f9d30bc7744905a618089d6a0d8608]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 04:40:13.122040 23555 tablet_service.cc:1467] Processing CreateTablet for tablet 1ce7ef1ce9974f268da33890990b625d (DEFAULT_TABLE table=test-table [id=21f9d30bc7744905a618089d6a0d8608]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 04:40:13.122328 23408 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1ce7ef1ce9974f268da33890990b625d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:40:13.122332 23698 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1ce7ef1ce9974f268da33890990b625d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:40:13.122331 23555 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1ce7ef1ce9974f268da33890990b625d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:40:13.124615 23891 tablet_bootstrap.cc:492] T 1ce7ef1ce9974f268da33890990b625d P 27da82a1c2d3446f95f7ecd5d9405358: Bootstrap starting.
I20260808 04:40:13.125005 23893 tablet_bootstrap.cc:492] T 1ce7ef1ce9974f268da33890990b625d P 7e50b4a48b5649a6ae754f453671aafc: Bootstrap starting.
I20260808 04:40:13.125386 23892 tablet_bootstrap.cc:492] T 1ce7ef1ce9974f268da33890990b625d P 9a10e81aa6db43e6b4cf0cdac04b5166: Bootstrap starting.
I20260808 04:40:13.125998 23891 tablet_bootstrap.cc:654] T 1ce7ef1ce9974f268da33890990b625d P 27da82a1c2d3446f95f7ecd5d9405358: Neither blocks nor log segments found. Creating new log.
I20260808 04:40:13.125999 23893 tablet_bootstrap.cc:654] T 1ce7ef1ce9974f268da33890990b625d P 7e50b4a48b5649a6ae754f453671aafc: Neither blocks nor log segments found. Creating new log.
I20260808 04:40:13.126317 23892 tablet_bootstrap.cc:654] T 1ce7ef1ce9974f268da33890990b625d P 9a10e81aa6db43e6b4cf0cdac04b5166: Neither blocks nor log segments found. Creating new log.
I20260808 04:40:13.127358 23893 tablet_bootstrap.cc:492] T 1ce7ef1ce9974f268da33890990b625d P 7e50b4a48b5649a6ae754f453671aafc: No bootstrap required, opened a new log
I20260808 04:40:13.127362 23891 tablet_bootstrap.cc:492] T 1ce7ef1ce9974f268da33890990b625d P 27da82a1c2d3446f95f7ecd5d9405358: No bootstrap required, opened a new log
I20260808 04:40:13.127451 23893 ts_tablet_manager.cc:1397] T 1ce7ef1ce9974f268da33890990b625d P 7e50b4a48b5649a6ae754f453671aafc: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260808 04:40:13.127462 23891 ts_tablet_manager.cc:1397] T 1ce7ef1ce9974f268da33890990b625d P 27da82a1c2d3446f95f7ecd5d9405358: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260808 04:40:13.127920 23893 raft_consensus.cc:348] T 1ce7ef1ce9974f268da33890990b625d P 7e50b4a48b5649a6ae754f453671aafc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27da82a1c2d3446f95f7ecd5d9405358" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 36077 } } peers { permanent_uuid: "9a10e81aa6db43e6b4cf0cdac04b5166" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 40955 } } peers { permanent_uuid: "7e50b4a48b5649a6ae754f453671aafc" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 38143 } }
I20260808 04:40:13.127920 23891 raft_consensus.cc:348] T 1ce7ef1ce9974f268da33890990b625d P 27da82a1c2d3446f95f7ecd5d9405358 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27da82a1c2d3446f95f7ecd5d9405358" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 36077 } } peers { permanent_uuid: "9a10e81aa6db43e6b4cf0cdac04b5166" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 40955 } } peers { permanent_uuid: "7e50b4a48b5649a6ae754f453671aafc" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 38143 } }
I20260808 04:40:13.128038 23893 raft_consensus.cc:374] T 1ce7ef1ce9974f268da33890990b625d P 7e50b4a48b5649a6ae754f453671aafc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:40:13.128038 23891 raft_consensus.cc:374] T 1ce7ef1ce9974f268da33890990b625d P 27da82a1c2d3446f95f7ecd5d9405358 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:40:13.128073 23893 raft_consensus.cc:729] T 1ce7ef1ce9974f268da33890990b625d P 7e50b4a48b5649a6ae754f453671aafc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e50b4a48b5649a6ae754f453671aafc, State: Initialized, Role: FOLLOWER
I20260808 04:40:13.128073 23891 raft_consensus.cc:729] T 1ce7ef1ce9974f268da33890990b625d P 27da82a1c2d3446f95f7ecd5d9405358 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 27da82a1c2d3446f95f7ecd5d9405358, State: Initialized, Role: FOLLOWER
I20260808 04:40:13.128211 23893 consensus_queue.cc:260] T 1ce7ef1ce9974f268da33890990b625d P 7e50b4a48b5649a6ae754f453671aafc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27da82a1c2d3446f95f7ecd5d9405358" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 36077 } } peers { permanent_uuid: "9a10e81aa6db43e6b4cf0cdac04b5166" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 40955 } } peers { permanent_uuid: "7e50b4a48b5649a6ae754f453671aafc" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 38143 } }
I20260808 04:40:13.128211 23891 consensus_queue.cc:260] T 1ce7ef1ce9974f268da33890990b625d P 27da82a1c2d3446f95f7ecd5d9405358 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27da82a1c2d3446f95f7ecd5d9405358" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 36077 } } peers { permanent_uuid: "9a10e81aa6db43e6b4cf0cdac04b5166" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 40955 } } peers { permanent_uuid: "7e50b4a48b5649a6ae754f453671aafc" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 38143 } }
I20260808 04:40:13.128489 23893 ts_tablet_manager.cc:1428] T 1ce7ef1ce9974f268da33890990b625d P 7e50b4a48b5649a6ae754f453671aafc: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260808 04:40:13.128502 23891 ts_tablet_manager.cc:1428] T 1ce7ef1ce9974f268da33890990b625d P 27da82a1c2d3446f95f7ecd5d9405358: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260808 04:40:13.129036 23892 tablet_bootstrap.cc:492] T 1ce7ef1ce9974f268da33890990b625d P 9a10e81aa6db43e6b4cf0cdac04b5166: No bootstrap required, opened a new log
I20260808 04:40:13.129135 23892 ts_tablet_manager.cc:1397] T 1ce7ef1ce9974f268da33890990b625d P 9a10e81aa6db43e6b4cf0cdac04b5166: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20260808 04:40:13.129562 23892 raft_consensus.cc:348] T 1ce7ef1ce9974f268da33890990b625d P 9a10e81aa6db43e6b4cf0cdac04b5166 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27da82a1c2d3446f95f7ecd5d9405358" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 36077 } } peers { permanent_uuid: "9a10e81aa6db43e6b4cf0cdac04b5166" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 40955 } } peers { permanent_uuid: "7e50b4a48b5649a6ae754f453671aafc" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 38143 } }
I20260808 04:40:13.129678 23892 raft_consensus.cc:374] T 1ce7ef1ce9974f268da33890990b625d P 9a10e81aa6db43e6b4cf0cdac04b5166 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:40:13.129724 23892 raft_consensus.cc:729] T 1ce7ef1ce9974f268da33890990b625d P 9a10e81aa6db43e6b4cf0cdac04b5166 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a10e81aa6db43e6b4cf0cdac04b5166, State: Initialized, Role: FOLLOWER
I20260808 04:40:13.129854 23892 consensus_queue.cc:260] T 1ce7ef1ce9974f268da33890990b625d P 9a10e81aa6db43e6b4cf0cdac04b5166 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27da82a1c2d3446f95f7ecd5d9405358" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 36077 } } peers { permanent_uuid: "9a10e81aa6db43e6b4cf0cdac04b5166" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 40955 } } peers { permanent_uuid: "7e50b4a48b5649a6ae754f453671aafc" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 38143 } }
I20260808 04:40:13.130276 23892 ts_tablet_manager.cc:1428] T 1ce7ef1ce9974f268da33890990b625d P 9a10e81aa6db43e6b4cf0cdac04b5166: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260808 04:40:13.174571 23897 raft_consensus.cc:482] T 1ce7ef1ce9974f268da33890990b625d P 9a10e81aa6db43e6b4cf0cdac04b5166 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 04:40:13.174768 23897 raft_consensus.cc:504] T 1ce7ef1ce9974f268da33890990b625d P 9a10e81aa6db43e6b4cf0cdac04b5166 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27da82a1c2d3446f95f7ecd5d9405358" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 36077 } } peers { permanent_uuid: "9a10e81aa6db43e6b4cf0cdac04b5166" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 40955 } } peers { permanent_uuid: "7e50b4a48b5649a6ae754f453671aafc" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 38143 } }
I20260808 04:40:13.176050 23897 leader_election.cc:288] T 1ce7ef1ce9974f268da33890990b625d P 9a10e81aa6db43e6b4cf0cdac04b5166 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 27da82a1c2d3446f95f7ecd5d9405358 (127.20.240.193:36077), 7e50b4a48b5649a6ae754f453671aafc (127.20.240.195:38143)
I20260808 04:40:13.180131 23899 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:13.176438 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.240.194:49793 (local address 127.20.240.193:36077)
0808 04:40:13.176759 (+ 321us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:13.176769 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:13.176785 (+ 16us) server_negotiation.cc:407] Connection header received
0808 04:40:13.176970 (+ 185us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:13.176975 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:13.177035 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:13.177144 (+ 109us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 04:40:13.177478 (+ 334us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:13.178025 (+ 547us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:13.179130 (+ 1105us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:13.179562 (+ 432us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:13.179695 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:13.179815 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:13.179913 (+ 98us) server_negotiation.cc:299] Negotiation successful
0808 04:40:13.179992 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":227,"thread_start_us":131,"threads_started":1}
I20260808 04:40:13.180145 23898 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:13.176292 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.193:36077 (local address 127.20.240.194:49793)
0808 04:40:13.176672 (+ 380us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:13.176690 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:13.176808 (+ 118us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:13.177199 (+ 391us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:13.177202 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:13.177223 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 04:40:13.177363 (+ 140us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:13.177369 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:13.178142 (+ 773us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:13.178146 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:13.179001 (+ 855us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:13.179012 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:13.179685 (+ 673us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:13.179689 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:13.179792 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:13.179816 (+ 24us) client_negotiation.cc:769] Sending connection context
0808 04:40:13.179888 (+ 72us) client_negotiation.cc:240] Negotiation successful
0808 04:40:13.179966 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":276,"mutex_wait_us":1,"spinlock_wait_cycles":768,"thread_start_us":159,"threads_started":1}
I20260808 04:40:13.180598 23900 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:13.176818 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.195:38143 (local address 127.20.240.194:43845)
0808 04:40:13.177103 (+ 285us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:13.177119 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:13.177249 (+ 130us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:13.177560 (+ 311us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:13.177563 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:13.177579 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 04:40:13.177704 (+ 125us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:13.177709 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:13.178503 (+ 794us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:13.178507 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:13.179320 (+ 813us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:13.179330 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:13.180105 (+ 775us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:13.180112 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:13.180238 (+ 126us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:13.180270 (+ 32us) client_negotiation.cc:769] Sending connection context
0808 04:40:13.180356 (+ 86us) client_negotiation.cc:240] Negotiation successful
0808 04:40:13.180426 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":205,"mutex_wait_us":20,"spinlock_wait_cycles":1408,"thread_start_us":108,"threads_started":1}
I20260808 04:40:13.180624 23427 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ce7ef1ce9974f268da33890990b625d" candidate_uuid: "9a10e81aa6db43e6b4cf0cdac04b5166" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27da82a1c2d3446f95f7ecd5d9405358" is_pre_election: true
I20260808 04:40:13.180801 23901 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:13.176937 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.240.194:43845 (local address 127.20.240.195:38143)
0808 04:40:13.177344 (+ 407us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:13.177358 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:13.177370 (+ 12us) server_negotiation.cc:407] Connection header received
0808 04:40:13.177415 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:13.177417 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:13.177456 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:13.177548 (+ 92us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 04:40:13.177814 (+ 266us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:13.178353 (+ 539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:13.179437 (+ 1084us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:13.179893 (+ 456us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:13.180054 (+ 161us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:13.180109 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:13.180456 (+ 347us) server_negotiation.cc:299] Negotiation successful
0808 04:40:13.180545 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":296,"thread_start_us":131,"threads_started":1}
I20260808 04:40:13.180804 23427 raft_consensus.cc:2454] T 1ce7ef1ce9974f268da33890990b625d P 27da82a1c2d3446f95f7ecd5d9405358 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a10e81aa6db43e6b4cf0cdac04b5166 in term 0.
I20260808 04:40:13.181305 23718 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ce7ef1ce9974f268da33890990b625d" candidate_uuid: "9a10e81aa6db43e6b4cf0cdac04b5166" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e50b4a48b5649a6ae754f453671aafc" is_pre_election: true
I20260808 04:40:13.181308 23506 leader_election.cc:302] T 1ce7ef1ce9974f268da33890990b625d P 9a10e81aa6db43e6b4cf0cdac04b5166 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27da82a1c2d3446f95f7ecd5d9405358, 9a10e81aa6db43e6b4cf0cdac04b5166; no voters:
I20260808 04:40:13.181468 23718 raft_consensus.cc:2454] T 1ce7ef1ce9974f268da33890990b625d P 7e50b4a48b5649a6ae754f453671aafc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a10e81aa6db43e6b4cf0cdac04b5166 in term 0.
I20260808 04:40:13.181597 23897 raft_consensus.cc:2781] T 1ce7ef1ce9974f268da33890990b625d P 9a10e81aa6db43e6b4cf0cdac04b5166 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 04:40:13.181667 23897 raft_consensus.cc:482] T 1ce7ef1ce9974f268da33890990b625d P 9a10e81aa6db43e6b4cf0cdac04b5166 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 04:40:13.181718 23897 raft_consensus.cc:3037] T 1ce7ef1ce9974f268da33890990b625d P 9a10e81aa6db43e6b4cf0cdac04b5166 [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:40:13.182750 23897 raft_consensus.cc:504] T 1ce7ef1ce9974f268da33890990b625d P 9a10e81aa6db43e6b4cf0cdac04b5166 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27da82a1c2d3446f95f7ecd5d9405358" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 36077 } } peers { permanent_uuid: "9a10e81aa6db43e6b4cf0cdac04b5166" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 40955 } } peers { permanent_uuid: "7e50b4a48b5649a6ae754f453671aafc" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 38143 } }
I20260808 04:40:13.183108 23897 leader_election.cc:288] T 1ce7ef1ce9974f268da33890990b625d P 9a10e81aa6db43e6b4cf0cdac04b5166 [CANDIDATE]: Term 1 election: Requested vote from peers 27da82a1c2d3446f95f7ecd5d9405358 (127.20.240.193:36077), 7e50b4a48b5649a6ae754f453671aafc (127.20.240.195:38143)
I20260808 04:40:13.183568 23427 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ce7ef1ce9974f268da33890990b625d" candidate_uuid: "9a10e81aa6db43e6b4cf0cdac04b5166" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27da82a1c2d3446f95f7ecd5d9405358"
I20260808 04:40:13.183571 23718 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ce7ef1ce9974f268da33890990b625d" candidate_uuid: "9a10e81aa6db43e6b4cf0cdac04b5166" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e50b4a48b5649a6ae754f453671aafc"
I20260808 04:40:13.183708 23718 raft_consensus.cc:3037] T 1ce7ef1ce9974f268da33890990b625d P 7e50b4a48b5649a6ae754f453671aafc [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:40:13.183701 23427 raft_consensus.cc:3037] T 1ce7ef1ce9974f268da33890990b625d P 27da82a1c2d3446f95f7ecd5d9405358 [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:40:13.184648 23427 raft_consensus.cc:2454] T 1ce7ef1ce9974f268da33890990b625d P 27da82a1c2d3446f95f7ecd5d9405358 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a10e81aa6db43e6b4cf0cdac04b5166 in term 1.
I20260808 04:40:13.184825 23718 raft_consensus.cc:2454] T 1ce7ef1ce9974f268da33890990b625d P 7e50b4a48b5649a6ae754f453671aafc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a10e81aa6db43e6b4cf0cdac04b5166 in term 1.
I20260808 04:40:13.185003 23506 leader_election.cc:302] T 1ce7ef1ce9974f268da33890990b625d P 9a10e81aa6db43e6b4cf0cdac04b5166 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27da82a1c2d3446f95f7ecd5d9405358, 9a10e81aa6db43e6b4cf0cdac04b5166; no voters:
I20260808 04:40:13.185235 23897 raft_consensus.cc:2781] T 1ce7ef1ce9974f268da33890990b625d P 9a10e81aa6db43e6b4cf0cdac04b5166 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 04:40:13.185482 23897 raft_consensus.cc:686] T 1ce7ef1ce9974f268da33890990b625d P 9a10e81aa6db43e6b4cf0cdac04b5166 [term 1 LEADER]: Becoming Leader. State: Replica: 9a10e81aa6db43e6b4cf0cdac04b5166, State: Running, Role: LEADER
I20260808 04:40:13.185765 23897 consensus_queue.cc:237] T 1ce7ef1ce9974f268da33890990b625d P 9a10e81aa6db43e6b4cf0cdac04b5166 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27da82a1c2d3446f95f7ecd5d9405358" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 36077 } } peers { permanent_uuid: "9a10e81aa6db43e6b4cf0cdac04b5166" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 40955 } } peers { permanent_uuid: "7e50b4a48b5649a6ae754f453671aafc" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 38143 } }
I20260808 04:40:13.188136 23263 catalog_manager.cc:5495] T 1ce7ef1ce9974f268da33890990b625d P 9a10e81aa6db43e6b4cf0cdac04b5166 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9a10e81aa6db43e6b4cf0cdac04b5166 (127.20.240.194). New cstate: current_term: 1 leader_uuid: "9a10e81aa6db43e6b4cf0cdac04b5166" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27da82a1c2d3446f95f7ecd5d9405358" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 36077 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9a10e81aa6db43e6b4cf0cdac04b5166" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 40955 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e50b4a48b5649a6ae754f453671aafc" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 38143 } health_report { overall_health: UNKNOWN } } }
I20260808 04:40:13.218519 23905 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:13.214523 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48986 (local address 127.20.240.194:40955)
0808 04:40:13.214850 (+ 327us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:13.214857 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:13.214870 (+ 13us) server_negotiation.cc:407] Connection header received
0808 04:40:13.214955 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:13.214957 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:13.215009 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:13.215115 (+ 106us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 04:40:13.215318 (+ 203us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:13.215928 (+ 610us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:13.217005 (+ 1077us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:13.217254 (+ 249us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:13.217333 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:13.217590 (+ 257us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 04:40:13.218088 (+ 498us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 04:40:13.218175 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:13.218243 (+ 68us) server_negotiation.cc:299] Negotiation successful
0808 04:40:13.218294 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":259,"thread_start_us":150,"threads_started":1}
I20260808 04:40:13.229420 23899 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:13.226031 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.240.194:56003 (local address 127.20.240.193:36077)
0808 04:40:13.226151 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:13.226154 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:13.226168 (+ 14us) server_negotiation.cc:407] Connection header received
0808 04:40:13.226222 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:13.226224 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:13.226266 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:13.226347 (+ 81us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 04:40:13.226605 (+ 258us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:13.227266 (+ 661us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:13.228338 (+ 1072us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:13.228559 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:13.228641 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:13.228960 (+ 319us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 04:40:13.229031 (+ 71us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 04:40:13.229089 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:13.229257 (+ 168us) server_negotiation.cc:299] Negotiation successful
0808 04:40:13.229306 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260808 04:40:13.229434 23908 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:13.225773 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.193:36077 (local address 127.20.240.194:56003)
0808 04:40:13.226060 (+ 287us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:13.226073 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:13.226156 (+ 83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:13.226382 (+ 226us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:13.226384 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:13.226391 (+ 7us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 04:40:13.226512 (+ 121us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:13.226517 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:13.227382 (+ 865us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:13.227385 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:13.228220 (+ 835us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:13.228232 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:13.228687 (+ 455us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:13.228690 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:13.228760 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:13.228805 (+ 45us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 04:40:13.229143 (+ 338us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 04:40:13.229170 (+ 27us) client_negotiation.cc:769] Sending connection context
0808 04:40:13.229232 (+ 62us) client_negotiation.cc:240] Negotiation successful
0808 04:40:13.229302 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":185,"thread_start_us":94,"threads_started":1}
I20260808 04:40:13.235680 23718 raft_consensus.cc:1261] T 1ce7ef1ce9974f268da33890990b625d P 7e50b4a48b5649a6ae754f453671aafc [term 1 FOLLOWER]: Refusing update from remote peer 9a10e81aa6db43e6b4cf0cdac04b5166: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 04:40:13.235679 23427 raft_consensus.cc:1261] T 1ce7ef1ce9974f268da33890990b625d P 27da82a1c2d3446f95f7ecd5d9405358 [term 1 FOLLOWER]: Refusing update from remote peer 9a10e81aa6db43e6b4cf0cdac04b5166: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 04:40:13.236109 23897 consensus_queue.cc:1035] T 1ce7ef1ce9974f268da33890990b625d P 9a10e81aa6db43e6b4cf0cdac04b5166 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e50b4a48b5649a6ae754f453671aafc" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 38143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 04:40:13.236337 23902 consensus_queue.cc:1035] T 1ce7ef1ce9974f268da33890990b625d P 9a10e81aa6db43e6b4cf0cdac04b5166 [LEADER]: Connected to new peer: Peer: permanent_uuid: "27da82a1c2d3446f95f7ecd5d9405358" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 36077 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 04:40:13.254552 23905 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:13.251002 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.240.193:46091 (local address 127.20.240.194:40955)
0808 04:40:13.251122 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:13.251128 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:13.251278 (+ 150us) server_negotiation.cc:407] Connection header received
0808 04:40:13.251382 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:13.251384 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:13.251424 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:13.251483 (+ 59us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 04:40:13.251634 (+ 151us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:13.252127 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:13.253075 (+ 948us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:13.253492 (+ 417us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:13.253591 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:13.254066 (+ 475us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 04:40:13.254137 (+ 71us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 04:40:13.254228 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:13.254388 (+ 160us) server_negotiation.cc:299] Negotiation successful
0808 04:40:13.254452 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260808 04:40:13.254554 23915 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:13.250935 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.194:40955 (local address 127.20.240.193:46091)
0808 04:40:13.251212 (+ 277us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:13.251225 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:13.251314 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:13.251486 (+ 172us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:13.251488 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:13.251493 (+ 5us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 04:40:13.251578 (+ 85us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:13.251582 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:13.252208 (+ 626us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:13.252210 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:13.252957 (+ 747us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:13.252968 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:13.253613 (+ 645us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:13.253616 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:13.253720 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:13.253754 (+ 34us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 04:40:13.254270 (+ 516us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 04:40:13.254278 (+ 8us) client_negotiation.cc:769] Sending connection context
0808 04:40:13.254345 (+ 67us) client_negotiation.cc:240] Negotiation successful
0808 04:40:13.254425 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":188,"thread_start_us":101,"threads_started":1}
I20260808 04:40:13.276274 23264 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:35052:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 04:40:13.276458 23264 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:35052:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 04:40:13.278784 23264 catalog_manager.cc:5782] T 00000000000000000000000000000000 P cc10ed40a4bf4b58aba57fcd15d2eb48: Sending DeleteTablet for 3 replicas of tablet 1ce7ef1ce9974f268da33890990b625d
I20260808 04:40:13.279589 23408 tablet_service.cc:1514] Processing DeleteTablet for tablet 1ce7ef1ce9974f268da33890990b625d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 04:40:13 UTC) from {username='kudu', principal='kudu/127.20.240.254@KRBTEST.COM'} at 127.0.0.1:33868
I20260808 04:40:13.279670 23698 tablet_service.cc:1514] Processing DeleteTablet for tablet 1ce7ef1ce9974f268da33890990b625d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 04:40:13 UTC) from {username='kudu', principal='kudu/127.20.240.254@KRBTEST.COM'} at 127.0.0.1:54070
I20260808 04:40:13.279827 23881 tablet_replica.cc:330] T 1ce7ef1ce9974f268da33890990b625d P 27da82a1c2d3446f95f7ecd5d9405358: stopping tablet replica
I20260808 04:40:13.279889 23882 tablet_replica.cc:330] T 1ce7ef1ce9974f268da33890990b625d P 7e50b4a48b5649a6ae754f453671aafc: stopping tablet replica
I20260808 04:40:13.279888 23555 tablet_service.cc:1514] Processing DeleteTablet for tablet 1ce7ef1ce9974f268da33890990b625d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 04:40:13 UTC) from {username='kudu', principal='kudu/127.20.240.254@KRBTEST.COM'} at 127.0.0.1:48970
I20260808 04:40:13.279994 23881 raft_consensus.cc:2229] T 1ce7ef1ce9974f268da33890990b625d P 27da82a1c2d3446f95f7ecd5d9405358 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 04:40:13.280000 23882 raft_consensus.cc:2229] T 1ce7ef1ce9974f268da33890990b625d P 7e50b4a48b5649a6ae754f453671aafc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 04:40:13.280115 23881 raft_consensus.cc:2258] T 1ce7ef1ce9974f268da33890990b625d P 27da82a1c2d3446f95f7ecd5d9405358 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 04:40:13.280117 23882 raft_consensus.cc:2258] T 1ce7ef1ce9974f268da33890990b625d P 7e50b4a48b5649a6ae754f453671aafc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 04:40:13.280077 23264 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:35052:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 04:40:13.280519 23264 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 04:40:13.281114 23882 ts_tablet_manager.cc:1905] T 1ce7ef1ce9974f268da33890990b625d P 7e50b4a48b5649a6ae754f453671aafc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 04:40:13.281279 23880 tablet_replica.cc:330] T 1ce7ef1ce9974f268da33890990b625d P 9a10e81aa6db43e6b4cf0cdac04b5166: stopping tablet replica
I20260808 04:40:13.281395 23880 raft_consensus.cc:2229] T 1ce7ef1ce9974f268da33890990b625d P 9a10e81aa6db43e6b4cf0cdac04b5166 [term 1 LEADER]: Raft consensus shutting down.
I20260808 04:40:13.281728 23880 raft_consensus.cc:2258] T 1ce7ef1ce9974f268da33890990b625d P 9a10e81aa6db43e6b4cf0cdac04b5166 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 04:40:13.282466 23880 ts_tablet_manager.cc:1905] T 1ce7ef1ce9974f268da33890990b625d P 9a10e81aa6db43e6b4cf0cdac04b5166: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 04:40:13.284180 23882 ts_tablet_manager.cc:1918] T 1ce7ef1ce9974f268da33890990b625d P 7e50b4a48b5649a6ae754f453671aafc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 04:40:13.284273 23882 log.cc:1196] T 1ce7ef1ce9974f268da33890990b625d P 7e50b4a48b5649a6ae754f453671aafc: Deleting WAL directory at /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786164000593138-21443-0/minicluster-data/ts-2/wal/wals/1ce7ef1ce9974f268da33890990b625d
I20260808 04:40:13.284876 23880 ts_tablet_manager.cc:1918] T 1ce7ef1ce9974f268da33890990b625d P 9a10e81aa6db43e6b4cf0cdac04b5166: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 04:40:13.284919 23881 ts_tablet_manager.cc:1905] T 1ce7ef1ce9974f268da33890990b625d P 27da82a1c2d3446f95f7ecd5d9405358: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 04:40:13.284969 23880 log.cc:1196] T 1ce7ef1ce9974f268da33890990b625d P 9a10e81aa6db43e6b4cf0cdac04b5166: Deleting WAL directory at /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786164000593138-21443-0/minicluster-data/ts-1/wal/wals/1ce7ef1ce9974f268da33890990b625d
I20260808 04:40:13.285300 23880 ts_tablet_manager.cc:1939] T 1ce7ef1ce9974f268da33890990b625d P 9a10e81aa6db43e6b4cf0cdac04b5166: Deleting consensus metadata
I20260808 04:40:13.286060 23252 catalog_manager.cc:4841] TS 9a10e81aa6db43e6b4cf0cdac04b5166 (127.20.240.194:40955): tablet 1ce7ef1ce9974f268da33890990b625d (table test-table [id=21f9d30bc7744905a618089d6a0d8608]) successfully deleted
I20260808 04:40:13.287670 23881 ts_tablet_manager.cc:1918] T 1ce7ef1ce9974f268da33890990b625d P 27da82a1c2d3446f95f7ecd5d9405358: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 04:40:13.287761 23881 log.cc:1196] T 1ce7ef1ce9974f268da33890990b625d P 27da82a1c2d3446f95f7ecd5d9405358: Deleting WAL directory at /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786164000593138-21443-0/minicluster-data/ts-0/wal/wals/1ce7ef1ce9974f268da33890990b625d
I20260808 04:40:13.288019 23881 ts_tablet_manager.cc:1939] T 1ce7ef1ce9974f268da33890990b625d P 27da82a1c2d3446f95f7ecd5d9405358: Deleting consensus metadata
I20260808 04:40:13.288790 23252 catalog_manager.cc:4841] TS 27da82a1c2d3446f95f7ecd5d9405358 (127.20.240.193:36077): tablet 1ce7ef1ce9974f268da33890990b625d (table test-table [id=21f9d30bc7744905a618089d6a0d8608]) successfully deleted
I20260808 04:40:13.289490 23882 ts_tablet_manager.cc:1939] T 1ce7ef1ce9974f268da33890990b625d P 7e50b4a48b5649a6ae754f453671aafc: Deleting consensus metadata
I20260808 04:40:13.291431 23252 catalog_manager.cc:4841] TS 7e50b4a48b5649a6ae754f453671aafc (127.20.240.195:38143): tablet 1ce7ef1ce9974f268da33890990b625d (table test-table [id=21f9d30bc7744905a618089d6a0d8608]) successfully deleted
I20260808 04:40:13.293301 23408 tablet_service.cc:1467] Processing CreateTablet for tablet d26adbe227e34ddcba0b09fbb16b2481 (DEFAULT_TABLE table=test-table [id=498d8fb14bca4e5ea3b7e9be81e5f47c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 04:40:13.293382 23698 tablet_service.cc:1467] Processing CreateTablet for tablet d26adbe227e34ddcba0b09fbb16b2481 (DEFAULT_TABLE table=test-table [id=498d8fb14bca4e5ea3b7e9be81e5f47c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 04:40:13.293579 23408 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d26adbe227e34ddcba0b09fbb16b2481. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:40:13.293653 23698 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d26adbe227e34ddcba0b09fbb16b2481. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:40:13.293617 23555 tablet_service.cc:1467] Processing CreateTablet for tablet d26adbe227e34ddcba0b09fbb16b2481 (DEFAULT_TABLE table=test-table [id=498d8fb14bca4e5ea3b7e9be81e5f47c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 04:40:13.293857 23555 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d26adbe227e34ddcba0b09fbb16b2481. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:40:13.296141 23893 tablet_bootstrap.cc:492] T d26adbe227e34ddcba0b09fbb16b2481 P 7e50b4a48b5649a6ae754f453671aafc: Bootstrap starting.
I20260808 04:40:13.296186 23891 tablet_bootstrap.cc:492] T d26adbe227e34ddcba0b09fbb16b2481 P 27da82a1c2d3446f95f7ecd5d9405358: Bootstrap starting.
I20260808 04:40:13.297076 23891 tablet_bootstrap.cc:654] T d26adbe227e34ddcba0b09fbb16b2481 P 27da82a1c2d3446f95f7ecd5d9405358: Neither blocks nor log segments found. Creating new log.
I20260808 04:40:13.297123 23893 tablet_bootstrap.cc:654] T d26adbe227e34ddcba0b09fbb16b2481 P 7e50b4a48b5649a6ae754f453671aafc: Neither blocks nor log segments found. Creating new log.
I20260808 04:40:13.297668 23892 tablet_bootstrap.cc:492] T d26adbe227e34ddcba0b09fbb16b2481 P 9a10e81aa6db43e6b4cf0cdac04b5166: Bootstrap starting.
I20260808 04:40:13.298679 23891 tablet_bootstrap.cc:492] T d26adbe227e34ddcba0b09fbb16b2481 P 27da82a1c2d3446f95f7ecd5d9405358: No bootstrap required, opened a new log
I20260808 04:40:13.298765 23891 ts_tablet_manager.cc:1397] T d26adbe227e34ddcba0b09fbb16b2481 P 27da82a1c2d3446f95f7ecd5d9405358: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260808 04:40:13.298797 23892 tablet_bootstrap.cc:654] T d26adbe227e34ddcba0b09fbb16b2481 P 9a10e81aa6db43e6b4cf0cdac04b5166: Neither blocks nor log segments found. Creating new log.
I20260808 04:40:13.299021 23893 tablet_bootstrap.cc:492] T d26adbe227e34ddcba0b09fbb16b2481 P 7e50b4a48b5649a6ae754f453671aafc: No bootstrap required, opened a new log
I20260808 04:40:13.299108 23893 ts_tablet_manager.cc:1397] T d26adbe227e34ddcba0b09fbb16b2481 P 7e50b4a48b5649a6ae754f453671aafc: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.002s
I20260808 04:40:13.299189 23891 raft_consensus.cc:348] T d26adbe227e34ddcba0b09fbb16b2481 P 27da82a1c2d3446f95f7ecd5d9405358 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27da82a1c2d3446f95f7ecd5d9405358" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 36077 } } peers { permanent_uuid: "9a10e81aa6db43e6b4cf0cdac04b5166" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 40955 } } peers { permanent_uuid: "7e50b4a48b5649a6ae754f453671aafc" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 38143 } }
I20260808 04:40:13.299320 23891 raft_consensus.cc:374] T d26adbe227e34ddcba0b09fbb16b2481 P 27da82a1c2d3446f95f7ecd5d9405358 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:40:13.299362 23891 raft_consensus.cc:729] T d26adbe227e34ddcba0b09fbb16b2481 P 27da82a1c2d3446f95f7ecd5d9405358 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 27da82a1c2d3446f95f7ecd5d9405358, State: Initialized, Role: FOLLOWER
I20260808 04:40:13.299479 23891 consensus_queue.cc:260] T d26adbe227e34ddcba0b09fbb16b2481 P 27da82a1c2d3446f95f7ecd5d9405358 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27da82a1c2d3446f95f7ecd5d9405358" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 36077 } } peers { permanent_uuid: "9a10e81aa6db43e6b4cf0cdac04b5166" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 40955 } } peers { permanent_uuid: "7e50b4a48b5649a6ae754f453671aafc" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 38143 } }
I20260808 04:40:13.299522 23893 raft_consensus.cc:348] T d26adbe227e34ddcba0b09fbb16b2481 P 7e50b4a48b5649a6ae754f453671aafc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27da82a1c2d3446f95f7ecd5d9405358" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 36077 } } peers { permanent_uuid: "9a10e81aa6db43e6b4cf0cdac04b5166" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 40955 } } peers { permanent_uuid: "7e50b4a48b5649a6ae754f453671aafc" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 38143 } }
I20260808 04:40:13.299633 23893 raft_consensus.cc:374] T d26adbe227e34ddcba0b09fbb16b2481 P 7e50b4a48b5649a6ae754f453671aafc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:40:13.299661 23893 raft_consensus.cc:729] T d26adbe227e34ddcba0b09fbb16b2481 P 7e50b4a48b5649a6ae754f453671aafc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e50b4a48b5649a6ae754f453671aafc, State: Initialized, Role: FOLLOWER
I20260808 04:40:13.299727 23891 ts_tablet_manager.cc:1428] T d26adbe227e34ddcba0b09fbb16b2481 P 27da82a1c2d3446f95f7ecd5d9405358: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260808 04:40:13.299767 23893 consensus_queue.cc:260] T d26adbe227e34ddcba0b09fbb16b2481 P 7e50b4a48b5649a6ae754f453671aafc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27da82a1c2d3446f95f7ecd5d9405358" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 36077 } } peers { permanent_uuid: "9a10e81aa6db43e6b4cf0cdac04b5166" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 40955 } } peers { permanent_uuid: "7e50b4a48b5649a6ae754f453671aafc" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 38143 } }
I20260808 04:40:13.300034 23893 ts_tablet_manager.cc:1428] T d26adbe227e34ddcba0b09fbb16b2481 P 7e50b4a48b5649a6ae754f453671aafc: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260808 04:40:13.312708 23892 tablet_bootstrap.cc:492] T d26adbe227e34ddcba0b09fbb16b2481 P 9a10e81aa6db43e6b4cf0cdac04b5166: No bootstrap required, opened a new log
I20260808 04:40:13.312835 23892 ts_tablet_manager.cc:1397] T d26adbe227e34ddcba0b09fbb16b2481 P 9a10e81aa6db43e6b4cf0cdac04b5166: Time spent bootstrapping tablet: real 0.015s user 0.000s sys 0.002s
I20260808 04:40:13.313376 23892 raft_consensus.cc:348] T d26adbe227e34ddcba0b09fbb16b2481 P 9a10e81aa6db43e6b4cf0cdac04b5166 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27da82a1c2d3446f95f7ecd5d9405358" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 36077 } } peers { permanent_uuid: "9a10e81aa6db43e6b4cf0cdac04b5166" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 40955 } } peers { permanent_uuid: "7e50b4a48b5649a6ae754f453671aafc" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 38143 } }
I20260808 04:40:13.313508 23892 raft_consensus.cc:374] T d26adbe227e34ddcba0b09fbb16b2481 P 9a10e81aa6db43e6b4cf0cdac04b5166 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:40:13.313539 23892 raft_consensus.cc:729] T d26adbe227e34ddcba0b09fbb16b2481 P 9a10e81aa6db43e6b4cf0cdac04b5166 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a10e81aa6db43e6b4cf0cdac04b5166, State: Initialized, Role: FOLLOWER
I20260808 04:40:13.313664 23892 consensus_queue.cc:260] T d26adbe227e34ddcba0b09fbb16b2481 P 9a10e81aa6db43e6b4cf0cdac04b5166 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27da82a1c2d3446f95f7ecd5d9405358" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 36077 } } peers { permanent_uuid: "9a10e81aa6db43e6b4cf0cdac04b5166" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 40955 } } peers { permanent_uuid: "7e50b4a48b5649a6ae754f453671aafc" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 38143 } }
I20260808 04:40:13.313920 23892 ts_tablet_manager.cc:1428] T d26adbe227e34ddcba0b09fbb16b2481 P 9a10e81aa6db43e6b4cf0cdac04b5166: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260808 04:40:13.408427 23870 raft_consensus.cc:482] T d26adbe227e34ddcba0b09fbb16b2481 P 7e50b4a48b5649a6ae754f453671aafc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 04:40:13.408597 23870 raft_consensus.cc:504] T d26adbe227e34ddcba0b09fbb16b2481 P 7e50b4a48b5649a6ae754f453671aafc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27da82a1c2d3446f95f7ecd5d9405358" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 36077 } } peers { permanent_uuid: "9a10e81aa6db43e6b4cf0cdac04b5166" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 40955 } } peers { permanent_uuid: "7e50b4a48b5649a6ae754f453671aafc" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 38143 } }
I20260808 04:40:13.409106 23870 leader_election.cc:288] T d26adbe227e34ddcba0b09fbb16b2481 P 7e50b4a48b5649a6ae754f453671aafc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 27da82a1c2d3446f95f7ecd5d9405358 (127.20.240.193:36077), 9a10e81aa6db43e6b4cf0cdac04b5166 (127.20.240.194:40955)
I20260808 04:40:13.409740 23427 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d26adbe227e34ddcba0b09fbb16b2481" candidate_uuid: "7e50b4a48b5649a6ae754f453671aafc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27da82a1c2d3446f95f7ecd5d9405358" is_pre_election: true
I20260808 04:40:13.409740 23575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d26adbe227e34ddcba0b09fbb16b2481" candidate_uuid: "7e50b4a48b5649a6ae754f453671aafc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a10e81aa6db43e6b4cf0cdac04b5166" is_pre_election: true
I20260808 04:40:13.409898 23427 raft_consensus.cc:2454] T d26adbe227e34ddcba0b09fbb16b2481 P 27da82a1c2d3446f95f7ecd5d9405358 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e50b4a48b5649a6ae754f453671aafc in term 0.
I20260808 04:40:13.409899 23575 raft_consensus.cc:2454] T d26adbe227e34ddcba0b09fbb16b2481 P 9a10e81aa6db43e6b4cf0cdac04b5166 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e50b4a48b5649a6ae754f453671aafc in term 0.
I20260808 04:40:13.410275 23651 leader_election.cc:302] T d26adbe227e34ddcba0b09fbb16b2481 P 7e50b4a48b5649a6ae754f453671aafc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e50b4a48b5649a6ae754f453671aafc, 9a10e81aa6db43e6b4cf0cdac04b5166; no voters:
I20260808 04:40:13.410614 23870 raft_consensus.cc:2781] T d26adbe227e34ddcba0b09fbb16b2481 P 7e50b4a48b5649a6ae754f453671aafc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 04:40:13.410678 23870 raft_consensus.cc:482] T d26adbe227e34ddcba0b09fbb16b2481 P 7e50b4a48b5649a6ae754f453671aafc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 04:40:13.410724 23870 raft_consensus.cc:3037] T d26adbe227e34ddcba0b09fbb16b2481 P 7e50b4a48b5649a6ae754f453671aafc [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:40:13.411811 23870 raft_consensus.cc:504] T d26adbe227e34ddcba0b09fbb16b2481 P 7e50b4a48b5649a6ae754f453671aafc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27da82a1c2d3446f95f7ecd5d9405358" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 36077 } } peers { permanent_uuid: "9a10e81aa6db43e6b4cf0cdac04b5166" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 40955 } } peers { permanent_uuid: "7e50b4a48b5649a6ae754f453671aafc" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 38143 } }
I20260808 04:40:13.412199 23870 leader_election.cc:288] T d26adbe227e34ddcba0b09fbb16b2481 P 7e50b4a48b5649a6ae754f453671aafc [CANDIDATE]: Term 1 election: Requested vote from peers 27da82a1c2d3446f95f7ecd5d9405358 (127.20.240.193:36077), 9a10e81aa6db43e6b4cf0cdac04b5166 (127.20.240.194:40955)
I20260808 04:40:13.412724 23427 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d26adbe227e34ddcba0b09fbb16b2481" candidate_uuid: "7e50b4a48b5649a6ae754f453671aafc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27da82a1c2d3446f95f7ecd5d9405358"
I20260808 04:40:13.412871 23427 raft_consensus.cc:3037] T d26adbe227e34ddcba0b09fbb16b2481 P 27da82a1c2d3446f95f7ecd5d9405358 [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:40:13.412832 23575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d26adbe227e34ddcba0b09fbb16b2481" candidate_uuid: "7e50b4a48b5649a6ae754f453671aafc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a10e81aa6db43e6b4cf0cdac04b5166"
I20260808 04:40:13.412968 23575 raft_consensus.cc:3037] T d26adbe227e34ddcba0b09fbb16b2481 P 9a10e81aa6db43e6b4cf0cdac04b5166 [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:40:13.414144 23575 raft_consensus.cc:2454] T d26adbe227e34ddcba0b09fbb16b2481 P 9a10e81aa6db43e6b4cf0cdac04b5166 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e50b4a48b5649a6ae754f453671aafc in term 1.
I20260808 04:40:13.414144 23427 raft_consensus.cc:2454] T d26adbe227e34ddcba0b09fbb16b2481 P 27da82a1c2d3446f95f7ecd5d9405358 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e50b4a48b5649a6ae754f453671aafc in term 1.
I20260808 04:40:13.414597 23651 leader_election.cc:302] T d26adbe227e34ddcba0b09fbb16b2481 P 7e50b4a48b5649a6ae754f453671aafc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27da82a1c2d3446f95f7ecd5d9405358, 7e50b4a48b5649a6ae754f453671aafc; no voters:
I20260808 04:40:13.414860 23870 raft_consensus.cc:2781] T d26adbe227e34ddcba0b09fbb16b2481 P 7e50b4a48b5649a6ae754f453671aafc [term 1 FOLLOWER]: Leader election won for term 1
I20260808 04:40:13.414988 23870 raft_consensus.cc:686] T d26adbe227e34ddcba0b09fbb16b2481 P 7e50b4a48b5649a6ae754f453671aafc [term 1 LEADER]: Becoming Leader. State: Replica: 7e50b4a48b5649a6ae754f453671aafc, State: Running, Role: LEADER
I20260808 04:40:13.415139 23870 consensus_queue.cc:237] T d26adbe227e34ddcba0b09fbb16b2481 P 7e50b4a48b5649a6ae754f453671aafc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27da82a1c2d3446f95f7ecd5d9405358" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 36077 } } peers { permanent_uuid: "9a10e81aa6db43e6b4cf0cdac04b5166" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 40955 } } peers { permanent_uuid: "7e50b4a48b5649a6ae754f453671aafc" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 38143 } }
I20260808 04:40:13.417366 23264 catalog_manager.cc:5495] T d26adbe227e34ddcba0b09fbb16b2481 P 7e50b4a48b5649a6ae754f453671aafc reported cstate change: term changed from 0 to 1, leader changed from <none> to 7e50b4a48b5649a6ae754f453671aafc (127.20.240.195). New cstate: current_term: 1 leader_uuid: "7e50b4a48b5649a6ae754f453671aafc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27da82a1c2d3446f95f7ecd5d9405358" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 36077 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9a10e81aa6db43e6b4cf0cdac04b5166" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 40955 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e50b4a48b5649a6ae754f453671aafc" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 38143 } health_report { overall_health: HEALTHY } } }
I20260808 04:40:13.435662 23901 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:13.432243 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54088 (local address 127.20.240.195:38143)
0808 04:40:13.432357 (+ 114us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:13.432361 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:13.432402 (+ 41us) server_negotiation.cc:407] Connection header received
0808 04:40:13.432545 (+ 143us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:13.432547 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:13.432589 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:13.432655 (+ 66us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 04:40:13.432903 (+ 248us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:13.433458 (+ 555us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:13.434718 (+ 1260us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:13.434933 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:13.435015 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:13.435278 (+ 263us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 04:40:13.435343 (+ 65us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 04:40:13.435396 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:13.435504 (+ 108us) server_negotiation.cc:299] Negotiation successful
0808 04:40:13.435552 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260808 04:40:13.442761 23427 raft_consensus.cc:1261] T d26adbe227e34ddcba0b09fbb16b2481 P 27da82a1c2d3446f95f7ecd5d9405358 [term 1 FOLLOWER]: Refusing update from remote peer 7e50b4a48b5649a6ae754f453671aafc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 04:40:13.442778 23575 raft_consensus.cc:1261] T d26adbe227e34ddcba0b09fbb16b2481 P 9a10e81aa6db43e6b4cf0cdac04b5166 [term 1 FOLLOWER]: Refusing update from remote peer 7e50b4a48b5649a6ae754f453671aafc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 04:40:13.443197 23870 consensus_queue.cc:1035] T d26adbe227e34ddcba0b09fbb16b2481 P 7e50b4a48b5649a6ae754f453671aafc [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a10e81aa6db43e6b4cf0cdac04b5166" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 40955 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 04:40:13.443456 23797 consensus_queue.cc:1035] T d26adbe227e34ddcba0b09fbb16b2481 P 7e50b4a48b5649a6ae754f453671aafc [LEADER]: Connected to new peer: Peer: permanent_uuid: "27da82a1c2d3446f95f7ecd5d9405358" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 36077 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260808 04:40:13.459471 23861 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260808 04:40:15.016394 23265 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:35052:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 04:40:15.016554 23265 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:35052:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 04:40:15.019241 23265 catalog_manager.cc:5782] T 00000000000000000000000000000000 P cc10ed40a4bf4b58aba57fcd15d2eb48: Sending DeleteTablet for 3 replicas of tablet d26adbe227e34ddcba0b09fbb16b2481
I20260808 04:40:15.019919 23408 tablet_service.cc:1514] Processing DeleteTablet for tablet d26adbe227e34ddcba0b09fbb16b2481 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 04:40:15 UTC) from {username='kudu', principal='kudu/127.20.240.254@KRBTEST.COM'} at 127.0.0.1:33868
I20260808 04:40:15.019948 23555 tablet_service.cc:1514] Processing DeleteTablet for tablet d26adbe227e34ddcba0b09fbb16b2481 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 04:40:15 UTC) from {username='kudu', principal='kudu/127.20.240.254@KRBTEST.COM'} at 127.0.0.1:48970
I20260808 04:40:15.020008 23698 tablet_service.cc:1514] Processing DeleteTablet for tablet d26adbe227e34ddcba0b09fbb16b2481 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 04:40:15 UTC) from {username='kudu', principal='kudu/127.20.240.254@KRBTEST.COM'} at 127.0.0.1:54070
I20260808 04:40:15.020335 23947 tablet_replica.cc:330] T d26adbe227e34ddcba0b09fbb16b2481 P 27da82a1c2d3446f95f7ecd5d9405358: stopping tablet replica
I20260808 04:40:15.020380 23948 tablet_replica.cc:330] T d26adbe227e34ddcba0b09fbb16b2481 P 7e50b4a48b5649a6ae754f453671aafc: stopping tablet replica
I20260808 04:40:15.020411 21443 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu with pid 23341
I20260808 04:40:15.022351 23948 raft_consensus.cc:2229] T d26adbe227e34ddcba0b09fbb16b2481 P 7e50b4a48b5649a6ae754f453671aafc [term 1 LEADER]: Raft consensus shutting down.
I20260808 04:40:15.022573 23946 tablet_replica.cc:330] T d26adbe227e34ddcba0b09fbb16b2481 P 9a10e81aa6db43e6b4cf0cdac04b5166: stopping tablet replica
I20260808 04:40:15.022642 23948 raft_consensus.cc:2258] T d26adbe227e34ddcba0b09fbb16b2481 P 7e50b4a48b5649a6ae754f453671aafc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 04:40:15.022732 23946 raft_consensus.cc:2229] T d26adbe227e34ddcba0b09fbb16b2481 P 9a10e81aa6db43e6b4cf0cdac04b5166 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 04:40:15.022867 23946 raft_consensus.cc:2258] T d26adbe227e34ddcba0b09fbb16b2481 P 9a10e81aa6db43e6b4cf0cdac04b5166 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 04:40:15.023689 23948 ts_tablet_manager.cc:1905] T d26adbe227e34ddcba0b09fbb16b2481 P 7e50b4a48b5649a6ae754f453671aafc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 04:40:15.025697 23946 ts_tablet_manager.cc:1905] T d26adbe227e34ddcba0b09fbb16b2481 P 9a10e81aa6db43e6b4cf0cdac04b5166: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 04:40:15.026870 23948 ts_tablet_manager.cc:1918] T d26adbe227e34ddcba0b09fbb16b2481 P 7e50b4a48b5649a6ae754f453671aafc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260808 04:40:15.026958 23948 log.cc:1196] T d26adbe227e34ddcba0b09fbb16b2481 P 7e50b4a48b5649a6ae754f453671aafc: Deleting WAL directory at /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786164000593138-21443-0/minicluster-data/ts-2/wal/wals/d26adbe227e34ddcba0b09fbb16b2481
I20260808 04:40:15.027272 23948 ts_tablet_manager.cc:1939] T d26adbe227e34ddcba0b09fbb16b2481 P 7e50b4a48b5649a6ae754f453671aafc: Deleting consensus metadata
I20260808 04:40:15.028165 23252 catalog_manager.cc:4841] TS 7e50b4a48b5649a6ae754f453671aafc (127.20.240.195:38143): tablet d26adbe227e34ddcba0b09fbb16b2481 (table test-table [id=498d8fb14bca4e5ea3b7e9be81e5f47c]) successfully deleted
I20260808 04:40:15.028586 23946 ts_tablet_manager.cc:1918] T d26adbe227e34ddcba0b09fbb16b2481 P 9a10e81aa6db43e6b4cf0cdac04b5166: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260808 04:40:15.028650 23946 log.cc:1196] T d26adbe227e34ddcba0b09fbb16b2481 P 9a10e81aa6db43e6b4cf0cdac04b5166: Deleting WAL directory at /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786164000593138-21443-0/minicluster-data/ts-1/wal/wals/d26adbe227e34ddcba0b09fbb16b2481
I20260808 04:40:15.028918 23946 ts_tablet_manager.cc:1939] T d26adbe227e34ddcba0b09fbb16b2481 P 9a10e81aa6db43e6b4cf0cdac04b5166: Deleting consensus metadata
I20260808 04:40:15.029639 23252 catalog_manager.cc:4841] TS 9a10e81aa6db43e6b4cf0cdac04b5166 (127.20.240.194:40955): tablet d26adbe227e34ddcba0b09fbb16b2481 (table test-table [id=498d8fb14bca4e5ea3b7e9be81e5f47c]) successfully deleted
W20260808 04:40:15.031349 23252 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.20.240.193:36077 (error 108)
I20260808 04:40:15.031445 21443 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu with pid 23487
I20260808 04:40:15.034024 23951 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:15.033370 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.193:36077 (local address 127.0.0.1:51468)
0808 04:40:15.033865 (+ 495us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:15.033938 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.240.193:36077: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":426,"thread_start_us":132,"threads_started":1}
W20260808 04:40:15.034166 23252 catalog_manager.cc:4584] TS 27da82a1c2d3446f95f7ecd5d9405358 (127.20.240.193:36077): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet d26adbe227e34ddcba0b09fbb16b2481: Network error: Client connection negotiation failed: client connection to 127.20.240.193:36077: connect: Connection refused (error 111)
I20260808 04:40:15.040076 21443 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu with pid 23632
I20260808 04:40:15.047796 21443 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu with pid 23231
2026-08-08T04:40:15Z chronyd exiting
[ OK ] SecurityITest.TxnSmokeWithDifferentUserTypes (6457 ms)
[ RUN ] SecurityITest.TestNoKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786164000593138-21443-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 04:40:15 dist-test-slave-vxj2 krb5kdc[23955](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 04:40:15 dist-test-slave-vxj2 krb5kdc[23955](info): set up 2 sockets
Aug 08 04:40:15 dist-test-slave-vxj2 krb5kdc[23955](info): commencing operation
krb5kdc: starting...
W20260808 04:40:16.139631 21443 mini_kdc.cc:121] Time spent starting KDC: real 1.066s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786164000593138-21443-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786164000593138-21443-0/krb5kdc/test-user.keytab.
Aug 08 04:40:16 dist-test-slave-vxj2 krb5kdc[23955](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164016, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T04:40:16Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T04:40:16Z Disabled control of system clock
WARNING: no policy specified for kudu/127.20.240.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.240.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.240.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.254.keytab.
Entry for principal kudu/127.20.240.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.254.keytab.
I20260808 04:40:16.264899 21443 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
/tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786164000593138-21443-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786164000593138-21443-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786164000593138-21443-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786164000593138-21443-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.240.254:46145
--webserver_interface=127.20.240.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.254.keytab
--principal=kudu/127.20.240.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.240.212:33985
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.240.254:46145
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786164000593138-21443-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786164000593138-21443-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786164000593138-21443-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 04:40:16.379478 23968 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:40:16.379765 23968 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:40:16.379869 23968 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:40:16.384003 23968 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 04:40:16.384063 23968 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:40:16.384083 23968 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:40:16.384099 23968 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 04:40:16.384161 23968 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 04:40:16.389530 23968 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.240.212:33985
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786164000593138-21443-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786164000593138-21443-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.240.254:46145
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.254.keytab
--principal=kudu/127.20.240.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.240.254:46145
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786164000593138-21443-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.240.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23968
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786164000593138-21443-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 04:05:18 UTC on ccycloud.quasar-drfdgt.root.comops.site
build id 4574101
I20260808 04:40:16.390590 23968 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:40:16.391664 23968 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260808 04:40:16.400647 23968 server_base.cc:1034] running on GCE node
W20260808 04:40:16.400677 23976 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:40:16.400696 23974 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:40:16.400677 23973 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:40:16.401698 23968 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:40:16.402868 23968 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:40:16.404055 23968 hybrid_clock.cc:648] HybridClock initialized: now 1786164016404028 us; error 42 us; skew 500 ppm
Aug 08 04:40:16 dist-test-slave-vxj2 krb5kdc[23955](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164016, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.240.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:40:16.406889 23968 init.cc:377] Logged in from keytab as kudu/127.20.240.254@KRBTEST.COM (short username kudu)
I20260808 04:40:16.407758 23968 webserver.cc:460] Webserver started at http://127.20.240.254:45611/ using document root <none> and password file <none>
I20260808 04:40:16.408289 23968 fs_manager.cc:359] Metadata directory not provided
I20260808 04:40:16.408355 23968 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:40:16.408526 23968 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 04:40:16.410633 23968 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786164000593138-21443-0/minicluster-data/master-0/data/instance:
uuid: "3d743533712540fbb64f9189f7275150"
format_stamp: "Formatted at 2026-08-08 04:40:16 on dist-test-slave-vxj2"
server_key: "cc3a1cfa10af369879c55817f49e8a1e"
server_key_iv: "788e108765ccda090c7f779323b7ec7c"
server_key_version: "encryptionkey@0"
I20260808 04:40:16.411233 23968 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786164000593138-21443-0/minicluster-data/master-0/wal/instance:
uuid: "3d743533712540fbb64f9189f7275150"
format_stamp: "Formatted at 2026-08-08 04:40:16 on dist-test-slave-vxj2"
server_key: "cc3a1cfa10af369879c55817f49e8a1e"
server_key_iv: "788e108765ccda090c7f779323b7ec7c"
server_key_version: "encryptionkey@0"
I20260808 04:40:16.415066 23968 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260808 04:40:16.417409 23983 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:16.418617 23968 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 04:40:16.418746 23968 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786164000593138-21443-0/minicluster-data/master-0/data,/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786164000593138-21443-0/minicluster-data/master-0/wal
uuid: "3d743533712540fbb64f9189f7275150"
format_stamp: "Formatted at 2026-08-08 04:40:16 on dist-test-slave-vxj2"
server_key: "cc3a1cfa10af369879c55817f49e8a1e"
server_key_iv: "788e108765ccda090c7f779323b7ec7c"
server_key_version: "encryptionkey@0"
I20260808 04:40:16.418864 23968 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786164000593138-21443-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786164000593138-21443-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786164000593138-21443-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:40:16.436522 23968 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:40:16.440127 23968 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:40:16.440362 23968 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:40:16.447971 23968 rpc_server.cc:307] RPC server started. Bound to: 127.20.240.254:46145
I20260808 04:40:16.448000 24039 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.240.254:46145 every 8 connection(s)
I20260808 04:40:16.449071 23968 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786164000593138-21443-0/minicluster-data/master-0/data/info.pb
I20260808 04:40:16.451692 21443 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu as pid 23968
I20260808 04:40:16.451795 21443 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786164000593138-21443-0/minicluster-data/master-0/wal/instance
I20260808 04:40:16.452103 21443 external_mini_cluster.cc:1428] Setting key e61036d03a851cb253ef723ddeb4a034
I20260808 04:40:16.452244 24040 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:40:16.459002 24040 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3d743533712540fbb64f9189f7275150: Bootstrap starting.
Aug 08 04:40:16 dist-test-slave-vxj2 krb5kdc[23955](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164016, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.240.254@KRBTEST.COM
I20260808 04:40:16.461568 24040 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3d743533712540fbb64f9189f7275150: Neither blocks nor log segments found. Creating new log.
I20260808 04:40:16.462436 24040 log.cc:824] T 00000000000000000000000000000000 P 3d743533712540fbb64f9189f7275150: Log is configured to *not* fsync() on all Append() calls
I20260808 04:40:16.464851 24040 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3d743533712540fbb64f9189f7275150: No bootstrap required, opened a new log
I20260808 04:40:16.467103 24043 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:16.453682 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47234 (local address 127.20.240.254:46145)
0808 04:40:16.454206 (+ 524us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:16.454222 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:16.454260 (+ 38us) server_negotiation.cc:407] Connection header received
0808 04:40:16.455092 (+ 832us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:16.455109 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:16.455433 (+ 324us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:16.455923 (+ 490us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:16.456747 (+ 824us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:16.457836 (+ 1089us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:16.458678 (+ 842us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:16.459209 (+ 531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:16.459368 (+ 159us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:16.462068 (+ 2700us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:40:16.462074 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:40:16.462091 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:40:16.462124 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:40:16.464042 (+ 1918us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:16.464586 (+ 544us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:16.464590 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:16.464595 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:16.464705 (+ 110us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:16.465095 (+ 390us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:16.465097 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:16.465098 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:16.465544 (+ 446us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:40:16.465688 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:16.466031 (+ 343us) server_negotiation.cc:299] Negotiation successful
0808 04:40:16.466311 (+ 280us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":381,"thread_start_us":149,"threads_started":1}
I20260808 04:40:16.469628 24040 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3d743533712540fbb64f9189f7275150 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3d743533712540fbb64f9189f7275150" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 46145 } }
I20260808 04:40:16.469870 24040 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3d743533712540fbb64f9189f7275150 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:40:16.469951 24040 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3d743533712540fbb64f9189f7275150 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d743533712540fbb64f9189f7275150, State: Initialized, Role: FOLLOWER
I20260808 04:40:16.470427 24040 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3d743533712540fbb64f9189f7275150 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3d743533712540fbb64f9189f7275150" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 46145 } }
I20260808 04:40:16.470587 24040 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3d743533712540fbb64f9189f7275150 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 04:40:16.470662 24040 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3d743533712540fbb64f9189f7275150 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 04:40:16.470785 24040 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3d743533712540fbb64f9189f7275150 [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:40:16.471853 24040 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3d743533712540fbb64f9189f7275150 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3d743533712540fbb64f9189f7275150" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 46145 } }
I20260808 04:40:16.472213 24040 leader_election.cc:302] T 00000000000000000000000000000000 P 3d743533712540fbb64f9189f7275150 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3d743533712540fbb64f9189f7275150; no voters:
I20260808 04:40:16.472554 24040 leader_election.cc:288] T 00000000000000000000000000000000 P 3d743533712540fbb64f9189f7275150 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 04:40:16.472746 24045 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3d743533712540fbb64f9189f7275150 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 04:40:16.473001 24045 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3d743533712540fbb64f9189f7275150 [term 1 LEADER]: Becoming Leader. State: Replica: 3d743533712540fbb64f9189f7275150, State: Running, Role: LEADER
I20260808 04:40:16.473354 24045 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3d743533712540fbb64f9189f7275150 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3d743533712540fbb64f9189f7275150" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 46145 } }
I20260808 04:40:16.473954 24040 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3d743533712540fbb64f9189f7275150 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 04:40:16.474907 24047 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3d743533712540fbb64f9189f7275150 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3d743533712540fbb64f9189f7275150. Latest consensus state: current_term: 1 leader_uuid: "3d743533712540fbb64f9189f7275150" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3d743533712540fbb64f9189f7275150" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 46145 } } }
I20260808 04:40:16.475036 24047 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3d743533712540fbb64f9189f7275150 [sys.catalog]: This master's current role is: LEADER
I20260808 04:40:16.475399 24053 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 04:40:16.476457 24046 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3d743533712540fbb64f9189f7275150 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3d743533712540fbb64f9189f7275150" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3d743533712540fbb64f9189f7275150" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 46145 } } }
I20260808 04:40:16.476570 24046 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3d743533712540fbb64f9189f7275150 [sys.catalog]: This master's current role is: LEADER
I20260808 04:40:16.478502 24053 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 04:40:16.484339 24053 catalog_manager.cc:1347] Generated new cluster ID: d4eccc4a3d9b4578a3167bc8c6d3dfa5
I20260808 04:40:16.484426 24053 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 04:40:16.504205 24053 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 04:40:16.505678 24053 catalog_manager.cc:1504] Loading token signing keys...
I20260808 04:40:16.519440 24053 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3d743533712540fbb64f9189f7275150: Generated new TSK 0
I20260808 04:40:16.520429 24053 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.20.240.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.240.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.240.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.193.keytab.
Entry for principal kudu/127.20.240.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.193.keytab.
I20260808 04:40:16.552142 21443 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
/tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786164000593138-21443-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786164000593138-21443-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786164000593138-21443-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786164000593138-21443-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.240.193:0
--local_ip_for_outbound_sockets=127.20.240.193
--webserver_interface=127.20.240.193
--webserver_port=0
--tserver_master_addrs=127.20.240.254:46145
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.193.keytab
--principal=kudu/127.20.240.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.240.212:33985
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786164000593138-21443-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786164000593138-21443-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786164000593138-21443-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 04:40:16.669488 24066 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:40:16.669800 24066 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:40:16.669874 24066 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:40:16.674171 24066 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:40:16.674264 24066 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:40:16.674371 24066 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.240.193
I20260808 04:40:16.680310 24066 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.240.212:33985
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786164000593138-21443-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786164000593138-21443-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.193.keytab
--principal=kudu/127.20.240.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.240.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786164000593138-21443-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.240.193
--webserver_port=0
--tserver_master_addrs=127.20.240.254:46145
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24066
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.240.193
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786164000593138-21443-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 04:05:18 UTC on ccycloud.quasar-drfdgt.root.comops.site
build id 4574101
I20260808 04:40:16.681571 24066 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:40:16.682663 24066 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:40:16.692644 24071 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:40:16.692662 24074 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:40:16.692829 24066 server_base.cc:1034] running on GCE node
W20260808 04:40:16.693073 24072 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:40:16.693526 24066 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:40:16.694198 24066 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:40:16.695379 24066 hybrid_clock.cc:648] HybridClock initialized: now 1786164016695356 us; error 33 us; skew 500 ppm
Aug 08 04:40:16 dist-test-slave-vxj2 krb5kdc[23955](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164016, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.240.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:40:16.698268 24066 init.cc:377] Logged in from keytab as kudu/127.20.240.193@KRBTEST.COM (short username kudu)
I20260808 04:40:16.699179 24066 webserver.cc:460] Webserver started at http://127.20.240.193:35503/ using document root <none> and password file <none>
I20260808 04:40:16.699707 24066 fs_manager.cc:359] Metadata directory not provided
I20260808 04:40:16.699767 24066 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:40:16.699947 24066 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 04:40:16.702181 24066 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786164000593138-21443-0/minicluster-data/ts-0/data/instance:
uuid: "8dd2a18fa38c427ab8531a29c9651dc7"
format_stamp: "Formatted at 2026-08-08 04:40:16 on dist-test-slave-vxj2"
server_key: "8e6d2af69c28b65e3df5b098c7a47cc0"
server_key_iv: "1ab64644e3e3be56f3bb423dad81085f"
server_key_version: "encryptionkey@0"
I20260808 04:40:16.702735 24066 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786164000593138-21443-0/minicluster-data/ts-0/wal/instance:
uuid: "8dd2a18fa38c427ab8531a29c9651dc7"
format_stamp: "Formatted at 2026-08-08 04:40:16 on dist-test-slave-vxj2"
server_key: "8e6d2af69c28b65e3df5b098c7a47cc0"
server_key_iv: "1ab64644e3e3be56f3bb423dad81085f"
server_key_version: "encryptionkey@0"
I20260808 04:40:16.706521 24066 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260808 04:40:16.709136 24081 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:16.710460 24066 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 04:40:16.710584 24066 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786164000593138-21443-0/minicluster-data/ts-0/data,/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786164000593138-21443-0/minicluster-data/ts-0/wal
uuid: "8dd2a18fa38c427ab8531a29c9651dc7"
format_stamp: "Formatted at 2026-08-08 04:40:16 on dist-test-slave-vxj2"
server_key: "8e6d2af69c28b65e3df5b098c7a47cc0"
server_key_iv: "1ab64644e3e3be56f3bb423dad81085f"
server_key_version: "encryptionkey@0"
I20260808 04:40:16.710695 24066 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786164000593138-21443-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786164000593138-21443-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786164000593138-21443-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:40:16.736923 24066 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:40:16.740296 24066 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:40:16.740512 24066 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:40:16.741197 24066 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 04:40:16.742089 24066 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 04:40:16.742141 24066 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:16.742202 24066 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 04:40:16.742237 24066 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:16.751668 24066 rpc_server.cc:307] RPC server started. Bound to: 127.20.240.193:43381
I20260808 04:40:16.751710 24200 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.240.193:43381 every 8 connection(s)
I20260808 04:40:16.752620 24066 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786164000593138-21443-0/minicluster-data/ts-0/data/info.pb
I20260808 04:40:16.759758 21443 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu as pid 24066
I20260808 04:40:16.759948 21443 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786164000593138-21443-0/minicluster-data/ts-0/wal/instance
I20260808 04:40:16.760238 21443 external_mini_cluster.cc:1428] Setting key a44700dcb6029c7417df9ab2ed8e56ea
Aug 08 04:40:16 dist-test-slave-vxj2 krb5kdc[23955](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164016, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.240.193@KRBTEST.COM for kudu/127.20.240.254@KRBTEST.COM
I20260808 04:40:16.767243 24043 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:16.754636 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.240.193:34213 (local address 127.20.240.254:46145)
0808 04:40:16.754806 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:16.754810 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:16.755699 (+ 889us) server_negotiation.cc:407] Connection header received
0808 04:40:16.757005 (+ 1306us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:16.757008 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:16.757061 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:16.757170 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:16.758550 (+ 1380us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:16.759109 (+ 559us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:16.760345 (+ 1236us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:16.760692 (+ 347us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:16.760842 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:16.763601 (+ 2759us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:40:16.763604 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:40:16.763607 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:40:16.763636 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:40:16.765108 (+ 1472us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:16.765674 (+ 566us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:16.765678 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:16.765680 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:16.765764 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:16.766111 (+ 347us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:16.766115 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:16.766117 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:16.766310 (+ 193us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:40:16.766419 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:16.766944 (+ 525us) server_negotiation.cc:299] Negotiation successful
0808 04:40:16.767078 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260808 04:40:16.768085 24203 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:16.755055 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:46145 (local address 127.20.240.193:34213)
0808 04:40:16.755531 (+ 476us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:16.755576 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:16.756775 (+ 1199us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:16.757485 (+ 710us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:16.757492 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:16.757905 (+ 413us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:40:16.758387 (+ 482us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:16.758400 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:16.759229 (+ 829us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:16.759231 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:16.760207 (+ 976us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:16.760217 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:16.760867 (+ 650us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:16.760872 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:16.761065 (+ 193us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:16.761801 (+ 736us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:40:16.761825 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:40:16.763430 (+ 1605us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:40:16.765272 (+ 1842us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:16.765279 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:16.765295 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:16.765565 (+ 270us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:16.765854 (+ 289us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:16.765860 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:16.765865 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:16.766014 (+ 149us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:16.766419 (+ 405us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:40:16.766428 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:40:16.766700 (+ 272us) client_negotiation.cc:769] Sending connection context
0808 04:40:16.766903 (+ 203us) client_negotiation.cc:240] Negotiation successful
0808 04:40:16.767243 (+ 340us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":285,"thread_start_us":134,"threads_started":1}
I20260808 04:40:16.769483 24201 heartbeater.cc:347] Connected to a master server at 127.20.240.254:46145
I20260808 04:40:16.769726 24201 heartbeater.cc:464] Registering TS with master...
WARNING: no policy specified for kudu/127.20.240.194@KRBTEST.COM; defaulting to no policy
I20260808 04:40:16.770269 24201 heartbeater.cc:511] Master 127.20.240.254:46145 requested a full tablet report, sending...
I20260808 04:40:16.771876 24001 ts_manager.cc:194] Registered new tserver with Master: 8dd2a18fa38c427ab8531a29c9651dc7 (127.20.240.193:43381)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.240.194@KRBTEST.COM" created.
I20260808 04:40:16.773233 24001 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.240.193@KRBTEST.COM'} at 127.20.240.193:34213
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.240.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.194.keytab.
Entry for principal kudu/127.20.240.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.194.keytab.
I20260808 04:40:16.788707 21443 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
/tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786164000593138-21443-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786164000593138-21443-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786164000593138-21443-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786164000593138-21443-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.240.194:0
--local_ip_for_outbound_sockets=127.20.240.194
--webserver_interface=127.20.240.194
--webserver_port=0
--tserver_master_addrs=127.20.240.254:46145
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.194.keytab
--principal=kudu/127.20.240.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.240.212:33985
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786164000593138-21443-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786164000593138-21443-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786164000593138-21443-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 04:40:16.902890 24206 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:40:16.903167 24206 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:40:16.903254 24206 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:40:16.908100 24206 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:40:16.908170 24206 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:40:16.908279 24206 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.240.194
I20260808 04:40:16.913988 24206 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.240.212:33985
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786164000593138-21443-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786164000593138-21443-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.194.keytab
--principal=kudu/127.20.240.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.240.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786164000593138-21443-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.240.194
--webserver_port=0
--tserver_master_addrs=127.20.240.254:46145
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24206
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.240.194
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786164000593138-21443-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 04:05:18 UTC on ccycloud.quasar-drfdgt.root.comops.site
build id 4574101
I20260808 04:40:16.915164 24206 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:40:16.916189 24206 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:40:16.925637 24211 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:40:16.925661 24212 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:40:16.925654 24214 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:40:16.925719 24206 server_base.cc:1034] running on GCE node
I20260808 04:40:16.926283 24206 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:40:16.926945 24206 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:40:16.928155 24206 hybrid_clock.cc:648] HybridClock initialized: now 1786164016928140 us; error 29 us; skew 500 ppm
Aug 08 04:40:16 dist-test-slave-vxj2 krb5kdc[23955](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164016, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.240.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:40:16.931016 24206 init.cc:377] Logged in from keytab as kudu/127.20.240.194@KRBTEST.COM (short username kudu)
I20260808 04:40:16.931926 24206 webserver.cc:460] Webserver started at http://127.20.240.194:43137/ using document root <none> and password file <none>
I20260808 04:40:16.932512 24206 fs_manager.cc:359] Metadata directory not provided
I20260808 04:40:16.932601 24206 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:40:16.932829 24206 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 04:40:16.934988 24206 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786164000593138-21443-0/minicluster-data/ts-1/data/instance:
uuid: "629e45193a21439f817c8f3f28e5721d"
format_stamp: "Formatted at 2026-08-08 04:40:16 on dist-test-slave-vxj2"
server_key: "2066bd52f134e69847012477a3c8bada"
server_key_iv: "ecff62fb59783c79e2e54b714f045991"
server_key_version: "encryptionkey@0"
I20260808 04:40:16.935575 24206 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786164000593138-21443-0/minicluster-data/ts-1/wal/instance:
uuid: "629e45193a21439f817c8f3f28e5721d"
format_stamp: "Formatted at 2026-08-08 04:40:16 on dist-test-slave-vxj2"
server_key: "2066bd52f134e69847012477a3c8bada"
server_key_iv: "ecff62fb59783c79e2e54b714f045991"
server_key_version: "encryptionkey@0"
I20260808 04:40:16.939536 24206 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260808 04:40:16.942131 24221 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:16.943395 24206 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 04:40:16.943529 24206 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786164000593138-21443-0/minicluster-data/ts-1/data,/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786164000593138-21443-0/minicluster-data/ts-1/wal
uuid: "629e45193a21439f817c8f3f28e5721d"
format_stamp: "Formatted at 2026-08-08 04:40:16 on dist-test-slave-vxj2"
server_key: "2066bd52f134e69847012477a3c8bada"
server_key_iv: "ecff62fb59783c79e2e54b714f045991"
server_key_version: "encryptionkey@0"
I20260808 04:40:16.943643 24206 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786164000593138-21443-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786164000593138-21443-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786164000593138-21443-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:40:16.956794 24206 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:40:16.959869 24206 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:40:16.960080 24206 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:40:16.960682 24206 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 04:40:16.961575 24206 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 04:40:16.961643 24206 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:16.961714 24206 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 04:40:16.961755 24206 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:16.970752 24206 rpc_server.cc:307] RPC server started. Bound to: 127.20.240.194:36359
I20260808 04:40:16.970775 24341 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.240.194:36359 every 8 connection(s)
I20260808 04:40:16.971676 24206 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786164000593138-21443-0/minicluster-data/ts-1/data/info.pb
I20260808 04:40:16.975981 21443 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu as pid 24206
I20260808 04:40:16.976125 21443 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786164000593138-21443-0/minicluster-data/ts-1/wal/instance
I20260808 04:40:16.976435 21443 external_mini_cluster.cc:1428] Setting key 0a4c9778db1eccb26d2b0e5d89e290f0
Aug 08 04:40:16 dist-test-slave-vxj2 krb5kdc[23955](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164016, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.240.194@KRBTEST.COM for kudu/127.20.240.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.20.240.195@KRBTEST.COM; defaulting to no policy
I20260808 04:40:16.987725 24043 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:16.973702 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.240.194:49615 (local address 127.20.240.254:46145)
0808 04:40:16.973970 (+ 268us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:16.973975 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:16.975109 (+ 1134us) server_negotiation.cc:407] Connection header received
0808 04:40:16.976789 (+ 1680us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:16.976793 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:16.976866 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:16.976978 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:16.978406 (+ 1428us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:16.978950 (+ 544us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:16.980231 (+ 1281us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:16.980460 (+ 229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:16.980576 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:16.983720 (+ 3144us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:40:16.983723 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:40:16.983725 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:40:16.983755 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:40:16.985358 (+ 1603us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:16.986039 (+ 681us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:16.986043 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:16.986045 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:16.986139 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:16.986544 (+ 405us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:16.986546 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:16.986548 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:16.986776 (+ 228us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:40:16.986859 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:16.987481 (+ 622us) server_negotiation.cc:299] Negotiation successful
0808 04:40:16.987595 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":109}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.240.195@KRBTEST.COM" created.
I20260808 04:40:16.988735 24344 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:16.974349 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:46145 (local address 127.20.240.194:49615)
0808 04:40:16.974882 (+ 533us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:16.974975 (+ 93us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:16.976502 (+ 1527us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:16.977218 (+ 716us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:16.977227 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:16.977634 (+ 407us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:40:16.978259 (+ 625us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:16.978274 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:16.979083 (+ 809us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:16.979086 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:16.980091 (+ 1005us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:16.980102 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:16.980631 (+ 529us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:16.980635 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:16.980813 (+ 178us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:16.981523 (+ 710us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:40:16.981541 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:40:16.983503 (+ 1962us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:40:16.985491 (+ 1988us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:16.985502 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:16.985525 (+ 23us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:16.985912 (+ 387us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:16.986232 (+ 320us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:16.986237 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:16.986240 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:16.986445 (+ 205us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:16.986907 (+ 462us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:40:16.986913 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:40:16.987242 (+ 329us) client_negotiation.cc:769] Sending connection context
0808 04:40:16.987417 (+ 175us) client_negotiation.cc:240] Negotiation successful
0808 04:40:16.987699 (+ 282us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":325,"thread_start_us":172,"threads_started":1}
I20260808 04:40:16.989996 24342 heartbeater.cc:347] Connected to a master server at 127.20.240.254:46145
I20260808 04:40:16.990257 24342 heartbeater.cc:464] Registering TS with master...
I20260808 04:40:16.990800 24342 heartbeater.cc:511] Master 127.20.240.254:46145 requested a full tablet report, sending...
I20260808 04:40:16.991961 24001 ts_manager.cc:194] Registered new tserver with Master: 629e45193a21439f817c8f3f28e5721d (127.20.240.194:36359)
I20260808 04:40:16.992552 24001 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.240.194@KRBTEST.COM'} at 127.20.240.194:49615
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.240.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.195.keytab.
Entry for principal kudu/127.20.240.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.195.keytab.
I20260808 04:40:17.005095 21443 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
/tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786164000593138-21443-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786164000593138-21443-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786164000593138-21443-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786164000593138-21443-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.240.195:0
--local_ip_for_outbound_sockets=127.20.240.195
--webserver_interface=127.20.240.195
--webserver_port=0
--tserver_master_addrs=127.20.240.254:46145
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.195.keytab
--principal=kudu/127.20.240.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.240.212:33985
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786164000593138-21443-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786164000593138-21443-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786164000593138-21443-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 04:40:17.118867 24347 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:40:17.119187 24347 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:40:17.119261 24347 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:40:17.123576 24347 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:40:17.123659 24347 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:40:17.123752 24347 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.240.195
I20260808 04:40:17.129324 24347 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.240.212:33985
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786164000593138-21443-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786164000593138-21443-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.195.keytab
--principal=kudu/127.20.240.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.240.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786164000593138-21443-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.240.195
--webserver_port=0
--tserver_master_addrs=127.20.240.254:46145
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24347
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.240.195
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786164000593138-21443-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 04:05:18 UTC on ccycloud.quasar-drfdgt.root.comops.site
build id 4574101
I20260808 04:40:17.130478 24347 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:40:17.131559 24347 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:40:17.141376 24353 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:40:17.141362 24352 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:40:17.141589 24347 server_base.cc:1034] running on GCE node
W20260808 04:40:17.141376 24356 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:40:17.142167 24347 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:40:17.142884 24347 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:40:17.144074 24347 hybrid_clock.cc:648] HybridClock initialized: now 1786164017144036 us; error 50 us; skew 500 ppm
Aug 08 04:40:17 dist-test-slave-vxj2 krb5kdc[23955](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164017, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.240.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:40:17.147071 24347 init.cc:377] Logged in from keytab as kudu/127.20.240.195@KRBTEST.COM (short username kudu)
I20260808 04:40:17.148039 24347 webserver.cc:460] Webserver started at http://127.20.240.195:42087/ using document root <none> and password file <none>
I20260808 04:40:17.148603 24347 fs_manager.cc:359] Metadata directory not provided
I20260808 04:40:17.148694 24347 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:40:17.148934 24347 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 04:40:17.151077 24347 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786164000593138-21443-0/minicluster-data/ts-2/data/instance:
uuid: "b69c7d3fd3f14d34b3cfa6bb0e0ab65f"
format_stamp: "Formatted at 2026-08-08 04:40:17 on dist-test-slave-vxj2"
server_key: "270e67e3fa977a472f3c918bdd085240"
server_key_iv: "4003522d38b9bbb1c821ea79d181864b"
server_key_version: "encryptionkey@0"
I20260808 04:40:17.151674 24347 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786164000593138-21443-0/minicluster-data/ts-2/wal/instance:
uuid: "b69c7d3fd3f14d34b3cfa6bb0e0ab65f"
format_stamp: "Formatted at 2026-08-08 04:40:17 on dist-test-slave-vxj2"
server_key: "270e67e3fa977a472f3c918bdd085240"
server_key_iv: "4003522d38b9bbb1c821ea79d181864b"
server_key_version: "encryptionkey@0"
I20260808 04:40:17.155756 24347 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260808 04:40:17.158489 24363 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:17.159705 24347 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260808 04:40:17.159848 24347 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786164000593138-21443-0/minicluster-data/ts-2/data,/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786164000593138-21443-0/minicluster-data/ts-2/wal
uuid: "b69c7d3fd3f14d34b3cfa6bb0e0ab65f"
format_stamp: "Formatted at 2026-08-08 04:40:17 on dist-test-slave-vxj2"
server_key: "270e67e3fa977a472f3c918bdd085240"
server_key_iv: "4003522d38b9bbb1c821ea79d181864b"
server_key_version: "encryptionkey@0"
I20260808 04:40:17.159981 24347 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786164000593138-21443-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786164000593138-21443-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786164000593138-21443-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:40:17.178191 24347 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:40:17.181430 24347 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:40:17.181648 24347 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:40:17.182309 24347 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 04:40:17.183146 24347 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 04:40:17.183215 24347 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:17.183284 24347 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 04:40:17.183331 24347 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:17.192258 24347 rpc_server.cc:307] RPC server started. Bound to: 127.20.240.195:39777
I20260808 04:40:17.192282 24481 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.240.195:39777 every 8 connection(s)
I20260808 04:40:17.193172 24347 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786164000593138-21443-0/minicluster-data/ts-2/data/info.pb
I20260808 04:40:17.202138 21443 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu as pid 24347
I20260808 04:40:17.202294 21443 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786164000593138-21443-0/minicluster-data/ts-2/wal/instance
I20260808 04:40:17.202596 21443 external_mini_cluster.cc:1428] Setting key 0d244dc9d0bd506d0516bba1f722786a
Aug 08 04:40:17 dist-test-slave-vxj2 krb5kdc[23955](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164017, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.240.195@KRBTEST.COM for kudu/127.20.240.254@KRBTEST.COM
I20260808 04:40:17.207520 24043 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:17.194968 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.240.195:52543 (local address 127.20.240.254:46145)
0808 04:40:17.195112 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:17.195116 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:17.195900 (+ 784us) server_negotiation.cc:407] Connection header received
0808 04:40:17.197246 (+ 1346us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:17.197249 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:17.197314 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:17.197434 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:17.198630 (+ 1196us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:17.199177 (+ 547us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:17.200328 (+ 1151us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:17.200566 (+ 238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:17.200680 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:17.203450 (+ 2770us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:40:17.203454 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:40:17.203456 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:40:17.203494 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:40:17.205267 (+ 1773us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:17.205826 (+ 559us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:17.205830 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:17.205832 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:17.205921 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:17.206312 (+ 391us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:17.206315 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:17.206317 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:17.206536 (+ 219us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:40:17.206647 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:17.207198 (+ 551us) server_negotiation.cc:299] Negotiation successful
0808 04:40:17.207351 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260808 04:40:17.208482 24484 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:17.195287 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:46145 (local address 127.20.240.195:52543)
0808 04:40:17.195740 (+ 453us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:17.195782 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:17.196991 (+ 1209us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:17.197622 (+ 631us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:17.197630 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:17.197984 (+ 354us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:40:17.198474 (+ 490us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:17.198488 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:17.199304 (+ 816us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:17.199308 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:17.200188 (+ 880us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:17.200198 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:17.200729 (+ 531us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:17.200733 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:17.200915 (+ 182us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:17.201521 (+ 606us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:40:17.201538 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:40:17.203262 (+ 1724us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:40:17.205384 (+ 2122us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:17.205391 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:17.205416 (+ 25us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:17.205709 (+ 293us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:17.206013 (+ 304us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:17.206016 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:17.206018 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:17.206187 (+ 169us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:17.206647 (+ 460us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:40:17.206656 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:40:17.206940 (+ 284us) client_negotiation.cc:769] Sending connection context
0808 04:40:17.207153 (+ 213us) client_negotiation.cc:240] Negotiation successful
0808 04:40:17.207516 (+ 363us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":272,"thread_start_us":122,"threads_started":1}
I20260808 04:40:17.209831 24482 heartbeater.cc:347] Connected to a master server at 127.20.240.254:46145
I20260808 04:40:17.210135 24482 heartbeater.cc:464] Registering TS with master...
I20260808 04:40:17.210664 24482 heartbeater.cc:511] Master 127.20.240.254:46145 requested a full tablet report, sending...
I20260808 04:40:17.211840 24001 ts_manager.cc:194] Registered new tserver with Master: b69c7d3fd3f14d34b3cfa6bb0e0ab65f (127.20.240.195:39777)
I20260808 04:40:17.212527 24001 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.240.195@KRBTEST.COM'} at 127.20.240.195:52543
I20260808 04:40:17.216919 21443 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260808 04:40:17.231449 24043 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 04:40:17.229774 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47236 (local address 127.20.240.254:46145)
0808 04:40:17.229916 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:17.229922 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:17.230109 (+ 187us) server_negotiation.cc:407] Connection header received
0808 04:40:17.230289 (+ 180us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:17.230292 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:17.230340 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:17.230436 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:17.231271 (+ 835us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:47236: BlockingRecv error: recv got EOF from 127.0.0.1:47236 (error 108)
Metrics: {"server-negotiator.queue_time_us":47}
I20260808 04:40:17.232702 21443 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu with pid 24066
I20260808 04:40:17.240070 21443 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu with pid 24206
I20260808 04:40:17.247295 21443 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu with pid 24347
I20260808 04:40:17.253551 21443 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu with pid 23968
2026-08-08T04:40:17Z chronyd exiting
[ OK ] SecurityITest.TestNoKerberosCredentials (2203 ms)
[ RUN ] SecurityITest.SaslPlainFallback
Loading random data
Initializing database '/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786164000593138-21443-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 04:40:17 dist-test-slave-vxj2 krb5kdc[24494](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 04:40:17 dist-test-slave-vxj2 krb5kdc[24494](info): set up 2 sockets
Aug 08 04:40:17 dist-test-slave-vxj2 krb5kdc[24494](info): commencing operation
krb5kdc: starting...
W20260808 04:40:18.352241 21443 mini_kdc.cc:121] Time spent starting KDC: real 1.074s user 0.005s sys 0.001s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786164000593138-21443-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786164000593138-21443-0/krb5kdc/test-user.keytab.
Aug 08 04:40:18 dist-test-slave-vxj2 krb5kdc[24494](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164018, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T04:40:18Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T04:40:18Z Disabled control of system clock
WARNING: no policy specified for kudu/127.20.240.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.240.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.240.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.254.keytab.
Entry for principal kudu/127.20.240.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.254.keytab.
I20260808 04:40:18.480608 21443 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
/tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786164000593138-21443-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786164000593138-21443-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786164000593138-21443-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786164000593138-21443-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.240.254:42441
--webserver_interface=127.20.240.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.254.keytab
--principal=kudu/127.20.240.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.240.212:41003
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.240.254:42441
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc-authentication=optional
--user-acl=* with env {KRB5CCNAME=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786164000593138-21443-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786164000593138-21443-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786164000593138-21443-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 04:40:18.608407 24507 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:40:18.608697 24507 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:40:18.608772 24507 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:40:18.613068 24507 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 04:40:18.613224 24507 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:40:18.613258 24507 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:40:18.613319 24507 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 04:40:18.613353 24507 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 04:40:18.619225 24507 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.240.212:41003
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786164000593138-21443-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786164000593138-21443-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.240.254:42441
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.254.keytab
--principal=kudu/127.20.240.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.240.254:42441
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786164000593138-21443-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.240.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24507
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786164000593138-21443-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 04:05:18 UTC on ccycloud.quasar-drfdgt.root.comops.site
build id 4574101
I20260808 04:40:18.620460 24507 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:40:18.621626 24507 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:40:18.630828 24513 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:40:18.630884 24512 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:40:18.630937 24515 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:40:18.631022 24507 server_base.cc:1034] running on GCE node
I20260808 04:40:18.631705 24507 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:40:18.632856 24507 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:40:18.634038 24507 hybrid_clock.cc:648] HybridClock initialized: now 1786164018633982 us; error 71 us; skew 500 ppm
Aug 08 04:40:18 dist-test-slave-vxj2 krb5kdc[24494](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164018, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.240.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:40:18.637284 24507 init.cc:377] Logged in from keytab as kudu/127.20.240.254@KRBTEST.COM (short username kudu)
I20260808 04:40:18.638283 24507 webserver.cc:460] Webserver started at http://127.20.240.254:46615/ using document root <none> and password file <none>
I20260808 04:40:18.638885 24507 fs_manager.cc:359] Metadata directory not provided
I20260808 04:40:18.638952 24507 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:40:18.639218 24507 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 04:40:18.641480 24507 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786164000593138-21443-0/minicluster-data/master-0/data/instance:
uuid: "f284c1f87f4548e69b5861d24a09dd06"
format_stamp: "Formatted at 2026-08-08 04:40:18 on dist-test-slave-vxj2"
server_key: "3052a0ef5773f4adc5becd3c30b43ee0"
server_key_iv: "c17d0054d4000d7970938cce5fdde7d7"
server_key_version: "encryptionkey@0"
I20260808 04:40:18.642105 24507 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786164000593138-21443-0/minicluster-data/master-0/wal/instance:
uuid: "f284c1f87f4548e69b5861d24a09dd06"
format_stamp: "Formatted at 2026-08-08 04:40:18 on dist-test-slave-vxj2"
server_key: "3052a0ef5773f4adc5becd3c30b43ee0"
server_key_iv: "c17d0054d4000d7970938cce5fdde7d7"
server_key_version: "encryptionkey@0"
I20260808 04:40:18.646360 24507 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260808 04:40:18.648888 24523 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:18.650219 24507 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 04:40:18.650370 24507 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786164000593138-21443-0/minicluster-data/master-0/data,/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786164000593138-21443-0/minicluster-data/master-0/wal
uuid: "f284c1f87f4548e69b5861d24a09dd06"
format_stamp: "Formatted at 2026-08-08 04:40:18 on dist-test-slave-vxj2"
server_key: "3052a0ef5773f4adc5becd3c30b43ee0"
server_key_iv: "c17d0054d4000d7970938cce5fdde7d7"
server_key_version: "encryptionkey@0"
I20260808 04:40:18.650493 24507 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786164000593138-21443-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786164000593138-21443-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786164000593138-21443-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:40:18.691229 24507 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:40:18.694522 24507 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:40:18.694751 24507 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:40:18.702281 24507 rpc_server.cc:307] RPC server started. Bound to: 127.20.240.254:42441
I20260808 04:40:18.702682 24575 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.240.254:42441 every 8 connection(s)
I20260808 04:40:18.703495 24507 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786164000593138-21443-0/minicluster-data/master-0/data/info.pb
I20260808 04:40:18.706391 24576 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:40:18.708343 21443 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu as pid 24507
I20260808 04:40:18.708457 21443 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786164000593138-21443-0/minicluster-data/master-0/wal/instance
I20260808 04:40:18.708724 21443 external_mini_cluster.cc:1428] Setting key 1a788ac57d59de87ef94e7161a9e14ca
I20260808 04:40:18.713047 24576 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f284c1f87f4548e69b5861d24a09dd06: Bootstrap starting.
I20260808 04:40:18.715399 24576 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f284c1f87f4548e69b5861d24a09dd06: Neither blocks nor log segments found. Creating new log.
I20260808 04:40:18.716251 24576 log.cc:824] T 00000000000000000000000000000000 P f284c1f87f4548e69b5861d24a09dd06: Log is configured to *not* fsync() on all Append() calls
Aug 08 04:40:18 dist-test-slave-vxj2 krb5kdc[24494](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164018, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.240.254@KRBTEST.COM
I20260808 04:40:18.718410 24576 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f284c1f87f4548e69b5861d24a09dd06: No bootstrap required, opened a new log
I20260808 04:40:18.722224 24576 raft_consensus.cc:348] T 00000000000000000000000000000000 P f284c1f87f4548e69b5861d24a09dd06 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f284c1f87f4548e69b5861d24a09dd06" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 42441 } }
I20260808 04:40:18.722455 24576 raft_consensus.cc:374] T 00000000000000000000000000000000 P f284c1f87f4548e69b5861d24a09dd06 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:40:18.722510 24576 raft_consensus.cc:729] T 00000000000000000000000000000000 P f284c1f87f4548e69b5861d24a09dd06 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f284c1f87f4548e69b5861d24a09dd06, State: Initialized, Role: FOLLOWER
I20260808 04:40:18.722920 24576 consensus_queue.cc:260] T 00000000000000000000000000000000 P f284c1f87f4548e69b5861d24a09dd06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f284c1f87f4548e69b5861d24a09dd06" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 42441 } }
I20260808 04:40:18.722971 24579 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:18.710222 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42662 (local address 127.20.240.254:42441)
0808 04:40:18.710670 (+ 448us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:18.710686 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:18.710732 (+ 46us) server_negotiation.cc:407] Connection header received
0808 04:40:18.711428 (+ 696us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:18.711445 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:18.711774 (+ 329us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:18.712120 (+ 346us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:18.712976 (+ 856us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:18.714031 (+ 1055us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:18.714899 (+ 868us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:18.715371 (+ 472us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:18.715539 (+ 168us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:18.718293 (+ 2754us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:40:18.718298 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:40:18.718311 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:40:18.718339 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:40:18.720015 (+ 1676us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:18.720456 (+ 441us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:18.720461 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:18.720466 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:18.720576 (+ 110us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:18.720853 (+ 277us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:18.720859 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:18.720862 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:18.721321 (+ 459us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:40:18.721549 (+ 228us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:18.721794 (+ 245us) server_negotiation.cc:299] Negotiation successful
0808 04:40:18.722094 (+ 300us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":299,"thread_start_us":141,"threads_started":1}
I20260808 04:40:18.723037 24576 raft_consensus.cc:388] T 00000000000000000000000000000000 P f284c1f87f4548e69b5861d24a09dd06 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 04:40:18.723112 24576 raft_consensus.cc:482] T 00000000000000000000000000000000 P f284c1f87f4548e69b5861d24a09dd06 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 04:40:18.723234 24576 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f284c1f87f4548e69b5861d24a09dd06 [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:40:18.724277 24576 raft_consensus.cc:504] T 00000000000000000000000000000000 P f284c1f87f4548e69b5861d24a09dd06 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f284c1f87f4548e69b5861d24a09dd06" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 42441 } }
I20260808 04:40:18.724633 24576 leader_election.cc:302] T 00000000000000000000000000000000 P f284c1f87f4548e69b5861d24a09dd06 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f284c1f87f4548e69b5861d24a09dd06; no voters:
I20260808 04:40:18.724975 24576 leader_election.cc:288] T 00000000000000000000000000000000 P f284c1f87f4548e69b5861d24a09dd06 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 04:40:18.725313 24581 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f284c1f87f4548e69b5861d24a09dd06 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 04:40:18.725529 24581 raft_consensus.cc:686] T 00000000000000000000000000000000 P f284c1f87f4548e69b5861d24a09dd06 [term 1 LEADER]: Becoming Leader. State: Replica: f284c1f87f4548e69b5861d24a09dd06, State: Running, Role: LEADER
I20260808 04:40:18.725832 24581 consensus_queue.cc:237] T 00000000000000000000000000000000 P f284c1f87f4548e69b5861d24a09dd06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f284c1f87f4548e69b5861d24a09dd06" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 42441 } }
I20260808 04:40:18.725986 21443 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 04:40:18.726358 24576 sys_catalog.cc:564] T 00000000000000000000000000000000 P f284c1f87f4548e69b5861d24a09dd06 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 04:40:18.727073 24581 sys_catalog.cc:455] T 00000000000000000000000000000000 P f284c1f87f4548e69b5861d24a09dd06 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f284c1f87f4548e69b5861d24a09dd06. Latest consensus state: current_term: 1 leader_uuid: "f284c1f87f4548e69b5861d24a09dd06" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f284c1f87f4548e69b5861d24a09dd06" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 42441 } } }
I20260808 04:40:18.727233 24581 sys_catalog.cc:458] T 00000000000000000000000000000000 P f284c1f87f4548e69b5861d24a09dd06 [sys.catalog]: This master's current role is: LEADER
I20260808 04:40:18.727514 24582 sys_catalog.cc:455] T 00000000000000000000000000000000 P f284c1f87f4548e69b5861d24a09dd06 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f284c1f87f4548e69b5861d24a09dd06" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f284c1f87f4548e69b5861d24a09dd06" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 42441 } } }
I20260808 04:40:18.727640 24582 sys_catalog.cc:458] T 00000000000000000000000000000000 P f284c1f87f4548e69b5861d24a09dd06 [sys.catalog]: This master's current role is: LEADER
I20260808 04:40:18.727797 24589 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 04:40:18.731170 24589 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 04:40:18.737449 24589 catalog_manager.cc:1347] Generated new cluster ID: b77fc70378c346c9ab96bafe9f047745
I20260808 04:40:18.737525 24589 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 04:40:18.744889 24579 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:18.739956 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42668 (local address 127.20.240.254:42441)
0808 04:40:18.740082 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:18.740087 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:18.740349 (+ 262us) server_negotiation.cc:407] Connection header received
0808 04:40:18.740507 (+ 158us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:18.740510 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:18.740553 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:18.740639 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:18.741245 (+ 606us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:18.741767 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:18.742628 (+ 861us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:18.742877 (+ 249us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:18.742981 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:18.743929 (+ 948us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:40:18.743932 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:40:18.743934 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 04:40:18.744404 (+ 470us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:40:18.744435 (+ 31us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 04:40:18.744451 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:40:18.744554 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:18.744666 (+ 112us) server_negotiation.cc:299] Negotiation successful
0808 04:40:18.744734 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260808 04:40:18.748337 24589 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 04:40:18.749300 24589 catalog_manager.cc:1504] Loading token signing keys...
I20260808 04:40:18.753821 24589 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f284c1f87f4548e69b5861d24a09dd06: Generated new TSK 0
I20260808 04:40:18.754555 24589 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 04:40:18.763116 21443 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu with pid 24507
2026-08-08T04:40:18Z chronyd exiting
[ OK ] SecurityITest.SaslPlainFallback (1508 ms)
[ RUN ] SecurityITest.TestUnauthorizedClientKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786164000593138-21443-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 04:40:18 dist-test-slave-vxj2 krb5kdc[24612](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 04:40:18 dist-test-slave-vxj2 krb5kdc[24612](info): set up 2 sockets
Aug 08 04:40:18 dist-test-slave-vxj2 krb5kdc[24612](info): commencing operation
krb5kdc: starting...
W20260808 04:40:19.956423 21443 mini_kdc.cc:121] Time spent starting KDC: real 1.171s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
W20260808 04:40:20.125946 21443 mini_kdc.cc:253] Time spent creating user principal test-admin: real 0.169s user 0.000s sys 0.003s
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
W20260808 04:40:20.394649 21443 mini_kdc.cc:253] Time spent creating user principal joe-interloper: real 0.189s user 0.000s sys 0.002s
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786164000593138-21443-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786164000593138-21443-0/krb5kdc/test-user.keytab.
W20260808 04:40:20.997428 21443 mini_kdc.cc:302] Time spent creating keytab for test-user: real 0.603s user 0.000s sys 0.002s
Aug 08 04:40:21 dist-test-slave-vxj2 krb5kdc[24612](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164021, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T04:40:21Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T04:40:21Z Disabled control of system clock
WARNING: no policy specified for kudu/127.20.240.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.240.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.240.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.254.keytab.
Entry for principal kudu/127.20.240.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.254.keytab.
I20260808 04:40:21.057281 21443 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
/tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786164000593138-21443-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786164000593138-21443-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786164000593138-21443-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786164000593138-21443-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.240.254:35891
--webserver_interface=127.20.240.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.254.keytab
--principal=kudu/127.20.240.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.240.212:35649
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.240.254:35891
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786164000593138-21443-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786164000593138-21443-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786164000593138-21443-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 04:40:21.173352 24625 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:40:21.173707 24625 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:40:21.173792 24625 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:40:21.178023 24625 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 04:40:21.178144 24625 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:40:21.178181 24625 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:40:21.178222 24625 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 04:40:21.178262 24625 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 04:40:21.184034 24625 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.240.212:35649
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786164000593138-21443-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786164000593138-21443-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.240.254:35891
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.254.keytab
--principal=kudu/127.20.240.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.240.254:35891
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786164000593138-21443-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.240.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24625
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786164000593138-21443-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 04:05:18 UTC on ccycloud.quasar-drfdgt.root.comops.site
build id 4574101
I20260808 04:40:21.185382 24625 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:40:21.186540 24625 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:40:21.195721 24631 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:40:21.195730 24630 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:40:21.195767 24633 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:40:21.195992 24625 server_base.cc:1034] running on GCE node
I20260808 04:40:21.196949 24625 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:40:21.198226 24625 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:40:21.199414 24625 hybrid_clock.cc:648] HybridClock initialized: now 1786164021199399 us; error 28 us; skew 500 ppm
Aug 08 04:40:21 dist-test-slave-vxj2 krb5kdc[24612](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164021, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.240.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:40:21.207540 24625 init.cc:377] Logged in from keytab as kudu/127.20.240.254@KRBTEST.COM (short username kudu)
I20260808 04:40:21.208762 24625 webserver.cc:460] Webserver started at http://127.20.240.254:45013/ using document root <none> and password file <none>
I20260808 04:40:21.209501 24625 fs_manager.cc:359] Metadata directory not provided
I20260808 04:40:21.209607 24625 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:40:21.209872 24625 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 04:40:21.212342 24625 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786164000593138-21443-0/minicluster-data/master-0/data/instance:
uuid: "dece918198ec4d7ca06b5f7e8a8bf697"
format_stamp: "Formatted at 2026-08-08 04:40:21 on dist-test-slave-vxj2"
server_key: "481e14b0fd77ea48a49ce8c36bcf4d1e"
server_key_iv: "fbc900bbad254682d4e3d0b4b5b54cbe"
server_key_version: "encryptionkey@0"
I20260808 04:40:21.213034 24625 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786164000593138-21443-0/minicluster-data/master-0/wal/instance:
uuid: "dece918198ec4d7ca06b5f7e8a8bf697"
format_stamp: "Formatted at 2026-08-08 04:40:21 on dist-test-slave-vxj2"
server_key: "481e14b0fd77ea48a49ce8c36bcf4d1e"
server_key_iv: "fbc900bbad254682d4e3d0b4b5b54cbe"
server_key_version: "encryptionkey@0"
I20260808 04:40:21.217442 24625 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260808 04:40:21.220305 24641 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:21.221844 24625 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 04:40:21.222010 24625 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786164000593138-21443-0/minicluster-data/master-0/data,/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786164000593138-21443-0/minicluster-data/master-0/wal
uuid: "dece918198ec4d7ca06b5f7e8a8bf697"
format_stamp: "Formatted at 2026-08-08 04:40:21 on dist-test-slave-vxj2"
server_key: "481e14b0fd77ea48a49ce8c36bcf4d1e"
server_key_iv: "fbc900bbad254682d4e3d0b4b5b54cbe"
server_key_version: "encryptionkey@0"
I20260808 04:40:21.222158 24625 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786164000593138-21443-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786164000593138-21443-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786164000593138-21443-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:40:21.239738 24625 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:40:21.243046 24625 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:40:21.243263 24625 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:40:21.250519 24625 rpc_server.cc:307] RPC server started. Bound to: 127.20.240.254:35891
I20260808 04:40:21.250851 24694 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.240.254:35891 every 8 connection(s)
I20260808 04:40:21.251523 24625 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786164000593138-21443-0/minicluster-data/master-0/data/info.pb
I20260808 04:40:21.254539 24695 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:40:21.254602 21443 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu as pid 24625
I20260808 04:40:21.254710 21443 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786164000593138-21443-0/minicluster-data/master-0/wal/instance
I20260808 04:40:21.255028 21443 external_mini_cluster.cc:1428] Setting key 62343e9ad75dc0628eb6c2e941e56734
I20260808 04:40:21.261785 24695 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dece918198ec4d7ca06b5f7e8a8bf697: Bootstrap starting.
I20260808 04:40:21.264658 24695 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P dece918198ec4d7ca06b5f7e8a8bf697: Neither blocks nor log segments found. Creating new log.
Aug 08 04:40:21 dist-test-slave-vxj2 krb5kdc[24612](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164021, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.240.254@KRBTEST.COM
I20260808 04:40:21.265522 24695 log.cc:824] T 00000000000000000000000000000000 P dece918198ec4d7ca06b5f7e8a8bf697: Log is configured to *not* fsync() on all Append() calls
I20260808 04:40:21.268045 24695 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dece918198ec4d7ca06b5f7e8a8bf697: No bootstrap required, opened a new log
I20260808 04:40:21.271090 24698 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:21.256438 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55444 (local address 127.20.240.254:35891)
0808 04:40:21.256874 (+ 436us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:21.256889 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:21.256928 (+ 39us) server_negotiation.cc:407] Connection header received
0808 04:40:21.257965 (+ 1037us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:21.257985 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:21.258315 (+ 330us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:21.258601 (+ 286us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:21.259566 (+ 965us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:21.260573 (+ 1007us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:21.261828 (+ 1255us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:21.262395 (+ 567us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:21.262526 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:21.265438 (+ 2912us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:40:21.265445 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:40:21.265461 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:40:21.265496 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:40:21.267687 (+ 2191us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:21.268150 (+ 463us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:21.268156 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:21.268162 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:21.268298 (+ 136us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:21.268606 (+ 308us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:21.268609 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:21.268611 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:21.269206 (+ 595us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:40:21.269399 (+ 193us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:21.269655 (+ 256us) server_negotiation.cc:299] Negotiation successful
0808 04:40:21.269974 (+ 319us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":274,"thread_start_us":134,"threads_started":1}
I20260808 04:40:21.273058 24695 raft_consensus.cc:348] T 00000000000000000000000000000000 P dece918198ec4d7ca06b5f7e8a8bf697 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dece918198ec4d7ca06b5f7e8a8bf697" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 35891 } }
I20260808 04:40:21.273387 24695 raft_consensus.cc:374] T 00000000000000000000000000000000 P dece918198ec4d7ca06b5f7e8a8bf697 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:40:21.273514 24695 raft_consensus.cc:729] T 00000000000000000000000000000000 P dece918198ec4d7ca06b5f7e8a8bf697 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dece918198ec4d7ca06b5f7e8a8bf697, State: Initialized, Role: FOLLOWER
I20260808 04:40:21.273952 24695 consensus_queue.cc:260] T 00000000000000000000000000000000 P dece918198ec4d7ca06b5f7e8a8bf697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dece918198ec4d7ca06b5f7e8a8bf697" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 35891 } }
I20260808 04:40:21.274085 24695 raft_consensus.cc:388] T 00000000000000000000000000000000 P dece918198ec4d7ca06b5f7e8a8bf697 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 04:40:21.274128 24695 raft_consensus.cc:482] T 00000000000000000000000000000000 P dece918198ec4d7ca06b5f7e8a8bf697 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 04:40:21.274194 24695 raft_consensus.cc:3037] T 00000000000000000000000000000000 P dece918198ec4d7ca06b5f7e8a8bf697 [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:40:21.275156 24695 raft_consensus.cc:504] T 00000000000000000000000000000000 P dece918198ec4d7ca06b5f7e8a8bf697 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dece918198ec4d7ca06b5f7e8a8bf697" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 35891 } }
I20260808 04:40:21.275476 24695 leader_election.cc:302] T 00000000000000000000000000000000 P dece918198ec4d7ca06b5f7e8a8bf697 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: dece918198ec4d7ca06b5f7e8a8bf697; no voters:
I20260808 04:40:21.275756 24695 leader_election.cc:288] T 00000000000000000000000000000000 P dece918198ec4d7ca06b5f7e8a8bf697 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 04:40:21.275976 24700 raft_consensus.cc:2781] T 00000000000000000000000000000000 P dece918198ec4d7ca06b5f7e8a8bf697 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 04:40:21.276213 24700 raft_consensus.cc:686] T 00000000000000000000000000000000 P dece918198ec4d7ca06b5f7e8a8bf697 [term 1 LEADER]: Becoming Leader. State: Replica: dece918198ec4d7ca06b5f7e8a8bf697, State: Running, Role: LEADER
I20260808 04:40:21.276590 24700 consensus_queue.cc:237] T 00000000000000000000000000000000 P dece918198ec4d7ca06b5f7e8a8bf697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dece918198ec4d7ca06b5f7e8a8bf697" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 35891 } }
I20260808 04:40:21.277118 24695 sys_catalog.cc:564] T 00000000000000000000000000000000 P dece918198ec4d7ca06b5f7e8a8bf697 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 04:40:21.278333 24702 sys_catalog.cc:455] T 00000000000000000000000000000000 P dece918198ec4d7ca06b5f7e8a8bf697 [sys.catalog]: SysCatalogTable state changed. Reason: New leader dece918198ec4d7ca06b5f7e8a8bf697. Latest consensus state: current_term: 1 leader_uuid: "dece918198ec4d7ca06b5f7e8a8bf697" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dece918198ec4d7ca06b5f7e8a8bf697" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 35891 } } }
I20260808 04:40:21.278606 24701 sys_catalog.cc:455] T 00000000000000000000000000000000 P dece918198ec4d7ca06b5f7e8a8bf697 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "dece918198ec4d7ca06b5f7e8a8bf697" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dece918198ec4d7ca06b5f7e8a8bf697" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 35891 } } }
I20260808 04:40:21.278719 24702 sys_catalog.cc:458] T 00000000000000000000000000000000 P dece918198ec4d7ca06b5f7e8a8bf697 [sys.catalog]: This master's current role is: LEADER
I20260808 04:40:21.278817 24701 sys_catalog.cc:458] T 00000000000000000000000000000000 P dece918198ec4d7ca06b5f7e8a8bf697 [sys.catalog]: This master's current role is: LEADER
I20260808 04:40:21.279800 24711 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 04:40:21.282644 24711 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 04:40:21.288390 24711 catalog_manager.cc:1347] Generated new cluster ID: 753743e869854cbea6153af1e7010edf
I20260808 04:40:21.288478 24711 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 04:40:21.303113 24711 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 04:40:21.304875 24711 catalog_manager.cc:1504] Loading token signing keys...
I20260808 04:40:21.310674 24711 catalog_manager.cc:5868] T 00000000000000000000000000000000 P dece918198ec4d7ca06b5f7e8a8bf697: Generated new TSK 0
I20260808 04:40:21.311426 24711 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.20.240.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.240.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.240.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.193.keytab.
Entry for principal kudu/127.20.240.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.193.keytab.
I20260808 04:40:21.345044 21443 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
/tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786164000593138-21443-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786164000593138-21443-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786164000593138-21443-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786164000593138-21443-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.240.193:0
--local_ip_for_outbound_sockets=127.20.240.193
--webserver_interface=127.20.240.193
--webserver_port=0
--tserver_master_addrs=127.20.240.254:35891
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.193.keytab
--principal=kudu/127.20.240.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.240.212:35649
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786164000593138-21443-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786164000593138-21443-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786164000593138-21443-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 04:40:21.462343 24722 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:40:21.462630 24722 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:40:21.462677 24722 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:40:21.466820 24722 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:40:21.466893 24722 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:40:21.466952 24722 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.240.193
I20260808 04:40:21.472404 24722 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.240.212:35649
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786164000593138-21443-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786164000593138-21443-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.193.keytab
--principal=kudu/127.20.240.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.240.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786164000593138-21443-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.240.193
--webserver_port=0
--tserver_master_addrs=127.20.240.254:35891
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24722
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.240.193
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786164000593138-21443-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 04:05:18 UTC on ccycloud.quasar-drfdgt.root.comops.site
build id 4574101
I20260808 04:40:21.473598 24722 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:40:21.474670 24722 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:40:21.484814 24730 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:40:21.484964 24722 server_base.cc:1034] running on GCE node
W20260808 04:40:21.484977 24728 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:40:21.484817 24727 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:40:21.485654 24722 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:40:21.486400 24722 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:40:21.487607 24722 hybrid_clock.cc:648] HybridClock initialized: now 1786164021487590 us; error 26 us; skew 500 ppm
Aug 08 04:40:21 dist-test-slave-vxj2 krb5kdc[24612](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164021, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.240.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:40:21.490643 24722 init.cc:377] Logged in from keytab as kudu/127.20.240.193@KRBTEST.COM (short username kudu)
I20260808 04:40:21.491561 24722 webserver.cc:460] Webserver started at http://127.20.240.193:33913/ using document root <none> and password file <none>
I20260808 04:40:21.492111 24722 fs_manager.cc:359] Metadata directory not provided
I20260808 04:40:21.492169 24722 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:40:21.492336 24722 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 04:40:21.494422 24722 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786164000593138-21443-0/minicluster-data/ts-0/data/instance:
uuid: "b52e0011b1e0466c960cbf8d9c9de682"
format_stamp: "Formatted at 2026-08-08 04:40:21 on dist-test-slave-vxj2"
server_key: "368af1b3cb891280c956c35349766d43"
server_key_iv: "28e2a8a2ed7b1487212e3bdc62822dee"
server_key_version: "encryptionkey@0"
I20260808 04:40:21.495003 24722 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786164000593138-21443-0/minicluster-data/ts-0/wal/instance:
uuid: "b52e0011b1e0466c960cbf8d9c9de682"
format_stamp: "Formatted at 2026-08-08 04:40:21 on dist-test-slave-vxj2"
server_key: "368af1b3cb891280c956c35349766d43"
server_key_iv: "28e2a8a2ed7b1487212e3bdc62822dee"
server_key_version: "encryptionkey@0"
I20260808 04:40:21.498996 24722 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260808 04:40:21.501859 24737 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:21.503152 24722 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 04:40:21.503293 24722 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786164000593138-21443-0/minicluster-data/ts-0/data,/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786164000593138-21443-0/minicluster-data/ts-0/wal
uuid: "b52e0011b1e0466c960cbf8d9c9de682"
format_stamp: "Formatted at 2026-08-08 04:40:21 on dist-test-slave-vxj2"
server_key: "368af1b3cb891280c956c35349766d43"
server_key_iv: "28e2a8a2ed7b1487212e3bdc62822dee"
server_key_version: "encryptionkey@0"
I20260808 04:40:21.503422 24722 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786164000593138-21443-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786164000593138-21443-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786164000593138-21443-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:40:21.521660 24722 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:40:21.525377 24722 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:40:21.525625 24722 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:40:21.526405 24722 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 04:40:21.527459 24722 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 04:40:21.527514 24722 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:21.527601 24722 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 04:40:21.527634 24722 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:21.537563 24722 rpc_server.cc:307] RPC server started. Bound to: 127.20.240.193:44969
I20260808 04:40:21.537588 24854 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.240.193:44969 every 8 connection(s)
I20260808 04:40:21.538542 24722 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786164000593138-21443-0/minicluster-data/ts-0/data/info.pb
I20260808 04:40:21.542181 21443 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu as pid 24722
I20260808 04:40:21.542331 21443 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786164000593138-21443-0/minicluster-data/ts-0/wal/instance
I20260808 04:40:21.542745 21443 external_mini_cluster.cc:1428] Setting key 1ca0db99e1a338aae37ce979635c4769
Aug 08 04:40:21 dist-test-slave-vxj2 krb5kdc[24612](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164021, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.240.193@KRBTEST.COM for kudu/127.20.240.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.20.240.194@KRBTEST.COM; defaulting to no policy
I20260808 04:40:21.555660 24698 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:21.540484 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.240.193:32869 (local address 127.20.240.254:35891)
0808 04:40:21.540618 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:21.540622 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:21.541655 (+ 1033us) server_negotiation.cc:407] Connection header received
0808 04:40:21.543542 (+ 1887us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:21.543546 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:21.543608 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:21.543706 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:21.545395 (+ 1689us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:21.546036 (+ 641us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:21.547244 (+ 1208us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:21.547711 (+ 467us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:21.547845 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:21.551097 (+ 3252us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:40:21.551102 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:40:21.551106 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:40:21.551147 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:40:21.553203 (+ 2056us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:21.553810 (+ 607us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:21.553816 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:21.553820 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:21.553948 (+ 128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:21.554425 (+ 477us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:21.554428 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:21.554429 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:21.554634 (+ 205us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:40:21.554723 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:21.555403 (+ 680us) server_negotiation.cc:299] Negotiation successful
0808 04:40:21.555527 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260808 04:40:21.556716 24857 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:21.540830 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:35891 (local address 127.20.240.193:32869)
0808 04:40:21.541489 (+ 659us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:21.541535 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:21.543262 (+ 1727us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:21.543911 (+ 649us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:21.543918 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:21.544466 (+ 548us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:40:21.545230 (+ 764us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:21.545254 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:21.546203 (+ 949us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:21.546206 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:21.547109 (+ 903us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:21.547118 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:21.547971 (+ 853us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:21.547975 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:21.548125 (+ 150us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:21.548830 (+ 705us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:40:21.548919 (+ 89us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:40:21.550889 (+ 1970us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:40:21.553360 (+ 2471us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:21.553366 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:21.553382 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:21.553676 (+ 294us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:21.554091 (+ 415us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:21.554094 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:21.554097 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:21.554294 (+ 197us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:21.554735 (+ 441us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:40:21.554741 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:40:21.555112 (+ 371us) client_negotiation.cc:769] Sending connection context
0808 04:40:21.555329 (+ 217us) client_negotiation.cc:240] Negotiation successful
0808 04:40:21.555632 (+ 303us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":447,"thread_start_us":177,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.240.194@KRBTEST.COM" created.
I20260808 04:40:21.558198 24855 heartbeater.cc:347] Connected to a master server at 127.20.240.254:35891
I20260808 04:40:21.558496 24855 heartbeater.cc:464] Registering TS with master...
I20260808 04:40:21.559121 24855 heartbeater.cc:511] Master 127.20.240.254:35891 requested a full tablet report, sending...
I20260808 04:40:21.560736 24658 ts_manager.cc:194] Registered new tserver with Master: b52e0011b1e0466c960cbf8d9c9de682 (127.20.240.193:44969)
I20260808 04:40:21.562109 24658 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.240.193@KRBTEST.COM'} at 127.20.240.193:32869
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.240.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.194.keytab.
Entry for principal kudu/127.20.240.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.194.keytab.
I20260808 04:40:21.576498 21443 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
/tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786164000593138-21443-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786164000593138-21443-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786164000593138-21443-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786164000593138-21443-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.240.194:0
--local_ip_for_outbound_sockets=127.20.240.194
--webserver_interface=127.20.240.194
--webserver_port=0
--tserver_master_addrs=127.20.240.254:35891
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.194.keytab
--principal=kudu/127.20.240.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.240.212:35649
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786164000593138-21443-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786164000593138-21443-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786164000593138-21443-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 04:40:21.695133 24860 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:40:21.695497 24860 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:40:21.695590 24860 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:40:21.699972 24860 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:40:21.700110 24860 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:40:21.700245 24860 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.240.194
I20260808 04:40:21.706214 24860 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.240.212:35649
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786164000593138-21443-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786164000593138-21443-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.194.keytab
--principal=kudu/127.20.240.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.240.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786164000593138-21443-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.240.194
--webserver_port=0
--tserver_master_addrs=127.20.240.254:35891
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24860
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.240.194
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786164000593138-21443-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 04:05:18 UTC on ccycloud.quasar-drfdgt.root.comops.site
build id 4574101
I20260808 04:40:21.707475 24860 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:40:21.708598 24860 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:40:21.719476 24866 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:40:21.719534 24860 server_base.cc:1034] running on GCE node
W20260808 04:40:21.719476 24868 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:40:21.719476 24865 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:40:21.720299 24860 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:40:21.720999 24860 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:40:21.722220 24860 hybrid_clock.cc:648] HybridClock initialized: now 1786164021722178 us; error 52 us; skew 500 ppm
Aug 08 04:40:21 dist-test-slave-vxj2 krb5kdc[24612](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164021, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.240.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:40:21.725485 24860 init.cc:377] Logged in from keytab as kudu/127.20.240.194@KRBTEST.COM (short username kudu)
I20260808 04:40:21.726603 24860 webserver.cc:460] Webserver started at http://127.20.240.194:35389/ using document root <none> and password file <none>
I20260808 04:40:21.727243 24860 fs_manager.cc:359] Metadata directory not provided
I20260808 04:40:21.727340 24860 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:40:21.727581 24860 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 04:40:21.729852 24860 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786164000593138-21443-0/minicluster-data/ts-1/data/instance:
uuid: "231d5794c56f4f90a1abd4d8b16d9048"
format_stamp: "Formatted at 2026-08-08 04:40:21 on dist-test-slave-vxj2"
server_key: "c8fe93243a400818608672563131a2ca"
server_key_iv: "422fb8b02c83c85a7501321697bff1d3"
server_key_version: "encryptionkey@0"
I20260808 04:40:21.730454 24860 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786164000593138-21443-0/minicluster-data/ts-1/wal/instance:
uuid: "231d5794c56f4f90a1abd4d8b16d9048"
format_stamp: "Formatted at 2026-08-08 04:40:21 on dist-test-slave-vxj2"
server_key: "c8fe93243a400818608672563131a2ca"
server_key_iv: "422fb8b02c83c85a7501321697bff1d3"
server_key_version: "encryptionkey@0"
I20260808 04:40:21.734496 24860 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260808 04:40:21.737074 24875 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:21.738461 24860 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 04:40:21.738613 24860 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786164000593138-21443-0/minicluster-data/ts-1/data,/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786164000593138-21443-0/minicluster-data/ts-1/wal
uuid: "231d5794c56f4f90a1abd4d8b16d9048"
format_stamp: "Formatted at 2026-08-08 04:40:21 on dist-test-slave-vxj2"
server_key: "c8fe93243a400818608672563131a2ca"
server_key_iv: "422fb8b02c83c85a7501321697bff1d3"
server_key_version: "encryptionkey@0"
I20260808 04:40:21.738740 24860 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786164000593138-21443-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786164000593138-21443-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786164000593138-21443-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:40:21.765956 24860 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:40:21.769919 24860 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:40:21.770159 24860 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:40:21.770826 24860 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 04:40:21.771741 24860 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 04:40:21.771814 24860 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:21.771895 24860 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 04:40:21.771936 24860 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:21.781800 24860 rpc_server.cc:307] RPC server started. Bound to: 127.20.240.194:46713
I20260808 04:40:21.781822 24993 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.240.194:46713 every 8 connection(s)
I20260808 04:40:21.782725 24860 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786164000593138-21443-0/minicluster-data/ts-1/data/info.pb
I20260808 04:40:21.784281 21443 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu as pid 24860
I20260808 04:40:21.784422 21443 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786164000593138-21443-0/minicluster-data/ts-1/wal/instance
I20260808 04:40:21.784713 21443 external_mini_cluster.cc:1428] Setting key e2d4b90e106a22324aac587c1b1b88e0
Aug 08 04:40:21 dist-test-slave-vxj2 krb5kdc[24612](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164021, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.240.194@KRBTEST.COM for kudu/127.20.240.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.20.240.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.240.195@KRBTEST.COM" created.
I20260808 04:40:21.799062 24698 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:21.784508 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.240.194:47725 (local address 127.20.240.254:35891)
0808 04:40:21.784667 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:21.784672 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:21.785729 (+ 1057us) server_negotiation.cc:407] Connection header received
0808 04:40:21.787250 (+ 1521us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:21.787256 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:21.787319 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:21.787421 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:21.788816 (+ 1395us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:21.789471 (+ 655us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:21.791386 (+ 1915us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:21.791833 (+ 447us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:21.791984 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:21.795033 (+ 3049us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:40:21.795036 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:40:21.795038 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:40:21.795064 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:40:21.796576 (+ 1512us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:21.797122 (+ 546us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:21.797124 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:21.797126 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:21.797260 (+ 134us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:21.797610 (+ 350us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:21.797613 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:21.797615 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:21.797859 (+ 244us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:40:21.797943 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:21.798621 (+ 678us) server_negotiation.cc:299] Negotiation successful
0808 04:40:21.798782 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260808 04:40:21.799836 24996 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:21.785014 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:35891 (local address 127.20.240.194:47725)
0808 04:40:21.785561 (+ 547us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:21.785617 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:21.787031 (+ 1414us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:21.787611 (+ 580us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:21.787619 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:21.788135 (+ 516us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:40:21.788653 (+ 518us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:21.788667 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:21.789633 (+ 966us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:21.789639 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:21.791238 (+ 1599us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:21.791250 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:21.792038 (+ 788us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:21.792041 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:21.792202 (+ 161us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:21.792877 (+ 675us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:40:21.792901 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:40:21.794841 (+ 1940us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:40:21.796712 (+ 1871us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:21.796727 (+ 15us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:21.796740 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:21.797025 (+ 285us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:21.797357 (+ 332us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:21.797360 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:21.797362 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:21.797510 (+ 148us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:21.798003 (+ 493us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:40:21.798008 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:40:21.798337 (+ 329us) client_negotiation.cc:769] Sending connection context
0808 04:40:21.798580 (+ 243us) client_negotiation.cc:240] Negotiation successful
0808 04:40:21.798900 (+ 320us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":336,"thread_start_us":212,"threads_started":1}
I20260808 04:40:21.801200 24994 heartbeater.cc:347] Connected to a master server at 127.20.240.254:35891
I20260808 04:40:21.801465 24994 heartbeater.cc:464] Registering TS with master...
I20260808 04:40:21.801985 24994 heartbeater.cc:511] Master 127.20.240.254:35891 requested a full tablet report, sending...
I20260808 04:40:21.803089 24658 ts_manager.cc:194] Registered new tserver with Master: 231d5794c56f4f90a1abd4d8b16d9048 (127.20.240.194:46713)
I20260808 04:40:21.803982 24658 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.240.194@KRBTEST.COM'} at 127.20.240.194:47725
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.240.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.195.keytab.
Entry for principal kudu/127.20.240.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.195.keytab.
I20260808 04:40:21.816910 21443 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
/tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786164000593138-21443-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786164000593138-21443-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786164000593138-21443-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786164000593138-21443-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.240.195:0
--local_ip_for_outbound_sockets=127.20.240.195
--webserver_interface=127.20.240.195
--webserver_port=0
--tserver_master_addrs=127.20.240.254:35891
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.195.keytab
--principal=kudu/127.20.240.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.240.212:35649
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786164000593138-21443-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786164000593138-21443-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786164000593138-21443-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 04:40:21.932685 24999 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:40:21.932976 24999 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:40:21.933022 24999 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:40:21.937217 24999 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:40:21.937302 24999 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:40:21.937366 24999 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.240.195
I20260808 04:40:21.943289 24999 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.240.212:35649
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786164000593138-21443-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786164000593138-21443-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.195.keytab
--principal=kudu/127.20.240.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.240.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786164000593138-21443-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.240.195
--webserver_port=0
--tserver_master_addrs=127.20.240.254:35891
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24999
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.240.195
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786164000593138-21443-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 04:05:18 UTC on ccycloud.quasar-drfdgt.root.comops.site
build id 4574101
I20260808 04:40:21.944393 24999 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:40:21.945397 24999 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:40:21.955205 25004 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:40:21.955291 25005 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:40:21.955214 25007 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:40:21.955282 24999 server_base.cc:1034] running on GCE node
I20260808 04:40:21.955885 24999 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:40:21.956579 24999 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:40:21.957774 24999 hybrid_clock.cc:648] HybridClock initialized: now 1786164021957738 us; error 47 us; skew 500 ppm
Aug 08 04:40:21 dist-test-slave-vxj2 krb5kdc[24612](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164021, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.240.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:40:21.960680 24999 init.cc:377] Logged in from keytab as kudu/127.20.240.195@KRBTEST.COM (short username kudu)
I20260808 04:40:21.961685 24999 webserver.cc:460] Webserver started at http://127.20.240.195:39021/ using document root <none> and password file <none>
I20260808 04:40:21.962284 24999 fs_manager.cc:359] Metadata directory not provided
I20260808 04:40:21.962386 24999 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:40:21.962617 24999 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 04:40:21.964968 24999 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786164000593138-21443-0/minicluster-data/ts-2/data/instance:
uuid: "bd0dab4a728c4fe3a15ff605767fbb00"
format_stamp: "Formatted at 2026-08-08 04:40:21 on dist-test-slave-vxj2"
server_key: "2ae01566cdc6159b03b7d7f6bf116043"
server_key_iv: "81de35fbbff619741e0855ca98c359c2"
server_key_version: "encryptionkey@0"
I20260808 04:40:21.965682 24999 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786164000593138-21443-0/minicluster-data/ts-2/wal/instance:
uuid: "bd0dab4a728c4fe3a15ff605767fbb00"
format_stamp: "Formatted at 2026-08-08 04:40:21 on dist-test-slave-vxj2"
server_key: "2ae01566cdc6159b03b7d7f6bf116043"
server_key_iv: "81de35fbbff619741e0855ca98c359c2"
server_key_version: "encryptionkey@0"
I20260808 04:40:21.969658 24999 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260808 04:40:21.972229 25014 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:21.973685 24999 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 04:40:21.973829 24999 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786164000593138-21443-0/minicluster-data/ts-2/data,/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786164000593138-21443-0/minicluster-data/ts-2/wal
uuid: "bd0dab4a728c4fe3a15ff605767fbb00"
format_stamp: "Formatted at 2026-08-08 04:40:21 on dist-test-slave-vxj2"
server_key: "2ae01566cdc6159b03b7d7f6bf116043"
server_key_iv: "81de35fbbff619741e0855ca98c359c2"
server_key_version: "encryptionkey@0"
I20260808 04:40:21.973956 24999 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786164000593138-21443-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786164000593138-21443-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786164000593138-21443-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:40:21.995333 24999 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:40:21.999290 24999 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:40:21.999541 24999 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:40:22.000367 24999 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 04:40:22.001514 24999 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 04:40:22.001590 24999 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:22.001662 24999 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 04:40:22.001709 24999 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:22.011658 24999 rpc_server.cc:307] RPC server started. Bound to: 127.20.240.195:39009
I20260808 04:40:22.011715 25128 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.240.195:39009 every 8 connection(s)
I20260808 04:40:22.012669 24999 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786164000593138-21443-0/minicluster-data/ts-2/data/info.pb
I20260808 04:40:22.014422 21443 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu as pid 24999
I20260808 04:40:22.014556 21443 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786164000593138-21443-0/minicluster-data/ts-2/wal/instance
I20260808 04:40:22.014896 21443 external_mini_cluster.cc:1428] Setting key 00ca3f4ce7ec3fb1299dfddc953b4a69
Aug 08 04:40:22 dist-test-slave-vxj2 krb5kdc[24612](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164021, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.240.195@KRBTEST.COM for kudu/127.20.240.254@KRBTEST.COM
I20260808 04:40:22.028789 24698 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:22.014732 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.240.195:37763 (local address 127.20.240.254:35891)
0808 04:40:22.014985 (+ 253us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:22.014989 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:22.016233 (+ 1244us) server_negotiation.cc:407] Connection header received
0808 04:40:22.018033 (+ 1800us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:22.018036 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:22.018092 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:22.018172 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:22.019401 (+ 1229us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:22.019933 (+ 532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:22.021103 (+ 1170us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:22.021506 (+ 403us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:22.021610 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:22.024593 (+ 2983us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:40:22.024596 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:40:22.024598 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:40:22.024628 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:40:22.026255 (+ 1627us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:22.026892 (+ 637us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:22.026895 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:22.026897 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:22.026982 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:22.027348 (+ 366us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:22.027351 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:22.027353 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:22.027581 (+ 228us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:40:22.027664 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:22.028387 (+ 723us) server_negotiation.cc:299] Negotiation successful
0808 04:40:22.028571 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260808 04:40:22.029865 25131 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:22.015357 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:35891 (local address 127.20.240.195:37763)
0808 04:40:22.016067 (+ 710us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:22.016136 (+ 69us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:22.017826 (+ 1690us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:22.018363 (+ 537us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:22.018370 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:22.018751 (+ 381us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:40:22.019252 (+ 501us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:22.019266 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:22.020056 (+ 790us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:22.020060 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:22.020970 (+ 910us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:22.020981 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:22.021658 (+ 677us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:22.021663 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:22.021900 (+ 237us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:22.022614 (+ 714us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:40:22.022632 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:40:22.024375 (+ 1743us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:40:22.026369 (+ 1994us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:22.026374 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:22.026389 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:22.026757 (+ 368us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:22.027098 (+ 341us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:22.027102 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:22.027104 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:22.027263 (+ 159us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:22.027683 (+ 420us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:40:22.027691 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:40:22.028074 (+ 383us) client_negotiation.cc:769] Sending connection context
0808 04:40:22.028307 (+ 233us) client_negotiation.cc:240] Negotiation successful
0808 04:40:22.028690 (+ 383us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":394,"thread_start_us":177,"threads_started":1}
I20260808 04:40:22.031025 25129 heartbeater.cc:347] Connected to a master server at 127.20.240.254:35891
I20260808 04:40:22.031291 25129 heartbeater.cc:464] Registering TS with master...
I20260808 04:40:22.031840 25129 heartbeater.cc:511] Master 127.20.240.254:35891 requested a full tablet report, sending...
I20260808 04:40:22.032948 24658 ts_manager.cc:194] Registered new tserver with Master: bd0dab4a728c4fe3a15ff605767fbb00 (127.20.240.195:39009)
I20260808 04:40:22.033761 24658 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.240.195@KRBTEST.COM'} at 127.20.240.195:37763
I20260808 04:40:22.042068 21443 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 08 04:40:22 dist-test-slave-vxj2 krb5kdc[24612](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164022, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for joe-interloper@KRBTEST.COM:
Aug 08 04:40:22 dist-test-slave-vxj2 krb5kdc[24612](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164022, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.20.240.254@KRBTEST.COM
I20260808 04:40:22.070557 24698 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:22.060942 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55450 (local address 127.20.240.254:35891)
0808 04:40:22.061128 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:22.061133 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:22.061302 (+ 169us) server_negotiation.cc:407] Connection header received
0808 04:40:22.061470 (+ 168us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:22.061473 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:22.061524 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:22.061608 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:22.062437 (+ 829us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:22.062982 (+ 545us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:22.063864 (+ 882us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:22.064090 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:22.064195 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:22.067056 (+ 2861us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:40:22.067059 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:40:22.067061 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:40:22.067094 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:40:22.068642 (+ 1548us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:22.069122 (+ 480us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:22.069125 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:22.069126 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:22.069308 (+ 182us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:22.069621 (+ 313us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:22.069624 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:22.069625 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:22.069938 (+ 313us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:40:22.070051 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:22.070311 (+ 260us) server_negotiation.cc:299] Negotiation successful
0808 04:40:22.070427 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
W20260808 04:40:22.071051 24658 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.ConnectToMaster from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:55450
I20260808 04:40:22.072196 21443 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu with pid 24722
I20260808 04:40:22.082015 21443 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu with pid 24860
I20260808 04:40:22.088236 21443 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu with pid 24999
I20260808 04:40:22.096382 21443 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu with pid 24625
2026-08-08T04:40:22Z chronyd exiting
[ OK ] SecurityITest.TestUnauthorizedClientKerberosCredentials (3335 ms)
[ RUN ] SecurityITest.TestAuthorizedSuperuser
Loading random data
Initializing database '/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786164000593138-21443-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 04:40:22 dist-test-slave-vxj2 krb5kdc[25142](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 04:40:22 dist-test-slave-vxj2 krb5kdc[25142](info): set up 2 sockets
Aug 08 04:40:22 dist-test-slave-vxj2 krb5kdc[25142](info): commencing operation
krb5kdc: starting...
W20260808 04:40:23.211542 21443 mini_kdc.cc:121] Time spent starting KDC: real 1.091s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786164000593138-21443-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786164000593138-21443-0/krb5kdc/test-user.keytab.
Aug 08 04:40:23 dist-test-slave-vxj2 krb5kdc[25142](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164023, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T04:40:23Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T04:40:23Z Disabled control of system clock
WARNING: no policy specified for kudu/127.20.240.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.240.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.240.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.254.keytab.
Entry for principal kudu/127.20.240.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.254.keytab.
I20260808 04:40:23.345564 21443 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
/tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786164000593138-21443-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786164000593138-21443-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786164000593138-21443-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786164000593138-21443-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.240.254:33641
--webserver_interface=127.20.240.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.254.keytab
--principal=kudu/127.20.240.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.240.212:33109
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.240.254:33641
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786164000593138-21443-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786164000593138-21443-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786164000593138-21443-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 04:40:23.462673 25157 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:40:23.463028 25157 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:40:23.463129 25157 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:40:23.467298 25157 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 04:40:23.467415 25157 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:40:23.467459 25157 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:40:23.467504 25157 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 04:40:23.467545 25157 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 04:40:23.473271 25157 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.240.212:33109
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786164000593138-21443-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786164000593138-21443-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.240.254:33641
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.254.keytab
--principal=kudu/127.20.240.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.240.254:33641
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786164000593138-21443-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.240.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25157
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786164000593138-21443-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 04:05:18 UTC on ccycloud.quasar-drfdgt.root.comops.site
build id 4574101
I20260808 04:40:23.474493 25157 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:40:23.475570 25157 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:40:23.484490 25163 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:40:23.484498 25162 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:40:23.484699 25157 server_base.cc:1034] running on GCE node
W20260808 04:40:23.484674 25165 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:40:23.485502 25157 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:40:23.486784 25157 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:40:23.487974 25157 hybrid_clock.cc:648] HybridClock initialized: now 1786164023487943 us; error 42 us; skew 500 ppm
Aug 08 04:40:23 dist-test-slave-vxj2 krb5kdc[25142](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164023, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.240.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:40:23.490978 25157 init.cc:377] Logged in from keytab as kudu/127.20.240.254@KRBTEST.COM (short username kudu)
I20260808 04:40:23.492041 25157 webserver.cc:460] Webserver started at http://127.20.240.254:37917/ using document root <none> and password file <none>
I20260808 04:40:23.492652 25157 fs_manager.cc:359] Metadata directory not provided
I20260808 04:40:23.492744 25157 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:40:23.492996 25157 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 04:40:23.495275 25157 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786164000593138-21443-0/minicluster-data/master-0/data/instance:
uuid: "fa04ce6a6bce472eaa4257ff025d8461"
format_stamp: "Formatted at 2026-08-08 04:40:23 on dist-test-slave-vxj2"
server_key: "fcdd716868b9ff448208b71099c81545"
server_key_iv: "1bb08bf831cae77bfc15f5c94ff26ae9"
server_key_version: "encryptionkey@0"
I20260808 04:40:23.495898 25157 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786164000593138-21443-0/minicluster-data/master-0/wal/instance:
uuid: "fa04ce6a6bce472eaa4257ff025d8461"
format_stamp: "Formatted at 2026-08-08 04:40:23 on dist-test-slave-vxj2"
server_key: "fcdd716868b9ff448208b71099c81545"
server_key_iv: "1bb08bf831cae77bfc15f5c94ff26ae9"
server_key_version: "encryptionkey@0"
I20260808 04:40:23.499930 25157 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260808 04:40:23.502578 25173 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:23.503947 25157 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260808 04:40:23.504115 25157 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786164000593138-21443-0/minicluster-data/master-0/data,/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786164000593138-21443-0/minicluster-data/master-0/wal
uuid: "fa04ce6a6bce472eaa4257ff025d8461"
format_stamp: "Formatted at 2026-08-08 04:40:23 on dist-test-slave-vxj2"
server_key: "fcdd716868b9ff448208b71099c81545"
server_key_iv: "1bb08bf831cae77bfc15f5c94ff26ae9"
server_key_version: "encryptionkey@0"
I20260808 04:40:23.504241 25157 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786164000593138-21443-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786164000593138-21443-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786164000593138-21443-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:40:23.544071 25157 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:40:23.547684 25157 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:40:23.548005 25157 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:40:23.556216 25157 rpc_server.cc:307] RPC server started. Bound to: 127.20.240.254:33641
I20260808 04:40:23.556250 25229 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.240.254:33641 every 8 connection(s)
I20260808 04:40:23.557384 25157 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786164000593138-21443-0/minicluster-data/master-0/data/info.pb
I20260808 04:40:23.560551 25230 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:40:23.563050 21443 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu as pid 25157
I20260808 04:40:23.563192 21443 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786164000593138-21443-0/minicluster-data/master-0/wal/instance
I20260808 04:40:23.563493 21443 external_mini_cluster.cc:1428] Setting key d6f75b424293d56ea8229d3ab3e23f6f
I20260808 04:40:23.567529 25230 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fa04ce6a6bce472eaa4257ff025d8461: Bootstrap starting.
I20260808 04:40:23.569976 25230 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P fa04ce6a6bce472eaa4257ff025d8461: Neither blocks nor log segments found. Creating new log.
I20260808 04:40:23.570935 25230 log.cc:824] T 00000000000000000000000000000000 P fa04ce6a6bce472eaa4257ff025d8461: Log is configured to *not* fsync() on all Append() calls
I20260808 04:40:23.573330 25230 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fa04ce6a6bce472eaa4257ff025d8461: No bootstrap required, opened a new log
Aug 08 04:40:23 dist-test-slave-vxj2 krb5kdc[25142](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164023, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.240.254@KRBTEST.COM
I20260808 04:40:23.577596 25230 raft_consensus.cc:348] T 00000000000000000000000000000000 P fa04ce6a6bce472eaa4257ff025d8461 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fa04ce6a6bce472eaa4257ff025d8461" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 33641 } }
I20260808 04:40:23.577921 25230 raft_consensus.cc:374] T 00000000000000000000000000000000 P fa04ce6a6bce472eaa4257ff025d8461 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:40:23.578006 25230 raft_consensus.cc:729] T 00000000000000000000000000000000 P fa04ce6a6bce472eaa4257ff025d8461 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fa04ce6a6bce472eaa4257ff025d8461, State: Initialized, Role: FOLLOWER
I20260808 04:40:23.578613 25230 consensus_queue.cc:260] T 00000000000000000000000000000000 P fa04ce6a6bce472eaa4257ff025d8461 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fa04ce6a6bce472eaa4257ff025d8461" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 33641 } }
I20260808 04:40:23.578874 25230 raft_consensus.cc:388] T 00000000000000000000000000000000 P fa04ce6a6bce472eaa4257ff025d8461 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 04:40:23.578975 25230 raft_consensus.cc:482] T 00000000000000000000000000000000 P fa04ce6a6bce472eaa4257ff025d8461 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 04:40:23.579124 25230 raft_consensus.cc:3037] T 00000000000000000000000000000000 P fa04ce6a6bce472eaa4257ff025d8461 [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:40:23.580345 25230 raft_consensus.cc:504] T 00000000000000000000000000000000 P fa04ce6a6bce472eaa4257ff025d8461 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fa04ce6a6bce472eaa4257ff025d8461" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 33641 } }
I20260808 04:40:23.580564 25233 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:23.565191 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43904 (local address 127.20.240.254:33641)
0808 04:40:23.565684 (+ 493us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:23.565705 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:23.565744 (+ 39us) server_negotiation.cc:407] Connection header received
0808 04:40:23.566577 (+ 833us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:23.566597 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:23.566983 (+ 386us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:23.567338 (+ 355us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:23.568275 (+ 937us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:23.569349 (+ 1074us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:23.570251 (+ 902us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:23.570988 (+ 737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:23.571183 (+ 195us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:23.574224 (+ 3041us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:40:23.574229 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:40:23.574244 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:40:23.574272 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:40:23.577050 (+ 2778us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:23.577706 (+ 656us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:23.577711 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:23.577716 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:23.577920 (+ 204us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:23.578308 (+ 388us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:23.578312 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:23.578314 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:23.578807 (+ 493us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:40:23.579068 (+ 261us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:23.579371 (+ 303us) server_negotiation.cc:299] Negotiation successful
0808 04:40:23.579708 (+ 337us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":338,"thread_start_us":150,"threads_started":1}
I20260808 04:40:23.580781 25230 leader_election.cc:302] T 00000000000000000000000000000000 P fa04ce6a6bce472eaa4257ff025d8461 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: fa04ce6a6bce472eaa4257ff025d8461; no voters:
I20260808 04:40:23.581213 25230 leader_election.cc:288] T 00000000000000000000000000000000 P fa04ce6a6bce472eaa4257ff025d8461 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 04:40:23.581382 25235 raft_consensus.cc:2781] T 00000000000000000000000000000000 P fa04ce6a6bce472eaa4257ff025d8461 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 04:40:23.581616 25235 raft_consensus.cc:686] T 00000000000000000000000000000000 P fa04ce6a6bce472eaa4257ff025d8461 [term 1 LEADER]: Becoming Leader. State: Replica: fa04ce6a6bce472eaa4257ff025d8461, State: Running, Role: LEADER
I20260808 04:40:23.582561 25230 sys_catalog.cc:564] T 00000000000000000000000000000000 P fa04ce6a6bce472eaa4257ff025d8461 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 04:40:23.583106 25235 consensus_queue.cc:237] T 00000000000000000000000000000000 P fa04ce6a6bce472eaa4257ff025d8461 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fa04ce6a6bce472eaa4257ff025d8461" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 33641 } }
I20260808 04:40:23.584916 25236 sys_catalog.cc:455] T 00000000000000000000000000000000 P fa04ce6a6bce472eaa4257ff025d8461 [sys.catalog]: SysCatalogTable state changed. Reason: New leader fa04ce6a6bce472eaa4257ff025d8461. Latest consensus state: current_term: 1 leader_uuid: "fa04ce6a6bce472eaa4257ff025d8461" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fa04ce6a6bce472eaa4257ff025d8461" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 33641 } } }
I20260808 04:40:23.585062 25236 sys_catalog.cc:458] T 00000000000000000000000000000000 P fa04ce6a6bce472eaa4257ff025d8461 [sys.catalog]: This master's current role is: LEADER
I20260808 04:40:23.584913 25237 sys_catalog.cc:455] T 00000000000000000000000000000000 P fa04ce6a6bce472eaa4257ff025d8461 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "fa04ce6a6bce472eaa4257ff025d8461" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fa04ce6a6bce472eaa4257ff025d8461" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 33641 } } }
I20260808 04:40:23.585588 25237 sys_catalog.cc:458] T 00000000000000000000000000000000 P fa04ce6a6bce472eaa4257ff025d8461 [sys.catalog]: This master's current role is: LEADER
W20260808 04:40:23.587942 25252 catalog_manager.cc:1558] T 00000000000000000000000000000000 P fa04ce6a6bce472eaa4257ff025d8461: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 04:40:23.588016 25252 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 04:40:23.588114 25253 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 04:40:23.589100 25253 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 04:40:23.595232 25253 catalog_manager.cc:1347] Generated new cluster ID: 8b1ccbea61d34539a5f5cd1ac5047043
I20260808 04:40:23.595324 25253 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 04:40:23.610641 25253 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 04:40:23.612213 25253 catalog_manager.cc:1504] Loading token signing keys...
I20260808 04:40:23.622869 25253 catalog_manager.cc:5868] T 00000000000000000000000000000000 P fa04ce6a6bce472eaa4257ff025d8461: Generated new TSK 0
I20260808 04:40:23.623765 25253 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.20.240.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.240.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.240.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.193.keytab.
Entry for principal kudu/127.20.240.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.193.keytab.
I20260808 04:40:23.661273 21443 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
/tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786164000593138-21443-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786164000593138-21443-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786164000593138-21443-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786164000593138-21443-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.240.193:0
--local_ip_for_outbound_sockets=127.20.240.193
--webserver_interface=127.20.240.193
--webserver_port=0
--tserver_master_addrs=127.20.240.254:33641
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.193.keytab
--principal=kudu/127.20.240.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.240.212:33109
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786164000593138-21443-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786164000593138-21443-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786164000593138-21443-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 04:40:23.783424 25260 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:40:23.783826 25260 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:40:23.783906 25260 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:40:23.788195 25260 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:40:23.788280 25260 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:40:23.788383 25260 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.240.193
I20260808 04:40:23.793829 25260 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.240.212:33109
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786164000593138-21443-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786164000593138-21443-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.193.keytab
--principal=kudu/127.20.240.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.240.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786164000593138-21443-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.240.193
--webserver_port=0
--tserver_master_addrs=127.20.240.254:33641
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25260
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.240.193
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786164000593138-21443-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 04:05:18 UTC on ccycloud.quasar-drfdgt.root.comops.site
build id 4574101
I20260808 04:40:23.795022 25260 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:40:23.796101 25260 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:40:23.806367 25265 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:40:23.806388 25268 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:40:23.806452 25266 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:40:23.806577 25260 server_base.cc:1034] running on GCE node
I20260808 04:40:23.807195 25260 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:40:23.807868 25260 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:40:23.809034 25260 hybrid_clock.cc:648] HybridClock initialized: now 1786164023809010 us; error 34 us; skew 500 ppm
Aug 08 04:40:23 dist-test-slave-vxj2 krb5kdc[25142](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164023, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.240.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:40:23.812107 25260 init.cc:377] Logged in from keytab as kudu/127.20.240.193@KRBTEST.COM (short username kudu)
I20260808 04:40:23.813098 25260 webserver.cc:460] Webserver started at http://127.20.240.193:42225/ using document root <none> and password file <none>
I20260808 04:40:23.813726 25260 fs_manager.cc:359] Metadata directory not provided
I20260808 04:40:23.813823 25260 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:40:23.814064 25260 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 04:40:23.816226 25260 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786164000593138-21443-0/minicluster-data/ts-0/data/instance:
uuid: "5c1a2309663945fb9e11b487079958db"
format_stamp: "Formatted at 2026-08-08 04:40:23 on dist-test-slave-vxj2"
server_key: "083ede0cd773054ed693e6bf65ab4686"
server_key_iv: "c0d4d686294bcbafab99694513dba6c8"
server_key_version: "encryptionkey@0"
I20260808 04:40:23.816874 25260 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786164000593138-21443-0/minicluster-data/ts-0/wal/instance:
uuid: "5c1a2309663945fb9e11b487079958db"
format_stamp: "Formatted at 2026-08-08 04:40:23 on dist-test-slave-vxj2"
server_key: "083ede0cd773054ed693e6bf65ab4686"
server_key_iv: "c0d4d686294bcbafab99694513dba6c8"
server_key_version: "encryptionkey@0"
I20260808 04:40:23.821084 25260 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.001s
I20260808 04:40:23.823698 25276 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:23.825040 25260 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260808 04:40:23.825225 25260 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786164000593138-21443-0/minicluster-data/ts-0/data,/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786164000593138-21443-0/minicluster-data/ts-0/wal
uuid: "5c1a2309663945fb9e11b487079958db"
format_stamp: "Formatted at 2026-08-08 04:40:23 on dist-test-slave-vxj2"
server_key: "083ede0cd773054ed693e6bf65ab4686"
server_key_iv: "c0d4d686294bcbafab99694513dba6c8"
server_key_version: "encryptionkey@0"
I20260808 04:40:23.825363 25260 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786164000593138-21443-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786164000593138-21443-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786164000593138-21443-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:40:23.837649 25260 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:40:23.841358 25260 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:40:23.841634 25260 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:40:23.842324 25260 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 04:40:23.843272 25260 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 04:40:23.843349 25260 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:23.843434 25260 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 04:40:23.843483 25260 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:23.853302 25260 rpc_server.cc:307] RPC server started. Bound to: 127.20.240.193:43791
I20260808 04:40:23.853332 25395 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.240.193:43791 every 8 connection(s)
I20260808 04:40:23.854242 25260 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786164000593138-21443-0/minicluster-data/ts-0/data/info.pb
I20260808 04:40:23.859201 21443 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu as pid 25260
I20260808 04:40:23.859349 21443 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786164000593138-21443-0/minicluster-data/ts-0/wal/instance
I20260808 04:40:23.859643 21443 external_mini_cluster.cc:1428] Setting key 2214f426fd592f64fcb9cc954f816cac
Aug 08 04:40:23 dist-test-slave-vxj2 krb5kdc[25142](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164023, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.240.193@KRBTEST.COM for kudu/127.20.240.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.20.240.194@KRBTEST.COM; defaulting to no policy
I20260808 04:40:23.869086 25233 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:23.856155 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.240.193:44441 (local address 127.20.240.254:33641)
0808 04:40:23.856300 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:23.856305 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:23.857181 (+ 876us) server_negotiation.cc:407] Connection header received
0808 04:40:23.858599 (+ 1418us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:23.858602 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:23.858651 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:23.858727 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:23.860085 (+ 1358us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:23.860756 (+ 671us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:23.862071 (+ 1315us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:23.862319 (+ 248us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:23.862438 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:23.865386 (+ 2948us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:40:23.865389 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:40:23.865391 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:40:23.865417 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:40:23.866938 (+ 1521us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:23.867480 (+ 542us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:23.867484 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:23.867485 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:23.867564 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:23.867928 (+ 364us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:23.867931 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:23.867933 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:23.868125 (+ 192us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:40:23.868234 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:23.868769 (+ 535us) server_negotiation.cc:299] Negotiation successful
0808 04:40:23.868912 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260808 04:40:23.869997 25398 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:23.856545 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:33641 (local address 127.20.240.193:44441)
0808 04:40:23.856994 (+ 449us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:23.857039 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:23.858378 (+ 1339us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:23.858930 (+ 552us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:23.858937 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:23.859288 (+ 351us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:40:23.859922 (+ 634us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:23.859939 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:23.860940 (+ 1001us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:23.860946 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:23.861937 (+ 991us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:23.861946 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:23.862479 (+ 533us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:23.862483 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:23.862720 (+ 237us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:23.863448 (+ 728us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:40:23.863474 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:40:23.865199 (+ 1725us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:40:23.867067 (+ 1868us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:23.867073 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:23.867089 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:23.867363 (+ 274us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:23.867656 (+ 293us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:23.867661 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:23.867662 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:23.867822 (+ 160us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:23.868233 (+ 411us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:40:23.868241 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:40:23.868518 (+ 277us) client_negotiation.cc:769] Sending connection context
0808 04:40:23.868710 (+ 192us) client_negotiation.cc:240] Negotiation successful
0808 04:40:23.869073 (+ 363us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":265,"thread_start_us":108,"threads_started":1}
I20260808 04:40:23.871379 25396 heartbeater.cc:347] Connected to a master server at 127.20.240.254:33641
I20260808 04:40:23.871614 25396 heartbeater.cc:464] Registering TS with master...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.240.194@KRBTEST.COM" created.
I20260808 04:40:23.872291 25396 heartbeater.cc:511] Master 127.20.240.254:33641 requested a full tablet report, sending...
I20260808 04:40:23.874078 25191 ts_manager.cc:194] Registered new tserver with Master: 5c1a2309663945fb9e11b487079958db (127.20.240.193:43791)
I20260808 04:40:23.875254 25191 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.240.193@KRBTEST.COM'} at 127.20.240.193:44441
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.240.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.194.keytab.
Entry for principal kudu/127.20.240.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.194.keytab.
I20260808 04:40:23.889142 21443 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
/tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786164000593138-21443-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786164000593138-21443-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786164000593138-21443-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786164000593138-21443-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.240.194:0
--local_ip_for_outbound_sockets=127.20.240.194
--webserver_interface=127.20.240.194
--webserver_port=0
--tserver_master_addrs=127.20.240.254:33641
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.194.keytab
--principal=kudu/127.20.240.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.240.212:33109
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786164000593138-21443-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786164000593138-21443-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786164000593138-21443-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 04:40:24.002224 25401 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:40:24.002548 25401 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:40:24.002622 25401 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:40:24.006902 25401 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:40:24.007002 25401 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:40:24.007122 25401 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.240.194
I20260808 04:40:24.012688 25401 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.240.212:33109
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786164000593138-21443-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786164000593138-21443-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.194.keytab
--principal=kudu/127.20.240.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.240.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786164000593138-21443-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.240.194
--webserver_port=0
--tserver_master_addrs=127.20.240.254:33641
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25401
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.240.194
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786164000593138-21443-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 04:05:18 UTC on ccycloud.quasar-drfdgt.root.comops.site
build id 4574101
I20260808 04:40:24.013916 25401 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:40:24.014963 25401 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:40:24.024937 25407 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:40:24.025195 25406 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:40:24.025091 25401 server_base.cc:1034] running on GCE node
W20260808 04:40:24.024909 25409 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:40:24.025667 25401 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:40:24.026386 25401 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:40:24.027555 25401 hybrid_clock.cc:648] HybridClock initialized: now 1786164024027538 us; error 28 us; skew 500 ppm
Aug 08 04:40:24 dist-test-slave-vxj2 krb5kdc[25142](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164024, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.240.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:40:24.030699 25401 init.cc:377] Logged in from keytab as kudu/127.20.240.194@KRBTEST.COM (short username kudu)
I20260808 04:40:24.031718 25401 webserver.cc:460] Webserver started at http://127.20.240.194:41695/ using document root <none> and password file <none>
I20260808 04:40:24.032318 25401 fs_manager.cc:359] Metadata directory not provided
I20260808 04:40:24.032418 25401 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:40:24.032657 25401 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 04:40:24.034945 25401 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786164000593138-21443-0/minicluster-data/ts-1/data/instance:
uuid: "965e0e7b96d84c78b9e0fad905bc07f2"
format_stamp: "Formatted at 2026-08-08 04:40:24 on dist-test-slave-vxj2"
server_key: "34c6b29a39feb33386d3039f4962ca1b"
server_key_iv: "9a5e6a1481a50efd96e84650d32bb62e"
server_key_version: "encryptionkey@0"
I20260808 04:40:24.035648 25401 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786164000593138-21443-0/minicluster-data/ts-1/wal/instance:
uuid: "965e0e7b96d84c78b9e0fad905bc07f2"
format_stamp: "Formatted at 2026-08-08 04:40:24 on dist-test-slave-vxj2"
server_key: "34c6b29a39feb33386d3039f4962ca1b"
server_key_iv: "9a5e6a1481a50efd96e84650d32bb62e"
server_key_version: "encryptionkey@0"
I20260808 04:40:24.039966 25401 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.003s
I20260808 04:40:24.043218 25417 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:24.044690 25401 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260808 04:40:24.044919 25401 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786164000593138-21443-0/minicluster-data/ts-1/data,/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786164000593138-21443-0/minicluster-data/ts-1/wal
uuid: "965e0e7b96d84c78b9e0fad905bc07f2"
format_stamp: "Formatted at 2026-08-08 04:40:24 on dist-test-slave-vxj2"
server_key: "34c6b29a39feb33386d3039f4962ca1b"
server_key_iv: "9a5e6a1481a50efd96e84650d32bb62e"
server_key_version: "encryptionkey@0"
I20260808 04:40:24.045066 25401 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786164000593138-21443-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786164000593138-21443-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786164000593138-21443-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:40:24.056543 25401 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:40:24.060070 25401 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:40:24.060305 25401 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:40:24.060952 25401 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 04:40:24.061885 25401 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 04:40:24.061957 25401 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:24.062033 25401 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 04:40:24.062078 25401 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:24.071337 25401 rpc_server.cc:307] RPC server started. Bound to: 127.20.240.194:37033
I20260808 04:40:24.071378 25538 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.240.194:37033 every 8 connection(s)
I20260808 04:40:24.072332 25401 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786164000593138-21443-0/minicluster-data/ts-1/data/info.pb
I20260808 04:40:24.076120 21443 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu as pid 25401
I20260808 04:40:24.076345 21443 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786164000593138-21443-0/minicluster-data/ts-1/wal/instance
I20260808 04:40:24.076707 21443 external_mini_cluster.cc:1428] Setting key 1eec98b013d49919acf929b56348e031
Aug 08 04:40:24 dist-test-slave-vxj2 krb5kdc[25142](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164024, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.240.194@KRBTEST.COM for kudu/127.20.240.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.20.240.195@KRBTEST.COM; defaulting to no policy
I20260808 04:40:24.090756 25233 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:24.074481 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.240.194:43737 (local address 127.20.240.254:33641)
0808 04:40:24.074648 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:24.074654 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:24.075578 (+ 924us) server_negotiation.cc:407] Connection header received
0808 04:40:24.077735 (+ 2157us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:24.077738 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:24.077785 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:24.077897 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:24.079563 (+ 1666us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:24.080646 (+ 1083us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:24.082402 (+ 1756us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:24.082850 (+ 448us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:24.082981 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:24.086137 (+ 3156us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:40:24.086141 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:40:24.086144 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:40:24.086181 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:40:24.088180 (+ 1999us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:24.088794 (+ 614us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:24.088797 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:24.088798 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:24.088896 (+ 98us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:24.089455 (+ 559us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:24.089458 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:24.089462 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:24.089676 (+ 214us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:40:24.089767 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:24.090459 (+ 692us) server_negotiation.cc:299] Negotiation successful
0808 04:40:24.090621 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.240.195@KRBTEST.COM" created.
I20260808 04:40:24.091742 25541 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:24.074914 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:33641 (local address 127.20.240.194:43737)
0808 04:40:24.075398 (+ 484us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:24.075442 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:24.077459 (+ 2017us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:24.078151 (+ 692us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:24.078162 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:24.078804 (+ 642us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:40:24.079377 (+ 573us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:24.079396 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:24.080831 (+ 1435us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:24.080836 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:24.082219 (+ 1383us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:24.082230 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:24.083050 (+ 820us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:24.083053 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:24.083262 (+ 209us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:24.084018 (+ 756us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:40:24.084038 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:40:24.085927 (+ 1889us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:40:24.088363 (+ 2436us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:24.088370 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:24.088385 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:24.088671 (+ 286us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:24.089025 (+ 354us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:24.089029 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:24.089030 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:24.089323 (+ 293us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:24.089818 (+ 495us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:40:24.089824 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:40:24.090121 (+ 297us) client_negotiation.cc:769] Sending connection context
0808 04:40:24.090327 (+ 206us) client_negotiation.cc:240] Negotiation successful
0808 04:40:24.090703 (+ 376us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":284,"thread_start_us":115,"threads_started":1}
I20260808 04:40:24.093134 25539 heartbeater.cc:347] Connected to a master server at 127.20.240.254:33641
I20260808 04:40:24.093452 25539 heartbeater.cc:464] Registering TS with master...
I20260808 04:40:24.093983 25539 heartbeater.cc:511] Master 127.20.240.254:33641 requested a full tablet report, sending...
I20260808 04:40:24.095080 25191 ts_manager.cc:194] Registered new tserver with Master: 965e0e7b96d84c78b9e0fad905bc07f2 (127.20.240.194:37033)
I20260808 04:40:24.095683 25191 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.240.194@KRBTEST.COM'} at 127.20.240.194:43737
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.240.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.195.keytab.
Entry for principal kudu/127.20.240.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.195.keytab.
I20260808 04:40:24.109783 21443 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
/tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786164000593138-21443-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786164000593138-21443-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786164000593138-21443-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786164000593138-21443-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.240.195:0
--local_ip_for_outbound_sockets=127.20.240.195
--webserver_interface=127.20.240.195
--webserver_port=0
--tserver_master_addrs=127.20.240.254:33641
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.195.keytab
--principal=kudu/127.20.240.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.240.212:33109
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786164000593138-21443-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786164000593138-21443-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786164000593138-21443-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 04:40:24.225559 25545 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:40:24.225883 25545 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:40:24.225968 25545 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:40:24.230248 25545 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:40:24.230373 25545 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:40:24.230443 25545 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.240.195
I20260808 04:40:24.236011 25545 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.240.212:33109
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786164000593138-21443-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786164000593138-21443-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.195.keytab
--principal=kudu/127.20.240.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.240.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786164000593138-21443-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.240.195
--webserver_port=0
--tserver_master_addrs=127.20.240.254:33641
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25545
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.240.195
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786164000593138-21443-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 04:05:18 UTC on ccycloud.quasar-drfdgt.root.comops.site
build id 4574101
I20260808 04:40:24.237126 25545 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:40:24.238265 25545 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:40:24.248263 25551 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:40:24.248245 25553 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:40:24.248214 25550 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:40:24.248507 25545 server_base.cc:1034] running on GCE node
I20260808 04:40:24.249035 25545 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:40:24.249889 25545 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:40:24.251114 25545 hybrid_clock.cc:648] HybridClock initialized: now 1786164024251092 us; error 37 us; skew 500 ppm
Aug 08 04:40:24 dist-test-slave-vxj2 krb5kdc[25142](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164024, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.240.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:40:24.254227 25545 init.cc:377] Logged in from keytab as kudu/127.20.240.195@KRBTEST.COM (short username kudu)
I20260808 04:40:24.255195 25545 webserver.cc:460] Webserver started at http://127.20.240.195:39635/ using document root <none> and password file <none>
I20260808 04:40:24.255746 25545 fs_manager.cc:359] Metadata directory not provided
I20260808 04:40:24.255807 25545 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:40:24.255982 25545 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 04:40:24.258246 25545 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786164000593138-21443-0/minicluster-data/ts-2/data/instance:
uuid: "46c8e0f88c4044f0a971cf8624f947e7"
format_stamp: "Formatted at 2026-08-08 04:40:24 on dist-test-slave-vxj2"
server_key: "cfa840cde9f40c0ae69a9ccb7fd3c78b"
server_key_iv: "159b8221a6e932004ae200b42910b112"
server_key_version: "encryptionkey@0"
I20260808 04:40:24.258795 25545 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786164000593138-21443-0/minicluster-data/ts-2/wal/instance:
uuid: "46c8e0f88c4044f0a971cf8624f947e7"
format_stamp: "Formatted at 2026-08-08 04:40:24 on dist-test-slave-vxj2"
server_key: "cfa840cde9f40c0ae69a9ccb7fd3c78b"
server_key_iv: "159b8221a6e932004ae200b42910b112"
server_key_version: "encryptionkey@0"
I20260808 04:40:24.262773 25545 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260808 04:40:24.265416 25560 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:24.266793 25545 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 04:40:24.266928 25545 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786164000593138-21443-0/minicluster-data/ts-2/data,/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786164000593138-21443-0/minicluster-data/ts-2/wal
uuid: "46c8e0f88c4044f0a971cf8624f947e7"
format_stamp: "Formatted at 2026-08-08 04:40:24 on dist-test-slave-vxj2"
server_key: "cfa840cde9f40c0ae69a9ccb7fd3c78b"
server_key_iv: "159b8221a6e932004ae200b42910b112"
server_key_version: "encryptionkey@0"
I20260808 04:40:24.267056 25545 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786164000593138-21443-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786164000593138-21443-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786164000593138-21443-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:40:24.278671 25545 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:40:24.282111 25545 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:40:24.282383 25545 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:40:24.283030 25545 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 04:40:24.283994 25545 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 04:40:24.284044 25545 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:24.284114 25545 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 04:40:24.284152 25545 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:24.293504 25545 rpc_server.cc:307] RPC server started. Bound to: 127.20.240.195:36517
I20260808 04:40:24.293555 25679 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.240.195:36517 every 8 connection(s)
I20260808 04:40:24.294499 25545 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786164000593138-21443-0/minicluster-data/ts-2/data/info.pb
I20260808 04:40:24.296974 21443 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu as pid 25545
I20260808 04:40:24.297132 21443 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786164000593138-21443-0/minicluster-data/ts-2/wal/instance
I20260808 04:40:24.297497 21443 external_mini_cluster.cc:1428] Setting key e5826ae7c3de2620ccb0b6e155f9eda1
Aug 08 04:40:24 dist-test-slave-vxj2 krb5kdc[25142](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164024, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.240.195@KRBTEST.COM for kudu/127.20.240.254@KRBTEST.COM
I20260808 04:40:24.308946 25233 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:24.296446 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.240.195:53457 (local address 127.20.240.254:33641)
0808 04:40:24.296590 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:24.296601 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:24.297523 (+ 922us) server_negotiation.cc:407] Connection header received
0808 04:40:24.299105 (+ 1582us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:24.299107 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:24.299153 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:24.299223 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:24.300474 (+ 1251us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:24.301264 (+ 790us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:24.302447 (+ 1183us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:24.302673 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:24.302756 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:24.305422 (+ 2666us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:40:24.305425 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:40:24.305427 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:40:24.305456 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:40:24.306790 (+ 1334us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:24.307249 (+ 459us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:24.307253 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:24.307255 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:24.307363 (+ 108us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:24.307735 (+ 372us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:24.307803 (+ 68us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:24.307806 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:24.307989 (+ 183us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:40:24.308118 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:24.308579 (+ 461us) server_negotiation.cc:299] Negotiation successful
0808 04:40:24.308724 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260808 04:40:24.309738 25682 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:24.296810 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:33641 (local address 127.20.240.195:53457)
0808 04:40:24.297330 (+ 520us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:24.297385 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:24.298880 (+ 1495us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:24.299407 (+ 527us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:24.299416 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:24.299860 (+ 444us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:40:24.300339 (+ 479us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:24.300353 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:24.301404 (+ 1051us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:24.301406 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:24.302325 (+ 919us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:24.302334 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:24.302841 (+ 507us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:24.302844 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:24.302987 (+ 143us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:24.303647 (+ 660us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:40:24.303663 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:40:24.305234 (+ 1571us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:40:24.306898 (+ 1664us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:24.306903 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:24.306914 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:24.307160 (+ 246us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:24.307487 (+ 327us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:24.307490 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:24.307492 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:24.307646 (+ 154us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:24.308110 (+ 464us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:40:24.308115 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:40:24.308356 (+ 241us) client_negotiation.cc:769] Sending connection context
0808 04:40:24.308519 (+ 163us) client_negotiation.cc:240] Negotiation successful
0808 04:40:24.308771 (+ 252us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":290,"thread_start_us":146,"threads_started":1}
I20260808 04:40:24.311053 25680 heartbeater.cc:347] Connected to a master server at 127.20.240.254:33641
I20260808 04:40:24.311327 25680 heartbeater.cc:464] Registering TS with master...
I20260808 04:40:24.311865 25680 heartbeater.cc:511] Master 127.20.240.254:33641 requested a full tablet report, sending...
I20260808 04:40:24.312899 25190 ts_manager.cc:194] Registered new tserver with Master: 46c8e0f88c4044f0a971cf8624f947e7 (127.20.240.195:36517)
I20260808 04:40:24.313573 25190 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.240.195@KRBTEST.COM'} at 127.20.240.195:53457
I20260808 04:40:24.323661 21443 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 08 04:40:24 dist-test-slave-vxj2 krb5kdc[25142](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164024, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 08 04:40:24 dist-test-slave-vxj2 krb5kdc[25142](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164024, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.240.193@KRBTEST.COM
I20260808 04:40:24.351594 25687 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:24.340942 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44880 (local address 127.20.240.193:43791)
0808 04:40:24.341286 (+ 344us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:24.341308 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:24.341358 (+ 50us) server_negotiation.cc:407] Connection header received
0808 04:40:24.341532 (+ 174us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:24.341542 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:24.341754 (+ 212us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:24.341913 (+ 159us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:24.342676 (+ 763us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:24.343498 (+ 822us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:24.344380 (+ 882us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:24.344788 (+ 408us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:24.344910 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:24.347637 (+ 2727us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:40:24.347647 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:40:24.347662 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:40:24.347690 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:40:24.349600 (+ 1910us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:24.350119 (+ 519us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:24.350124 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:24.350125 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:24.350209 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:24.350507 (+ 298us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:24.350510 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:24.350512 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:24.350778 (+ 266us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:40:24.351025 (+ 247us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:24.351208 (+ 183us) server_negotiation.cc:299] Negotiation successful
0808 04:40:24.351381 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":222,"thread_start_us":89,"threads_started":1}
Aug 08 04:40:24 dist-test-slave-vxj2 krb5kdc[25142](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164024, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.240.254@KRBTEST.COM
I20260808 04:40:24.363283 25233 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:24.354445 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34424 (local address 127.20.240.254:33641)
0808 04:40:24.354603 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:24.354608 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:24.354623 (+ 15us) server_negotiation.cc:407] Connection header received
0808 04:40:24.354781 (+ 158us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:24.354785 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:24.354840 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:24.354924 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:24.355569 (+ 645us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:24.356114 (+ 545us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:24.356913 (+ 799us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:24.357206 (+ 293us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:24.357333 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:24.359908 (+ 2575us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:40:24.359912 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:40:24.359914 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:40:24.359941 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:40:24.361508 (+ 1567us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:24.361940 (+ 432us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:24.361944 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:24.361946 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:24.362041 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:24.362345 (+ 304us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:24.362348 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:24.362350 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:24.362590 (+ 240us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:40:24.362742 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:24.362981 (+ 239us) server_negotiation.cc:299] Negotiation successful
0808 04:40:24.363110 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
W20260808 04:40:24.363757 25190 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34424
I20260808 04:40:24.364445 21443 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu with pid 25260
I20260808 04:40:24.371593 21443 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu with pid 25401
I20260808 04:40:24.380905 21443 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu with pid 25545
I20260808 04:40:24.387138 21443 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu with pid 25157
2026-08-08T04:40:24Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizedSuperuser (2289 ms)
[ RUN ] SecurityITest.TestDisableWebUI
Loading random data
Initializing database '/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786164000593138-21443-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 04:40:24 dist-test-slave-vxj2 krb5kdc[25692](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 04:40:24 dist-test-slave-vxj2 krb5kdc[25692](info): set up 2 sockets
Aug 08 04:40:24 dist-test-slave-vxj2 krb5kdc[25692](info): commencing operation
krb5kdc: starting...
W20260808 04:40:25.480400 21443 mini_kdc.cc:121] Time spent starting KDC: real 1.070s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786164000593138-21443-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786164000593138-21443-0/krb5kdc/test-user.keytab.
Aug 08 04:40:25 dist-test-slave-vxj2 krb5kdc[25692](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164025, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T04:40:25Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T04:40:25Z Disabled control of system clock
WARNING: no policy specified for kudu/127.20.240.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.240.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.240.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.254.keytab.
Entry for principal kudu/127.20.240.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.254.keytab.
I20260808 04:40:25.617561 21443 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
/tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786164000593138-21443-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786164000593138-21443-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786164000593138-21443-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786164000593138-21443-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.240.254:44269
--webserver_interface=127.20.240.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.254.keytab
--principal=kudu/127.20.240.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.240.212:39099
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.240.254:44269
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786164000593138-21443-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786164000593138-21443-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786164000593138-21443-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 04:40:25.733654 25705 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:40:25.733948 25705 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:40:25.733995 25705 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:40:25.738159 25705 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 04:40:25.738230 25705 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:40:25.738250 25705 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:40:25.738267 25705 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 04:40:25.738282 25705 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 04:40:25.743762 25705 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.240.212:39099
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786164000593138-21443-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786164000593138-21443-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.240.254:44269
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.254.keytab
--principal=kudu/127.20.240.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.240.254:44269
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786164000593138-21443-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.240.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25705
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786164000593138-21443-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 04:05:18 UTC on ccycloud.quasar-drfdgt.root.comops.site
build id 4574101
I20260808 04:40:25.744853 25705 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:40:25.745935 25705 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:40:25.754210 25713 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:40:25.754232 25711 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:40:25.754245 25710 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:40:25.754665 25705 server_base.cc:1034] running on GCE node
I20260808 04:40:25.755234 25705 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:40:25.756390 25705 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:40:25.757551 25705 hybrid_clock.cc:648] HybridClock initialized: now 1786164025757518 us; error 43 us; skew 500 ppm
Aug 08 04:40:25 dist-test-slave-vxj2 krb5kdc[25692](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164025, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.240.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:40:25.760679 25705 init.cc:377] Logged in from keytab as kudu/127.20.240.254@KRBTEST.COM (short username kudu)
I20260808 04:40:25.761596 25705 fs_manager.cc:359] Metadata directory not provided
I20260808 04:40:25.761698 25705 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:40:25.761993 25705 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 04:40:25.764189 25705 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786164000593138-21443-0/minicluster-data/master-0/data/instance:
uuid: "5c43223b77c04481abb7d8f854be4b6e"
format_stamp: "Formatted at 2026-08-08 04:40:25 on dist-test-slave-vxj2"
server_key: "b03ce75cb1a3d0ed3bf1565337bca597"
server_key_iv: "5817905d1027f288c01bd425fbf8a8bd"
server_key_version: "encryptionkey@0"
I20260808 04:40:25.764809 25705 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786164000593138-21443-0/minicluster-data/master-0/wal/instance:
uuid: "5c43223b77c04481abb7d8f854be4b6e"
format_stamp: "Formatted at 2026-08-08 04:40:25 on dist-test-slave-vxj2"
server_key: "b03ce75cb1a3d0ed3bf1565337bca597"
server_key_iv: "5817905d1027f288c01bd425fbf8a8bd"
server_key_version: "encryptionkey@0"
I20260808 04:40:25.768795 25705 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.007s sys 0.000s
I20260808 04:40:25.771545 25721 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:25.773017 25705 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260808 04:40:25.773221 25705 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786164000593138-21443-0/minicluster-data/master-0/data,/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786164000593138-21443-0/minicluster-data/master-0/wal
uuid: "5c43223b77c04481abb7d8f854be4b6e"
format_stamp: "Formatted at 2026-08-08 04:40:25 on dist-test-slave-vxj2"
server_key: "b03ce75cb1a3d0ed3bf1565337bca597"
server_key_iv: "5817905d1027f288c01bd425fbf8a8bd"
server_key_version: "encryptionkey@0"
I20260808 04:40:25.773360 25705 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786164000593138-21443-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786164000593138-21443-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786164000593138-21443-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:40:25.797583 25705 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:40:25.801090 25705 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:40:25.801378 25705 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:40:25.809415 25705 rpc_server.cc:307] RPC server started. Bound to: 127.20.240.254:44269
I20260808 04:40:25.809739 25779 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.240.254:44269 every 8 connection(s)
I20260808 04:40:25.810200 25705 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786164000593138-21443-0/minicluster-data/master-0/data/info.pb
I20260808 04:40:25.813115 25780 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:40:25.814857 21443 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu as pid 25705
I20260808 04:40:25.814993 21443 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786164000593138-21443-0/minicluster-data/master-0/wal/instance
I20260808 04:40:25.815285 21443 external_mini_cluster.cc:1428] Setting key 9a16cd769b89fac711db7c791d968fbd
I20260808 04:40:25.820417 25780 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5c43223b77c04481abb7d8f854be4b6e: Bootstrap starting.
I20260808 04:40:25.823165 25780 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5c43223b77c04481abb7d8f854be4b6e: Neither blocks nor log segments found. Creating new log.
I20260808 04:40:25.823997 25780 log.cc:824] T 00000000000000000000000000000000 P 5c43223b77c04481abb7d8f854be4b6e: Log is configured to *not* fsync() on all Append() calls
Aug 08 04:40:25 dist-test-slave-vxj2 krb5kdc[25692](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164025, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.240.254@KRBTEST.COM
I20260808 04:40:25.826493 25780 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5c43223b77c04481abb7d8f854be4b6e: No bootstrap required, opened a new log
I20260808 04:40:25.830721 25780 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5c43223b77c04481abb7d8f854be4b6e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5c43223b77c04481abb7d8f854be4b6e" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 44269 } }
I20260808 04:40:25.830984 25783 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:25.816844 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34556 (local address 127.20.240.254:44269)
0808 04:40:25.817344 (+ 500us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:25.817364 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:25.817409 (+ 45us) server_negotiation.cc:407] Connection header received
0808 04:40:25.818237 (+ 828us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:25.818264 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:25.818703 (+ 439us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:25.819086 (+ 383us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:25.819801 (+ 715us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:25.821296 (+ 1495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:25.822214 (+ 918us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:25.822912 (+ 698us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:25.823097 (+ 185us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:25.826021 (+ 2924us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:40:25.826026 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:40:25.826041 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:40:25.826070 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:40:25.827880 (+ 1810us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:25.828427 (+ 547us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:25.828431 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:25.828436 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:25.828548 (+ 112us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:25.828872 (+ 324us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:25.828874 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:25.828875 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:25.829371 (+ 496us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:40:25.829534 (+ 163us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:25.829844 (+ 310us) server_negotiation.cc:299] Negotiation successful
0808 04:40:25.830188 (+ 344us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":339,"thread_start_us":122,"threads_started":1}
I20260808 04:40:25.830991 25780 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5c43223b77c04481abb7d8f854be4b6e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:40:25.831218 25780 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5c43223b77c04481abb7d8f854be4b6e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5c43223b77c04481abb7d8f854be4b6e, State: Initialized, Role: FOLLOWER
I20260808 04:40:25.831727 25780 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5c43223b77c04481abb7d8f854be4b6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5c43223b77c04481abb7d8f854be4b6e" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 44269 } }
I20260808 04:40:25.831909 25780 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5c43223b77c04481abb7d8f854be4b6e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 04:40:25.831979 25780 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5c43223b77c04481abb7d8f854be4b6e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 04:40:25.832077 25780 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5c43223b77c04481abb7d8f854be4b6e [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:40:25.834149 25780 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5c43223b77c04481abb7d8f854be4b6e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5c43223b77c04481abb7d8f854be4b6e" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 44269 } }
I20260808 04:40:25.834478 25780 leader_election.cc:302] T 00000000000000000000000000000000 P 5c43223b77c04481abb7d8f854be4b6e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5c43223b77c04481abb7d8f854be4b6e; no voters:
I20260808 04:40:25.834765 25780 leader_election.cc:288] T 00000000000000000000000000000000 P 5c43223b77c04481abb7d8f854be4b6e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 04:40:25.834995 25785 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5c43223b77c04481abb7d8f854be4b6e [term 1 FOLLOWER]: Leader election won for term 1
I20260808 04:40:25.835340 25785 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5c43223b77c04481abb7d8f854be4b6e [term 1 LEADER]: Becoming Leader. State: Replica: 5c43223b77c04481abb7d8f854be4b6e, State: Running, Role: LEADER
I20260808 04:40:25.835876 25785 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5c43223b77c04481abb7d8f854be4b6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5c43223b77c04481abb7d8f854be4b6e" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 44269 } }
I20260808 04:40:25.836125 25780 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5c43223b77c04481abb7d8f854be4b6e [sys.catalog]: configured and running, proceeding with master startup.
I20260808 04:40:25.837965 25786 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5c43223b77c04481abb7d8f854be4b6e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5c43223b77c04481abb7d8f854be4b6e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5c43223b77c04481abb7d8f854be4b6e" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 44269 } } }
I20260808 04:40:25.838132 25786 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5c43223b77c04481abb7d8f854be4b6e [sys.catalog]: This master's current role is: LEADER
I20260808 04:40:25.838624 25787 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5c43223b77c04481abb7d8f854be4b6e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5c43223b77c04481abb7d8f854be4b6e. Latest consensus state: current_term: 1 leader_uuid: "5c43223b77c04481abb7d8f854be4b6e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5c43223b77c04481abb7d8f854be4b6e" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 44269 } } }
I20260808 04:40:25.838977 25787 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5c43223b77c04481abb7d8f854be4b6e [sys.catalog]: This master's current role is: LEADER
W20260808 04:40:25.841435 25800 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 5c43223b77c04481abb7d8f854be4b6e: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 04:40:25.841537 25800 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 04:40:25.841620 25799 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 04:40:25.842327 25799 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 04:40:25.848357 25799 catalog_manager.cc:1347] Generated new cluster ID: 5307f4d01ba54ab2b0ad107457b6e082
I20260808 04:40:25.848440 25799 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 04:40:25.871452 25799 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 04:40:25.872864 25799 catalog_manager.cc:1504] Loading token signing keys...
I20260808 04:40:25.892400 25799 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5c43223b77c04481abb7d8f854be4b6e: Generated new TSK 0
I20260808 04:40:25.893504 25799 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.20.240.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.240.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.240.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.193.keytab.
Entry for principal kudu/127.20.240.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.193.keytab.
I20260808 04:40:25.932402 21443 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
/tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786164000593138-21443-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786164000593138-21443-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786164000593138-21443-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786164000593138-21443-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.240.193:0
--local_ip_for_outbound_sockets=127.20.240.193
--webserver_interface=127.20.240.193
--webserver_port=0
--tserver_master_addrs=127.20.240.254:44269
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.193.keytab
--principal=kudu/127.20.240.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.240.212:39099
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786164000593138-21443-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786164000593138-21443-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786164000593138-21443-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 04:40:26.054536 25806 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:40:26.054860 25806 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:40:26.054909 25806 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:40:26.059202 25806 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:40:26.059284 25806 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:40:26.059387 25806 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.240.193
I20260808 04:40:26.065063 25806 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.240.212:39099
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786164000593138-21443-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786164000593138-21443-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.193.keytab
--principal=kudu/127.20.240.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.240.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786164000593138-21443-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.240.193
--webserver_port=0
--tserver_master_addrs=127.20.240.254:44269
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25806
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.240.193
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786164000593138-21443-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 04:05:18 UTC on ccycloud.quasar-drfdgt.root.comops.site
build id 4574101
I20260808 04:40:26.066346 25806 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:40:26.067427 25806 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:40:26.077574 25814 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:40:26.077737 25806 server_base.cc:1034] running on GCE node
W20260808 04:40:26.077555 25811 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:40:26.077555 25812 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:40:26.078392 25806 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:40:26.079120 25806 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:40:26.080324 25806 hybrid_clock.cc:648] HybridClock initialized: now 1786164026080293 us; error 42 us; skew 500 ppm
Aug 08 04:40:26 dist-test-slave-vxj2 krb5kdc[25692](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164026, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.240.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:40:26.083541 25806 init.cc:377] Logged in from keytab as kudu/127.20.240.193@KRBTEST.COM (short username kudu)
I20260808 04:40:26.084407 25806 fs_manager.cc:359] Metadata directory not provided
I20260808 04:40:26.084540 25806 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:40:26.084841 25806 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 04:40:26.087163 25806 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786164000593138-21443-0/minicluster-data/ts-0/data/instance:
uuid: "db9e2d52b8b340d5ba43ec4af55e4d20"
format_stamp: "Formatted at 2026-08-08 04:40:26 on dist-test-slave-vxj2"
server_key: "14b54e58245e44a806e65de6e16e4188"
server_key_iv: "acc18bd543cbf5c76372f6552ca0ae38"
server_key_version: "encryptionkey@0"
I20260808 04:40:26.087771 25806 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786164000593138-21443-0/minicluster-data/ts-0/wal/instance:
uuid: "db9e2d52b8b340d5ba43ec4af55e4d20"
format_stamp: "Formatted at 2026-08-08 04:40:26 on dist-test-slave-vxj2"
server_key: "14b54e58245e44a806e65de6e16e4188"
server_key_iv: "acc18bd543cbf5c76372f6552ca0ae38"
server_key_version: "encryptionkey@0"
I20260808 04:40:26.091784 25806 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260808 04:40:26.094450 25820 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:26.095849 25806 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260808 04:40:26.096012 25806 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786164000593138-21443-0/minicluster-data/ts-0/data,/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786164000593138-21443-0/minicluster-data/ts-0/wal
uuid: "db9e2d52b8b340d5ba43ec4af55e4d20"
format_stamp: "Formatted at 2026-08-08 04:40:26 on dist-test-slave-vxj2"
server_key: "14b54e58245e44a806e65de6e16e4188"
server_key_iv: "acc18bd543cbf5c76372f6552ca0ae38"
server_key_version: "encryptionkey@0"
I20260808 04:40:26.096148 25806 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786164000593138-21443-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786164000593138-21443-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786164000593138-21443-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:40:26.113289 25806 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:40:26.116683 25806 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:40:26.116955 25806 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:40:26.117658 25806 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 04:40:26.118533 25806 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 04:40:26.118607 25806 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:26.118680 25806 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 04:40:26.118732 25806 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:26.127879 25806 rpc_server.cc:307] RPC server started. Bound to: 127.20.240.193:43095
I20260808 04:40:26.127902 25938 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.240.193:43095 every 8 connection(s)
I20260808 04:40:26.128502 25806 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786164000593138-21443-0/minicluster-data/ts-0/data/info.pb
I20260808 04:40:26.130559 21443 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu as pid 25806
I20260808 04:40:26.130697 21443 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786164000593138-21443-0/minicluster-data/ts-0/wal/instance
I20260808 04:40:26.131033 21443 external_mini_cluster.cc:1428] Setting key 3e9f64720e746e822ccc77cccb446ba2
Aug 08 04:40:26 dist-test-slave-vxj2 krb5kdc[25692](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164026, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.240.193@KRBTEST.COM for kudu/127.20.240.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.20.240.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.240.194@KRBTEST.COM" created.
I20260808 04:40:26.145576 25783 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:26.130438 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.240.193:59569 (local address 127.20.240.254:44269)
0808 04:40:26.130608 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:26.130615 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:26.131508 (+ 893us) server_negotiation.cc:407] Connection header received
0808 04:40:26.133333 (+ 1825us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:26.133336 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:26.133388 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:26.133467 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:26.135078 (+ 1611us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:26.135995 (+ 917us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:26.138022 (+ 2027us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:26.138262 (+ 240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:26.138376 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:26.141657 (+ 3281us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:40:26.141660 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:40:26.141663 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:40:26.141694 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:40:26.143383 (+ 1689us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:26.143923 (+ 540us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:26.143927 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:26.143929 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:26.144014 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:26.144377 (+ 363us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:26.144382 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:26.144383 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:26.144587 (+ 204us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:40:26.144696 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:26.145238 (+ 542us) server_negotiation.cc:299] Negotiation successful
0808 04:40:26.145397 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260808 04:40:26.146456 25941 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:26.130771 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:44269 (local address 127.20.240.193:59569)
0808 04:40:26.131302 (+ 531us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:26.131363 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:26.132936 (+ 1573us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:26.133687 (+ 751us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:26.133700 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:26.134260 (+ 560us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:40:26.134913 (+ 653us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:26.134928 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:26.136144 (+ 1216us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:26.136150 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:26.137893 (+ 1743us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:26.137905 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:26.138457 (+ 552us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:26.138466 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:26.138726 (+ 260us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:26.139416 (+ 690us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:40:26.139446 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:40:26.141417 (+ 1971us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:40:26.143508 (+ 2091us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:26.143514 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:26.143532 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:26.143804 (+ 272us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:26.144109 (+ 305us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:26.144113 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:26.144116 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:26.144269 (+ 153us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:26.144694 (+ 425us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:40:26.144701 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:40:26.144973 (+ 272us) client_negotiation.cc:769] Sending connection context
0808 04:40:26.145197 (+ 224us) client_negotiation.cc:240] Negotiation successful
0808 04:40:26.145557 (+ 360us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":280,"thread_start_us":112,"threads_started":1}
I20260808 04:40:26.147996 25939 heartbeater.cc:347] Connected to a master server at 127.20.240.254:44269
I20260808 04:40:26.148295 25939 heartbeater.cc:464] Registering TS with master...
I20260808 04:40:26.148826 25939 heartbeater.cc:511] Master 127.20.240.254:44269 requested a full tablet report, sending...
I20260808 04:40:26.150708 25739 ts_manager.cc:194] Registered new tserver with Master: db9e2d52b8b340d5ba43ec4af55e4d20 (127.20.240.193:43095)
I20260808 04:40:26.152521 25739 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.240.193@KRBTEST.COM'} at 127.20.240.193:59569
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.240.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.194.keytab.
Entry for principal kudu/127.20.240.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.194.keytab.
I20260808 04:40:26.164634 21443 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
/tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786164000593138-21443-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786164000593138-21443-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786164000593138-21443-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786164000593138-21443-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.240.194:0
--local_ip_for_outbound_sockets=127.20.240.194
--webserver_interface=127.20.240.194
--webserver_port=0
--tserver_master_addrs=127.20.240.254:44269
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.194.keytab
--principal=kudu/127.20.240.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.240.212:39099
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786164000593138-21443-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786164000593138-21443-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786164000593138-21443-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 04:40:26.279764 25944 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:40:26.280107 25944 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:40:26.280206 25944 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:40:26.284554 25944 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:40:26.284672 25944 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:40:26.284772 25944 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.240.194
I20260808 04:40:26.290621 25944 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.240.212:39099
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786164000593138-21443-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786164000593138-21443-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.194.keytab
--principal=kudu/127.20.240.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.240.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786164000593138-21443-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.240.194
--webserver_port=0
--tserver_master_addrs=127.20.240.254:44269
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25944
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.240.194
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786164000593138-21443-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 04:05:18 UTC on ccycloud.quasar-drfdgt.root.comops.site
build id 4574101
I20260808 04:40:26.291849 25944 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:40:26.292948 25944 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:40:26.303434 25952 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:40:26.303434 25949 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:40:26.303653 25944 server_base.cc:1034] running on GCE node
W20260808 04:40:26.303448 25950 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:40:26.304189 25944 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:40:26.304929 25944 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:40:26.306162 25944 hybrid_clock.cc:648] HybridClock initialized: now 1786164026306128 us; error 45 us; skew 500 ppm
Aug 08 04:40:26 dist-test-slave-vxj2 krb5kdc[25692](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164026, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.240.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:40:26.313287 25944 init.cc:377] Logged in from keytab as kudu/127.20.240.194@KRBTEST.COM (short username kudu)
I20260808 04:40:26.314222 25944 fs_manager.cc:359] Metadata directory not provided
I20260808 04:40:26.314297 25944 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:40:26.314536 25944 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 04:40:26.316977 25944 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786164000593138-21443-0/minicluster-data/ts-1/data/instance:
uuid: "93fe7eb81d874b2d9ee9bb85ee6964d5"
format_stamp: "Formatted at 2026-08-08 04:40:26 on dist-test-slave-vxj2"
server_key: "421a37acb5b634beaa53afc1f2ef65cb"
server_key_iv: "4779925b8b904d04b6e5f6dbbec87f2a"
server_key_version: "encryptionkey@0"
I20260808 04:40:26.317694 25944 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786164000593138-21443-0/minicluster-data/ts-1/wal/instance:
uuid: "93fe7eb81d874b2d9ee9bb85ee6964d5"
format_stamp: "Formatted at 2026-08-08 04:40:26 on dist-test-slave-vxj2"
server_key: "421a37acb5b634beaa53afc1f2ef65cb"
server_key_iv: "4779925b8b904d04b6e5f6dbbec87f2a"
server_key_version: "encryptionkey@0"
I20260808 04:40:26.322180 25944 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20260808 04:40:26.324867 25958 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:26.326399 25944 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 04:40:26.326589 25944 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786164000593138-21443-0/minicluster-data/ts-1/data,/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786164000593138-21443-0/minicluster-data/ts-1/wal
uuid: "93fe7eb81d874b2d9ee9bb85ee6964d5"
format_stamp: "Formatted at 2026-08-08 04:40:26 on dist-test-slave-vxj2"
server_key: "421a37acb5b634beaa53afc1f2ef65cb"
server_key_iv: "4779925b8b904d04b6e5f6dbbec87f2a"
server_key_version: "encryptionkey@0"
I20260808 04:40:26.326730 25944 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786164000593138-21443-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786164000593138-21443-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786164000593138-21443-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:40:26.348073 25944 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:40:26.351457 25944 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:40:26.351689 25944 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:40:26.352350 25944 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 04:40:26.353327 25944 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 04:40:26.353399 25944 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:26.353487 25944 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 04:40:26.353533 25944 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:26.363118 25944 rpc_server.cc:307] RPC server started. Bound to: 127.20.240.194:40151
I20260808 04:40:26.363139 26077 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.240.194:40151 every 8 connection(s)
I20260808 04:40:26.363828 25944 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786164000593138-21443-0/minicluster-data/ts-1/data/info.pb
I20260808 04:40:26.372198 21443 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu as pid 25944
I20260808 04:40:26.372334 21443 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786164000593138-21443-0/minicluster-data/ts-1/wal/instance
I20260808 04:40:26.372726 21443 external_mini_cluster.cc:1428] Setting key 68301d869f9c1e94807985ebd8c54fe1
Aug 08 04:40:26 dist-test-slave-vxj2 krb5kdc[25692](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164026, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.240.194@KRBTEST.COM for kudu/127.20.240.254@KRBTEST.COM
I20260808 04:40:26.379995 25783 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:26.365784 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.240.194:33797 (local address 127.20.240.254:44269)
0808 04:40:26.365952 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:26.365957 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:26.367008 (+ 1051us) server_negotiation.cc:407] Connection header received
0808 04:40:26.368354 (+ 1346us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:26.368357 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:26.368411 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:26.368491 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:26.369808 (+ 1317us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:26.370378 (+ 570us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:26.371633 (+ 1255us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:26.371923 (+ 290us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:26.372040 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:26.375353 (+ 3313us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:40:26.375360 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:40:26.375366 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:40:26.375403 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:40:26.377268 (+ 1865us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:26.378076 (+ 808us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:26.378082 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:26.378087 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:26.378186 (+ 99us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:26.378594 (+ 408us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:26.378601 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:26.378605 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:26.378878 (+ 273us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:40:26.378997 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:26.379672 (+ 675us) server_negotiation.cc:299] Negotiation successful
0808 04:40:26.379816 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260808 04:40:26.381227 26080 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:26.366321 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:44269 (local address 127.20.240.194:33797)
0808 04:40:26.366828 (+ 507us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:26.366876 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:26.368100 (+ 1224us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:26.368667 (+ 567us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:26.368674 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:26.369071 (+ 397us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:40:26.369626 (+ 555us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:26.369641 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:26.370517 (+ 876us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:26.370520 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:26.371491 (+ 971us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:26.371500 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:26.372135 (+ 635us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:26.372140 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:26.372389 (+ 249us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:26.373136 (+ 747us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:40:26.373184 (+ 48us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:40:26.375164 (+ 1980us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:40:26.377395 (+ 2231us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:26.377404 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:26.377428 (+ 24us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:26.377927 (+ 499us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:26.378320 (+ 393us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:26.378323 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:26.378324 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:26.378488 (+ 164us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:26.379032 (+ 544us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:40:26.379038 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:40:26.379361 (+ 323us) client_negotiation.cc:769] Sending connection context
0808 04:40:26.379615 (+ 254us) client_negotiation.cc:240] Negotiation successful
0808 04:40:26.379999 (+ 384us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":301,"thread_start_us":143,"threads_started":1}
I20260808 04:40:26.382655 26078 heartbeater.cc:347] Connected to a master server at 127.20.240.254:44269
I20260808 04:40:26.382939 26078 heartbeater.cc:464] Registering TS with master...
I20260808 04:40:26.383435 26078 heartbeater.cc:511] Master 127.20.240.254:44269 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.20.240.195@KRBTEST.COM; defaulting to no policy
I20260808 04:40:26.384598 25739 ts_manager.cc:194] Registered new tserver with Master: 93fe7eb81d874b2d9ee9bb85ee6964d5 (127.20.240.194:40151)
I20260808 04:40:26.385499 25739 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.240.194@KRBTEST.COM'} at 127.20.240.194:33797
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.240.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.240.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.195.keytab.
Entry for principal kudu/127.20.240.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.195.keytab.
I20260808 04:40:26.405565 21443 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
/tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786164000593138-21443-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786164000593138-21443-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786164000593138-21443-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786164000593138-21443-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.240.195:0
--local_ip_for_outbound_sockets=127.20.240.195
--webserver_interface=127.20.240.195
--webserver_port=0
--tserver_master_addrs=127.20.240.254:44269
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.195.keytab
--principal=kudu/127.20.240.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.240.212:39099
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786164000593138-21443-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786164000593138-21443-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786164000593138-21443-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 04:40:26.523890 26083 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:40:26.524189 26083 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:40:26.524238 26083 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:40:26.528573 26083 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:40:26.528662 26083 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:40:26.528759 26083 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.240.195
I20260808 04:40:26.534799 26083 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.240.212:39099
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786164000593138-21443-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786164000593138-21443-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.195.keytab
--principal=kudu/127.20.240.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.240.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786164000593138-21443-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.240.195
--webserver_port=0
--tserver_master_addrs=127.20.240.254:44269
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26083
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.240.195
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786164000593138-21443-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 04:05:18 UTC on ccycloud.quasar-drfdgt.root.comops.site
build id 4574101
I20260808 04:40:26.536058 26083 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:40:26.537307 26083 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:40:26.547942 26089 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:40:26.547952 26088 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:40:26.547960 26091 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:40:26.548275 26083 server_base.cc:1034] running on GCE node
I20260808 04:40:26.548862 26083 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:40:26.549677 26083 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:40:26.550876 26083 hybrid_clock.cc:648] HybridClock initialized: now 1786164026550860 us; error 34 us; skew 500 ppm
Aug 08 04:40:26 dist-test-slave-vxj2 krb5kdc[25692](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164026, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.240.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:40:26.553895 26083 init.cc:377] Logged in from keytab as kudu/127.20.240.195@KRBTEST.COM (short username kudu)
I20260808 04:40:26.554741 26083 fs_manager.cc:359] Metadata directory not provided
I20260808 04:40:26.554809 26083 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:40:26.554993 26083 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 04:40:26.557247 26083 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786164000593138-21443-0/minicluster-data/ts-2/data/instance:
uuid: "4e74b2a8fcb14feaaf0a0b53bd19aeee"
format_stamp: "Formatted at 2026-08-08 04:40:26 on dist-test-slave-vxj2"
server_key: "03d8239fda56282b768b844ba0bc72c7"
server_key_iv: "8a1b1669f8baaa581df488659d45b3e6"
server_key_version: "encryptionkey@0"
I20260808 04:40:26.557860 26083 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786164000593138-21443-0/minicluster-data/ts-2/wal/instance:
uuid: "4e74b2a8fcb14feaaf0a0b53bd19aeee"
format_stamp: "Formatted at 2026-08-08 04:40:26 on dist-test-slave-vxj2"
server_key: "03d8239fda56282b768b844ba0bc72c7"
server_key_iv: "8a1b1669f8baaa581df488659d45b3e6"
server_key_version: "encryptionkey@0"
I20260808 04:40:26.561849 26083 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.001s sys 0.003s
I20260808 04:40:26.564554 26097 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:26.566200 26083 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 04:40:26.566365 26083 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786164000593138-21443-0/minicluster-data/ts-2/data,/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786164000593138-21443-0/minicluster-data/ts-2/wal
uuid: "4e74b2a8fcb14feaaf0a0b53bd19aeee"
format_stamp: "Formatted at 2026-08-08 04:40:26 on dist-test-slave-vxj2"
server_key: "03d8239fda56282b768b844ba0bc72c7"
server_key_iv: "8a1b1669f8baaa581df488659d45b3e6"
server_key_version: "encryptionkey@0"
I20260808 04:40:26.566501 26083 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786164000593138-21443-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786164000593138-21443-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786164000593138-21443-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:40:26.580509 26083 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:40:26.584112 26083 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:40:26.584374 26083 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:40:26.585076 26083 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 04:40:26.586205 26083 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 04:40:26.586258 26083 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:26.586328 26083 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 04:40:26.586385 26083 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:26.596446 26083 rpc_server.cc:307] RPC server started. Bound to: 127.20.240.195:37739
I20260808 04:40:26.596465 26219 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.240.195:37739 every 8 connection(s)
I20260808 04:40:26.597121 26083 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786164000593138-21443-0/minicluster-data/ts-2/data/info.pb
I20260808 04:40:26.603098 21443 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu as pid 26083
I20260808 04:40:26.603209 21443 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786164000593138-21443-0/minicluster-data/ts-2/wal/instance
I20260808 04:40:26.603511 21443 external_mini_cluster.cc:1428] Setting key 29f209b5f07c02015ca1ae618a9658ed
Aug 08 04:40:26 dist-test-slave-vxj2 krb5kdc[25692](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164026, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.240.195@KRBTEST.COM for kudu/127.20.240.254@KRBTEST.COM
I20260808 04:40:26.611810 25783 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:26.599071 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.240.195:45475 (local address 127.20.240.254:44269)
0808 04:40:26.599243 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:26.599248 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:26.600064 (+ 816us) server_negotiation.cc:407] Connection header received
0808 04:40:26.601493 (+ 1429us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:26.601497 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:26.601557 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:26.601664 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:26.602873 (+ 1209us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:26.603519 (+ 646us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:26.604956 (+ 1437us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:26.605219 (+ 263us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:26.605306 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:26.607948 (+ 2642us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:40:26.607951 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:40:26.607953 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:40:26.607980 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:40:26.609541 (+ 1561us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:26.610127 (+ 586us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:26.610130 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:26.610131 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:26.610214 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:26.610568 (+ 354us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:26.610570 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:26.610571 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:26.610751 (+ 180us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:40:26.610828 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:26.611469 (+ 641us) server_negotiation.cc:299] Negotiation successful
0808 04:40:26.611611 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260808 04:40:26.612845 26222 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:26.599454 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:44269 (local address 127.20.240.195:45475)
0808 04:40:26.599922 (+ 468us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:26.599964 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:26.601271 (+ 1307us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:26.601851 (+ 580us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:26.601858 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:26.602224 (+ 366us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:40:26.602723 (+ 499us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:26.602737 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:26.603682 (+ 945us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:26.603684 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:26.604843 (+ 1159us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:26.604860 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:26.605367 (+ 507us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:26.605371 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:26.605568 (+ 197us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:26.606252 (+ 684us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:40:26.606269 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:40:26.607768 (+ 1499us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:40:26.609678 (+ 1910us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:26.609684 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:26.609698 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:26.610033 (+ 335us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:26.610325 (+ 292us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:26.610327 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:26.610329 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:26.610473 (+ 144us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:26.610850 (+ 377us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:40:26.610855 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:40:26.611167 (+ 312us) client_negotiation.cc:769] Sending connection context
0808 04:40:26.611408 (+ 241us) client_negotiation.cc:240] Negotiation successful
0808 04:40:26.611815 (+ 407us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":249,"thread_start_us":111,"threads_started":1}
I20260808 04:40:26.614037 26220 heartbeater.cc:347] Connected to a master server at 127.20.240.254:44269
I20260808 04:40:26.614310 26220 heartbeater.cc:464] Registering TS with master...
I20260808 04:40:26.614794 26220 heartbeater.cc:511] Master 127.20.240.254:44269 requested a full tablet report, sending...
I20260808 04:40:26.615967 25739 ts_manager.cc:194] Registered new tserver with Master: 4e74b2a8fcb14feaaf0a0b53bd19aeee (127.20.240.195:37739)
I20260808 04:40:26.616920 25739 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.240.195@KRBTEST.COM'} at 127.20.240.195:45475
I20260808 04:40:26.617791 21443 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 04:40:26.627641 25783 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:26.620036 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34570 (local address 127.20.240.254:44269)
0808 04:40:26.620171 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:26.620175 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:26.620364 (+ 189us) server_negotiation.cc:407] Connection header received
0808 04:40:26.620460 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:26.620462 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:26.620502 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:26.620570 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:26.621345 (+ 775us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:26.621855 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:26.622732 (+ 877us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:26.622979 (+ 247us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:26.623063 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:26.624440 (+ 1377us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:40:26.624443 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:40:26.624445 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:40:26.624468 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:40:26.625933 (+ 1465us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:26.626407 (+ 474us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:26.626409 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:26.626410 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:26.626499 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:26.626835 (+ 336us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:26.626837 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:26.626838 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:26.627086 (+ 248us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:40:26.627196 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:26.627414 (+ 218us) server_negotiation.cc:299] Negotiation successful
0808 04:40:26.627515 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260808 04:40:26.630789 25739 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34570:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 04:40:26.634121 25739 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 04:40:26.649237 26236 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:26.643472 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.195:37739 (local address 127.0.0.1:52552)
0808 04:40:26.644277 (+ 805us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:26.644294 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:26.644384 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:26.645062 (+ 678us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:26.645064 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:26.645079 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 04:40:26.645211 (+ 132us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:26.645217 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:26.646274 (+ 1057us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:26.646280 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:26.647646 (+ 1366us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:26.647656 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:26.648623 (+ 967us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:26.648626 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:26.648734 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:26.648772 (+ 38us) client_negotiation.cc:769] Sending connection context
0808 04:40:26.648919 (+ 147us) client_negotiation.cc:240] Negotiation successful
0808 04:40:26.649048 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":739,"thread_start_us":111,"threads_started":1}
I20260808 04:40:26.649245 26235 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:26.643651 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52552 (local address 127.20.240.195:37739)
0808 04:40:26.643965 (+ 314us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:26.643978 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:26.644478 (+ 500us) server_negotiation.cc:407] Connection header received
0808 04:40:26.644560 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:26.644565 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:26.644751 (+ 186us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:26.644917 (+ 166us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 04:40:26.645327 (+ 410us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:26.646148 (+ 821us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:26.647777 (+ 1629us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:26.648492 (+ 715us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:26.648635 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:26.648776 (+ 141us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:26.648953 (+ 177us) server_negotiation.cc:299] Negotiation successful
0808 04:40:26.649053 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":195,"thread_start_us":92,"threads_started":1}
I20260808 04:40:26.649582 26232 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:26.643148 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.193:43095 (local address 127.0.0.1:46394)
0808 04:40:26.643822 (+ 674us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:26.643880 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:26.644030 (+ 150us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:26.644743 (+ 713us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:26.644749 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:26.644773 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 04:40:26.644942 (+ 169us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:26.644951 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:26.646656 (+ 1705us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:26.646659 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:26.648058 (+ 1399us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:26.648067 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:26.649138 (+ 1071us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:26.649142 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:26.649264 (+ 122us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:26.649305 (+ 41us) client_negotiation.cc:769] Sending connection context
0808 04:40:26.649361 (+ 56us) client_negotiation.cc:240] Negotiation successful
0808 04:40:26.649453 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":491,"mutex_wait_us":65,"thread_start_us":126,"threads_started":1}
I20260808 04:40:26.649966 26234 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:26.643899 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.194:40151 (local address 127.0.0.1:38082)
0808 04:40:26.644584 (+ 685us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:26.644597 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:26.644687 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:26.645397 (+ 710us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:26.645400 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:26.645417 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 04:40:26.645499 (+ 82us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:26.645505 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:26.646807 (+ 1302us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:26.646811 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:26.648035 (+ 1224us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:26.648046 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:26.649208 (+ 1162us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:26.649211 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:26.649660 (+ 449us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:26.649691 (+ 31us) client_negotiation.cc:769] Sending connection context
0808 04:40:26.649768 (+ 77us) client_negotiation.cc:240] Negotiation successful
0808 04:40:26.649845 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":627,"mutex_wait_us":400,"thread_start_us":102,"threads_started":1}
I20260808 04:40:26.650312 26233 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:26.643346 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46394 (local address 127.20.240.193:43095)
0808 04:40:26.644221 (+ 875us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:26.644229 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:26.644254 (+ 25us) server_negotiation.cc:407] Connection header received
0808 04:40:26.644337 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:26.644344 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:26.644562 (+ 218us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:26.645103 (+ 541us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 04:40:26.645294 (+ 191us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:26.646513 (+ 1219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:26.648216 (+ 1703us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:26.648990 (+ 774us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:26.649866 (+ 876us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:26.649993 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:26.650045 (+ 52us) server_negotiation.cc:299] Negotiation successful
0808 04:40:26.650153 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":777,"thread_start_us":72,"threads_started":1}
I20260808 04:40:26.650585 26237 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:26.644160 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38082 (local address 127.20.240.194:40151)
0808 04:40:26.644941 (+ 781us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:26.644953 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:26.644978 (+ 25us) server_negotiation.cc:407] Connection header received
0808 04:40:26.645057 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:26.645062 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:26.645257 (+ 195us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:26.645423 (+ 166us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 04:40:26.645592 (+ 169us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:26.646681 (+ 1089us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:26.648170 (+ 1489us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:26.648990 (+ 820us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:26.649124 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:26.650281 (+ 1157us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:26.650335 (+ 54us) server_negotiation.cc:299] Negotiation successful
0808 04:40:26.650431 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":682,"thread_start_us":127,"threads_started":1}
I20260808 04:40:26.652704 26009 tablet_service.cc:1467] Processing CreateTablet for tablet 1838c5b7355449159562fd36bf8ea8fb (DEFAULT_TABLE table=test-table [id=d09baf2468d0482990f0cdb604a9ccb0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 04:40:26.652678 26148 tablet_service.cc:1467] Processing CreateTablet for tablet 1838c5b7355449159562fd36bf8ea8fb (DEFAULT_TABLE table=test-table [id=d09baf2468d0482990f0cdb604a9ccb0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 04:40:26.653033 25869 tablet_service.cc:1467] Processing CreateTablet for tablet 1838c5b7355449159562fd36bf8ea8fb (DEFAULT_TABLE table=test-table [id=d09baf2468d0482990f0cdb604a9ccb0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 04:40:26.653775 26009 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1838c5b7355449159562fd36bf8ea8fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:40:26.653798 26148 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1838c5b7355449159562fd36bf8ea8fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:40:26.653951 25869 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1838c5b7355449159562fd36bf8ea8fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:40:26.659873 26238 tablet_bootstrap.cc:492] T 1838c5b7355449159562fd36bf8ea8fb P 93fe7eb81d874b2d9ee9bb85ee6964d5: Bootstrap starting.
I20260808 04:40:26.661669 26239 tablet_bootstrap.cc:492] T 1838c5b7355449159562fd36bf8ea8fb P db9e2d52b8b340d5ba43ec4af55e4d20: Bootstrap starting.
I20260808 04:40:26.663414 26238 tablet_bootstrap.cc:654] T 1838c5b7355449159562fd36bf8ea8fb P 93fe7eb81d874b2d9ee9bb85ee6964d5: Neither blocks nor log segments found. Creating new log.
I20260808 04:40:26.663501 26239 tablet_bootstrap.cc:654] T 1838c5b7355449159562fd36bf8ea8fb P db9e2d52b8b340d5ba43ec4af55e4d20: Neither blocks nor log segments found. Creating new log.
I20260808 04:40:26.663949 26240 tablet_bootstrap.cc:492] T 1838c5b7355449159562fd36bf8ea8fb P 4e74b2a8fcb14feaaf0a0b53bd19aeee: Bootstrap starting.
I20260808 04:40:26.664307 26238 log.cc:824] T 1838c5b7355449159562fd36bf8ea8fb P 93fe7eb81d874b2d9ee9bb85ee6964d5: Log is configured to *not* fsync() on all Append() calls
I20260808 04:40:26.664378 26239 log.cc:824] T 1838c5b7355449159562fd36bf8ea8fb P db9e2d52b8b340d5ba43ec4af55e4d20: Log is configured to *not* fsync() on all Append() calls
I20260808 04:40:26.666385 26240 tablet_bootstrap.cc:654] T 1838c5b7355449159562fd36bf8ea8fb P 4e74b2a8fcb14feaaf0a0b53bd19aeee: Neither blocks nor log segments found. Creating new log.
I20260808 04:40:26.666579 26239 tablet_bootstrap.cc:492] T 1838c5b7355449159562fd36bf8ea8fb P db9e2d52b8b340d5ba43ec4af55e4d20: No bootstrap required, opened a new log
I20260808 04:40:26.666824 26239 ts_tablet_manager.cc:1397] T 1838c5b7355449159562fd36bf8ea8fb P db9e2d52b8b340d5ba43ec4af55e4d20: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260808 04:40:26.666859 26238 tablet_bootstrap.cc:492] T 1838c5b7355449159562fd36bf8ea8fb P 93fe7eb81d874b2d9ee9bb85ee6964d5: No bootstrap required, opened a new log
I20260808 04:40:26.667045 26238 ts_tablet_manager.cc:1397] T 1838c5b7355449159562fd36bf8ea8fb P 93fe7eb81d874b2d9ee9bb85ee6964d5: Time spent bootstrapping tablet: real 0.007s user 0.005s sys 0.000s
I20260808 04:40:26.667733 26240 log.cc:824] T 1838c5b7355449159562fd36bf8ea8fb P 4e74b2a8fcb14feaaf0a0b53bd19aeee: Log is configured to *not* fsync() on all Append() calls
I20260808 04:40:26.670219 26240 tablet_bootstrap.cc:492] T 1838c5b7355449159562fd36bf8ea8fb P 4e74b2a8fcb14feaaf0a0b53bd19aeee: No bootstrap required, opened a new log
I20260808 04:40:26.670567 26240 ts_tablet_manager.cc:1397] T 1838c5b7355449159562fd36bf8ea8fb P 4e74b2a8fcb14feaaf0a0b53bd19aeee: Time spent bootstrapping tablet: real 0.007s user 0.006s sys 0.000s
I20260808 04:40:26.670481 26238 raft_consensus.cc:348] T 1838c5b7355449159562fd36bf8ea8fb P 93fe7eb81d874b2d9ee9bb85ee6964d5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "db9e2d52b8b340d5ba43ec4af55e4d20" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 43095 } } peers { permanent_uuid: "4e74b2a8fcb14feaaf0a0b53bd19aeee" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 37739 } } peers { permanent_uuid: "93fe7eb81d874b2d9ee9bb85ee6964d5" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 40151 } }
I20260808 04:40:26.670826 26238 raft_consensus.cc:374] T 1838c5b7355449159562fd36bf8ea8fb P 93fe7eb81d874b2d9ee9bb85ee6964d5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:40:26.670893 26238 raft_consensus.cc:729] T 1838c5b7355449159562fd36bf8ea8fb P 93fe7eb81d874b2d9ee9bb85ee6964d5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93fe7eb81d874b2d9ee9bb85ee6964d5, State: Initialized, Role: FOLLOWER
I20260808 04:40:26.671371 26238 consensus_queue.cc:260] T 1838c5b7355449159562fd36bf8ea8fb P 93fe7eb81d874b2d9ee9bb85ee6964d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "db9e2d52b8b340d5ba43ec4af55e4d20" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 43095 } } peers { permanent_uuid: "4e74b2a8fcb14feaaf0a0b53bd19aeee" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 37739 } } peers { permanent_uuid: "93fe7eb81d874b2d9ee9bb85ee6964d5" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 40151 } }
I20260808 04:40:26.671562 26239 raft_consensus.cc:348] T 1838c5b7355449159562fd36bf8ea8fb P db9e2d52b8b340d5ba43ec4af55e4d20 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "db9e2d52b8b340d5ba43ec4af55e4d20" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 43095 } } peers { permanent_uuid: "4e74b2a8fcb14feaaf0a0b53bd19aeee" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 37739 } } peers { permanent_uuid: "93fe7eb81d874b2d9ee9bb85ee6964d5" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 40151 } }
I20260808 04:40:26.671837 26239 raft_consensus.cc:374] T 1838c5b7355449159562fd36bf8ea8fb P db9e2d52b8b340d5ba43ec4af55e4d20 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:40:26.671895 26239 raft_consensus.cc:729] T 1838c5b7355449159562fd36bf8ea8fb P db9e2d52b8b340d5ba43ec4af55e4d20 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: db9e2d52b8b340d5ba43ec4af55e4d20, State: Initialized, Role: FOLLOWER
I20260808 04:40:26.672375 26239 consensus_queue.cc:260] T 1838c5b7355449159562fd36bf8ea8fb P db9e2d52b8b340d5ba43ec4af55e4d20 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "db9e2d52b8b340d5ba43ec4af55e4d20" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 43095 } } peers { permanent_uuid: "4e74b2a8fcb14feaaf0a0b53bd19aeee" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 37739 } } peers { permanent_uuid: "93fe7eb81d874b2d9ee9bb85ee6964d5" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 40151 } }
I20260808 04:40:26.672916 26078 heartbeater.cc:503] Master 127.20.240.254:44269 was elected leader, sending a full tablet report...
I20260808 04:40:26.673079 26238 ts_tablet_manager.cc:1428] T 1838c5b7355449159562fd36bf8ea8fb P 93fe7eb81d874b2d9ee9bb85ee6964d5: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260808 04:40:26.673374 26239 ts_tablet_manager.cc:1428] T 1838c5b7355449159562fd36bf8ea8fb P db9e2d52b8b340d5ba43ec4af55e4d20: Time spent starting tablet: real 0.006s user 0.003s sys 0.005s
I20260808 04:40:26.673733 25939 heartbeater.cc:503] Master 127.20.240.254:44269 was elected leader, sending a full tablet report...
I20260808 04:40:26.674551 26240 raft_consensus.cc:348] T 1838c5b7355449159562fd36bf8ea8fb P 4e74b2a8fcb14feaaf0a0b53bd19aeee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "db9e2d52b8b340d5ba43ec4af55e4d20" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 43095 } } peers { permanent_uuid: "4e74b2a8fcb14feaaf0a0b53bd19aeee" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 37739 } } peers { permanent_uuid: "93fe7eb81d874b2d9ee9bb85ee6964d5" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 40151 } }
I20260808 04:40:26.674831 26240 raft_consensus.cc:374] T 1838c5b7355449159562fd36bf8ea8fb P 4e74b2a8fcb14feaaf0a0b53bd19aeee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:40:26.674903 26240 raft_consensus.cc:729] T 1838c5b7355449159562fd36bf8ea8fb P 4e74b2a8fcb14feaaf0a0b53bd19aeee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e74b2a8fcb14feaaf0a0b53bd19aeee, State: Initialized, Role: FOLLOWER
I20260808 04:40:26.675347 26240 consensus_queue.cc:260] T 1838c5b7355449159562fd36bf8ea8fb P 4e74b2a8fcb14feaaf0a0b53bd19aeee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "db9e2d52b8b340d5ba43ec4af55e4d20" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 43095 } } peers { permanent_uuid: "4e74b2a8fcb14feaaf0a0b53bd19aeee" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 37739 } } peers { permanent_uuid: "93fe7eb81d874b2d9ee9bb85ee6964d5" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 40151 } }
I20260808 04:40:26.676054 26220 heartbeater.cc:503] Master 127.20.240.254:44269 was elected leader, sending a full tablet report...
I20260808 04:40:26.677486 26240 ts_tablet_manager.cc:1428] T 1838c5b7355449159562fd36bf8ea8fb P 4e74b2a8fcb14feaaf0a0b53bd19aeee: Time spent starting tablet: real 0.007s user 0.002s sys 0.004s
W20260808 04:40:26.848263 26221 tablet.cc:2369] T 1838c5b7355449159562fd36bf8ea8fb P 4e74b2a8fcb14feaaf0a0b53bd19aeee: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 04:40:26.865142 26079 tablet.cc:2369] T 1838c5b7355449159562fd36bf8ea8fb P 93fe7eb81d874b2d9ee9bb85ee6964d5: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 04:40:26.879967 25940 tablet.cc:2369] T 1838c5b7355449159562fd36bf8ea8fb P db9e2d52b8b340d5ba43ec4af55e4d20: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 04:40:27.009505 26244 raft_consensus.cc:482] T 1838c5b7355449159562fd36bf8ea8fb P 93fe7eb81d874b2d9ee9bb85ee6964d5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 04:40:27.009783 26244 raft_consensus.cc:504] T 1838c5b7355449159562fd36bf8ea8fb P 93fe7eb81d874b2d9ee9bb85ee6964d5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "db9e2d52b8b340d5ba43ec4af55e4d20" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 43095 } } peers { permanent_uuid: "4e74b2a8fcb14feaaf0a0b53bd19aeee" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 37739 } } peers { permanent_uuid: "93fe7eb81d874b2d9ee9bb85ee6964d5" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 40151 } }
I20260808 04:40:27.011103 26244 leader_election.cc:288] T 1838c5b7355449159562fd36bf8ea8fb P 93fe7eb81d874b2d9ee9bb85ee6964d5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers db9e2d52b8b340d5ba43ec4af55e4d20 (127.20.240.193:43095), 4e74b2a8fcb14feaaf0a0b53bd19aeee (127.20.240.195:37739)
I20260808 04:40:27.015492 26235 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:27.011518 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.240.194:44063 (local address 127.20.240.195:37739)
0808 04:40:27.011655 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:27.011660 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:27.011862 (+ 202us) server_negotiation.cc:407] Connection header received
0808 04:40:27.011956 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:27.011959 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:27.012016 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:27.012101 (+ 85us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 04:40:27.012415 (+ 314us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:27.013199 (+ 784us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:27.014409 (+ 1210us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:27.014909 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:27.015003 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:27.015044 (+ 41us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:27.015277 (+ 233us) server_negotiation.cc:299] Negotiation successful
0808 04:40:27.015354 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260808 04:40:27.015517 26248 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:27.011404 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.195:37739 (local address 127.20.240.194:44063)
0808 04:40:27.011751 (+ 347us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:27.011763 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:27.011867 (+ 104us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:27.012132 (+ 265us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:27.012135 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:27.012155 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 04:40:27.012288 (+ 133us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:27.012294 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:27.013324 (+ 1030us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:27.013328 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:27.014274 (+ 946us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:27.014284 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:27.015034 (+ 750us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:27.015038 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:27.015143 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:27.015169 (+ 26us) client_negotiation.cc:769] Sending connection context
0808 04:40:27.015244 (+ 75us) client_negotiation.cc:240] Negotiation successful
0808 04:40:27.015350 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":278,"mutex_wait_us":24,"thread_start_us":96,"threads_started":1}
I20260808 04:40:27.015739 26247 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:27.011430 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.193:43095 (local address 127.20.240.194:58955)
0808 04:40:27.011838 (+ 408us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:27.011855 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:27.012028 (+ 173us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:27.012419 (+ 391us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:27.012422 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:27.012441 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 04:40:27.012549 (+ 108us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:27.012555 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:27.013605 (+ 1050us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:27.013607 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:27.014527 (+ 920us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:27.014537 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:27.015291 (+ 754us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:27.015294 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:27.015409 (+ 115us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:27.015432 (+ 23us) client_negotiation.cc:769] Sending connection context
0808 04:40:27.015512 (+ 80us) client_negotiation.cc:240] Negotiation successful
0808 04:40:27.015594 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":326,"mutex_wait_us":22,"thread_start_us":104,"threads_started":1}
I20260808 04:40:27.015769 26233 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:27.011536 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.240.194:58955 (local address 127.20.240.193:43095)
0808 04:40:27.011665 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:27.011670 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:27.011956 (+ 286us) server_negotiation.cc:407] Connection header received
0808 04:40:27.012155 (+ 199us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:27.012157 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:27.012210 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:27.012259 (+ 49us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 04:40:27.012726 (+ 467us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:27.013488 (+ 762us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:27.014658 (+ 1170us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:27.015152 (+ 494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:27.015278 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:27.015323 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:27.015552 (+ 229us) server_negotiation.cc:299] Negotiation successful
0808 04:40:27.015636 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260808 04:40:27.016218 26169 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1838c5b7355449159562fd36bf8ea8fb" candidate_uuid: "93fe7eb81d874b2d9ee9bb85ee6964d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e74b2a8fcb14feaaf0a0b53bd19aeee" is_pre_election: true
I20260808 04:40:27.016327 25891 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1838c5b7355449159562fd36bf8ea8fb" candidate_uuid: "93fe7eb81d874b2d9ee9bb85ee6964d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "db9e2d52b8b340d5ba43ec4af55e4d20" is_pre_election: true
I20260808 04:40:27.016600 26169 raft_consensus.cc:2454] T 1838c5b7355449159562fd36bf8ea8fb P 4e74b2a8fcb14feaaf0a0b53bd19aeee [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 93fe7eb81d874b2d9ee9bb85ee6964d5 in term 0.
I20260808 04:40:27.016642 25891 raft_consensus.cc:2454] T 1838c5b7355449159562fd36bf8ea8fb P db9e2d52b8b340d5ba43ec4af55e4d20 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 93fe7eb81d874b2d9ee9bb85ee6964d5 in term 0.
I20260808 04:40:27.017185 25962 leader_election.cc:302] T 1838c5b7355449159562fd36bf8ea8fb P 93fe7eb81d874b2d9ee9bb85ee6964d5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 4e74b2a8fcb14feaaf0a0b53bd19aeee, 93fe7eb81d874b2d9ee9bb85ee6964d5, db9e2d52b8b340d5ba43ec4af55e4d20; no voters:
I20260808 04:40:27.017509 26244 raft_consensus.cc:2781] T 1838c5b7355449159562fd36bf8ea8fb P 93fe7eb81d874b2d9ee9bb85ee6964d5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 04:40:27.017599 26244 raft_consensus.cc:482] T 1838c5b7355449159562fd36bf8ea8fb P 93fe7eb81d874b2d9ee9bb85ee6964d5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 04:40:27.017645 26244 raft_consensus.cc:3037] T 1838c5b7355449159562fd36bf8ea8fb P 93fe7eb81d874b2d9ee9bb85ee6964d5 [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:40:27.018810 26244 raft_consensus.cc:504] T 1838c5b7355449159562fd36bf8ea8fb P 93fe7eb81d874b2d9ee9bb85ee6964d5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "db9e2d52b8b340d5ba43ec4af55e4d20" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 43095 } } peers { permanent_uuid: "4e74b2a8fcb14feaaf0a0b53bd19aeee" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 37739 } } peers { permanent_uuid: "93fe7eb81d874b2d9ee9bb85ee6964d5" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 40151 } }
I20260808 04:40:27.019156 26244 leader_election.cc:288] T 1838c5b7355449159562fd36bf8ea8fb P 93fe7eb81d874b2d9ee9bb85ee6964d5 [CANDIDATE]: Term 1 election: Requested vote from peers db9e2d52b8b340d5ba43ec4af55e4d20 (127.20.240.193:43095), 4e74b2a8fcb14feaaf0a0b53bd19aeee (127.20.240.195:37739)
I20260808 04:40:27.019608 25891 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1838c5b7355449159562fd36bf8ea8fb" candidate_uuid: "93fe7eb81d874b2d9ee9bb85ee6964d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "db9e2d52b8b340d5ba43ec4af55e4d20"
I20260808 04:40:27.019577 26169 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1838c5b7355449159562fd36bf8ea8fb" candidate_uuid: "93fe7eb81d874b2d9ee9bb85ee6964d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e74b2a8fcb14feaaf0a0b53bd19aeee"
I20260808 04:40:27.019744 26169 raft_consensus.cc:3037] T 1838c5b7355449159562fd36bf8ea8fb P 4e74b2a8fcb14feaaf0a0b53bd19aeee [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:40:27.019717 25891 raft_consensus.cc:3037] T 1838c5b7355449159562fd36bf8ea8fb P db9e2d52b8b340d5ba43ec4af55e4d20 [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:40:27.020817 25891 raft_consensus.cc:2454] T 1838c5b7355449159562fd36bf8ea8fb P db9e2d52b8b340d5ba43ec4af55e4d20 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 93fe7eb81d874b2d9ee9bb85ee6964d5 in term 1.
I20260808 04:40:27.020823 26169 raft_consensus.cc:2454] T 1838c5b7355449159562fd36bf8ea8fb P 4e74b2a8fcb14feaaf0a0b53bd19aeee [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 93fe7eb81d874b2d9ee9bb85ee6964d5 in term 1.
I20260808 04:40:27.021184 25962 leader_election.cc:302] T 1838c5b7355449159562fd36bf8ea8fb P 93fe7eb81d874b2d9ee9bb85ee6964d5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4e74b2a8fcb14feaaf0a0b53bd19aeee, 93fe7eb81d874b2d9ee9bb85ee6964d5; no voters:
I20260808 04:40:27.021377 26244 raft_consensus.cc:2781] T 1838c5b7355449159562fd36bf8ea8fb P 93fe7eb81d874b2d9ee9bb85ee6964d5 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 04:40:27.021667 26244 raft_consensus.cc:686] T 1838c5b7355449159562fd36bf8ea8fb P 93fe7eb81d874b2d9ee9bb85ee6964d5 [term 1 LEADER]: Becoming Leader. State: Replica: 93fe7eb81d874b2d9ee9bb85ee6964d5, State: Running, Role: LEADER
I20260808 04:40:27.022213 26244 consensus_queue.cc:237] T 1838c5b7355449159562fd36bf8ea8fb P 93fe7eb81d874b2d9ee9bb85ee6964d5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "db9e2d52b8b340d5ba43ec4af55e4d20" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 43095 } } peers { permanent_uuid: "4e74b2a8fcb14feaaf0a0b53bd19aeee" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 37739 } } peers { permanent_uuid: "93fe7eb81d874b2d9ee9bb85ee6964d5" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 40151 } }
I20260808 04:40:27.025579 25739 catalog_manager.cc:5495] T 1838c5b7355449159562fd36bf8ea8fb P 93fe7eb81d874b2d9ee9bb85ee6964d5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 93fe7eb81d874b2d9ee9bb85ee6964d5 (127.20.240.194). New cstate: current_term: 1 leader_uuid: "93fe7eb81d874b2d9ee9bb85ee6964d5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "db9e2d52b8b340d5ba43ec4af55e4d20" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 43095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4e74b2a8fcb14feaaf0a0b53bd19aeee" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 37739 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "93fe7eb81d874b2d9ee9bb85ee6964d5" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 40151 } health_report { overall_health: HEALTHY } } }
I20260808 04:40:27.110599 26237 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:27.106518 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38092 (local address 127.20.240.194:40151)
0808 04:40:27.106706 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:27.106711 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:27.106728 (+ 17us) server_negotiation.cc:407] Connection header received
0808 04:40:27.106835 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:27.106838 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:27.106928 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:27.107064 (+ 136us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 04:40:27.107387 (+ 323us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:27.107900 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:27.108777 (+ 877us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:27.109068 (+ 291us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:27.109261 (+ 193us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:27.109568 (+ 307us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 04:40:27.110034 (+ 466us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 04:40:27.110131 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:27.110265 (+ 134us) server_negotiation.cc:299] Negotiation successful
0808 04:40:27.110374 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260808 04:40:27.117259 25891 raft_consensus.cc:1261] T 1838c5b7355449159562fd36bf8ea8fb P db9e2d52b8b340d5ba43ec4af55e4d20 [term 1 FOLLOWER]: Refusing update from remote peer 93fe7eb81d874b2d9ee9bb85ee6964d5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 04:40:27.117259 26169 raft_consensus.cc:1261] T 1838c5b7355449159562fd36bf8ea8fb P 4e74b2a8fcb14feaaf0a0b53bd19aeee [term 1 FOLLOWER]: Refusing update from remote peer 93fe7eb81d874b2d9ee9bb85ee6964d5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 04:40:27.118052 26244 consensus_queue.cc:1035] T 1838c5b7355449159562fd36bf8ea8fb P 93fe7eb81d874b2d9ee9bb85ee6964d5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "db9e2d52b8b340d5ba43ec4af55e4d20" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 43095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 04:40:27.118294 26249 consensus_queue.cc:1035] T 1838c5b7355449159562fd36bf8ea8fb P 93fe7eb81d874b2d9ee9bb85ee6964d5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4e74b2a8fcb14feaaf0a0b53bd19aeee" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 37739 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 04:40:27.127031 26253 mvcc.cc:205] Tried to move back new op lower bound from 7316127855063973888 to 7316127854685564928. Current Snapshot: MvccSnapshot[applied={T|T < 7316127855063973888}]
I20260808 04:40:27.127312 26254 mvcc.cc:205] Tried to move back new op lower bound from 7316127855063973888 to 7316127854685564928. Current Snapshot: MvccSnapshot[applied={T|T < 7316127855063973888}]
I20260808 04:40:27.144198 25738 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34570:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 04:40:27.144430 25738 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34570:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 04:40:27.147473 25738 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 5c43223b77c04481abb7d8f854be4b6e: Sending DeleteTablet for 3 replicas of tablet 1838c5b7355449159562fd36bf8ea8fb
I20260808 04:40:27.148419 25869 tablet_service.cc:1514] Processing DeleteTablet for tablet 1838c5b7355449159562fd36bf8ea8fb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 04:40:27 UTC) from {username='kudu', principal='kudu/127.20.240.254@KRBTEST.COM'} at 127.0.0.1:46394
I20260808 04:40:27.148602 26148 tablet_service.cc:1514] Processing DeleteTablet for tablet 1838c5b7355449159562fd36bf8ea8fb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 04:40:27 UTC) from {username='kudu', principal='kudu/127.20.240.254@KRBTEST.COM'} at 127.0.0.1:52552
I20260808 04:40:27.148728 26009 tablet_service.cc:1514] Processing DeleteTablet for tablet 1838c5b7355449159562fd36bf8ea8fb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 04:40:27 UTC) from {username='kudu', principal='kudu/127.20.240.254@KRBTEST.COM'} at 127.0.0.1:38082
I20260808 04:40:27.149032 26264 tablet_replica.cc:330] T 1838c5b7355449159562fd36bf8ea8fb P db9e2d52b8b340d5ba43ec4af55e4d20: stopping tablet replica
I20260808 04:40:27.149099 26265 tablet_replica.cc:330] T 1838c5b7355449159562fd36bf8ea8fb P 4e74b2a8fcb14feaaf0a0b53bd19aeee: stopping tablet replica
I20260808 04:40:27.149242 21443 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu with pid 25806
I20260808 04:40:27.149412 26264 raft_consensus.cc:2229] T 1838c5b7355449159562fd36bf8ea8fb P db9e2d52b8b340d5ba43ec4af55e4d20 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 04:40:27.149412 26265 raft_consensus.cc:2229] T 1838c5b7355449159562fd36bf8ea8fb P 4e74b2a8fcb14feaaf0a0b53bd19aeee [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 04:40:27.149762 26265 raft_consensus.cc:2258] T 1838c5b7355449159562fd36bf8ea8fb P 4e74b2a8fcb14feaaf0a0b53bd19aeee [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 04:40:27.152252 26265 ts_tablet_manager.cc:1905] T 1838c5b7355449159562fd36bf8ea8fb P 4e74b2a8fcb14feaaf0a0b53bd19aeee: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 04:40:27.154495 26266 tablet_replica.cc:330] T 1838c5b7355449159562fd36bf8ea8fb P 93fe7eb81d874b2d9ee9bb85ee6964d5: stopping tablet replica
I20260808 04:40:27.154891 26266 raft_consensus.cc:2229] T 1838c5b7355449159562fd36bf8ea8fb P 93fe7eb81d874b2d9ee9bb85ee6964d5 [term 1 LEADER]: Raft consensus shutting down.
I20260808 04:40:27.155229 26265 ts_tablet_manager.cc:1918] T 1838c5b7355449159562fd36bf8ea8fb P 4e74b2a8fcb14feaaf0a0b53bd19aeee: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 04:40:27.155324 26265 log.cc:1196] T 1838c5b7355449159562fd36bf8ea8fb P 4e74b2a8fcb14feaaf0a0b53bd19aeee: Deleting WAL directory at /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786164000593138-21443-0/minicluster-data/ts-2/wal/wals/1838c5b7355449159562fd36bf8ea8fb
I20260808 04:40:27.155355 26266 raft_consensus.cc:2258] T 1838c5b7355449159562fd36bf8ea8fb P 93fe7eb81d874b2d9ee9bb85ee6964d5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 04:40:27.155644 26265 ts_tablet_manager.cc:1939] T 1838c5b7355449159562fd36bf8ea8fb P 4e74b2a8fcb14feaaf0a0b53bd19aeee: Deleting consensus metadata
I20260808 04:40:27.157064 26266 ts_tablet_manager.cc:1905] T 1838c5b7355449159562fd36bf8ea8fb P 93fe7eb81d874b2d9ee9bb85ee6964d5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 04:40:27.157028 25726 catalog_manager.cc:4841] TS 4e74b2a8fcb14feaaf0a0b53bd19aeee (127.20.240.195:37739): tablet 1838c5b7355449159562fd36bf8ea8fb (table test-table [id=d09baf2468d0482990f0cdb604a9ccb0]) successfully deleted
W20260808 04:40:27.160409 25725 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.20.240.193:43095 (error 108)
I20260808 04:40:27.160635 21443 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu with pid 25944
I20260808 04:40:27.163734 26268 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:27.163183 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.193:43095 (local address 127.0.0.1:46406)
0808 04:40:27.163472 (+ 289us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:27.163572 (+ 100us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.240.193:43095: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":195,"thread_start_us":119,"threads_started":1}
W20260808 04:40:27.165342 25725 catalog_manager.cc:4584] TS db9e2d52b8b340d5ba43ec4af55e4d20 (127.20.240.193:43095): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 1838c5b7355449159562fd36bf8ea8fb: Network error: Client connection negotiation failed: client connection to 127.20.240.193:43095: connect: Connection refused (error 111)
I20260808 04:40:27.168576 21443 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu with pid 26083
I20260808 04:40:27.170392 26268 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:27.168786 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.194:40151 (local address 127.0.0.1:38102)
0808 04:40:27.170196 (+ 1410us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:27.170273 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.240.194:40151: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1271}
I20260808 04:40:27.176196 21443 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu with pid 25705
2026-08-08T04:40:27Z chronyd exiting
[ OK ] SecurityITest.TestDisableWebUI (2789 ms)
[ RUN ] SecurityITest.TestDisableAuthenticationEncryption
2026-08-08T04:40:27Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T04:40:27Z Disabled control of system clock
I20260808 04:40:27.209030 21443 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
/tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786164000593138-21443-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786164000593138-21443-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786164000593138-21443-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786164000593138-21443-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.240.254:39471
--webserver_interface=127.20.240.254
--webserver_port=0
--builtin_ntp_servers=127.20.240.212:39519
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.240.254:39471
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260808 04:40:27.327067 26273 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:40:27.327402 26273 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:40:27.327486 26273 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:40:27.331559 26273 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 04:40:27.331667 26273 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:40:27.331696 26273 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:40:27.331745 26273 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 04:40:27.331800 26273 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 04:40:27.336840 26273 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.240.212:39519
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786164000593138-21443-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786164000593138-21443-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.240.254:39471
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.240.254:39471
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786164000593138-21443-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.240.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26273
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786164000593138-21443-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 04:05:18 UTC on ccycloud.quasar-drfdgt.root.comops.site
build id 4574101
I20260808 04:40:27.338116 26273 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:40:27.339598 26273 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:40:27.348459 26279 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:40:27.348637 26273 server_base.cc:1034] running on GCE node
W20260808 04:40:27.348475 26280 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:40:27.348464 26282 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:40:27.349495 26273 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:40:27.350631 26273 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:40:27.351872 26273 hybrid_clock.cc:648] HybridClock initialized: now 1786164027351850 us; error 33 us; skew 500 ppm
I20260808 04:40:27.354127 26273 webserver.cc:460] Webserver started at http://127.20.240.254:42205/ using document root <none> and password file <none>
I20260808 04:40:27.354756 26273 fs_manager.cc:359] Metadata directory not provided
I20260808 04:40:27.354825 26273 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:40:27.355095 26273 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 04:40:27.357358 26273 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786164000593138-21443-0/minicluster-data/master-0/data/instance:
uuid: "2fb87827a5314e51aa5049f3f7a76f73"
format_stamp: "Formatted at 2026-08-08 04:40:27 on dist-test-slave-vxj2"
server_key: "8e22d3a9c04c0f1c209ab2554c51431c"
server_key_iv: "50055abf19d607986730cd6cf7eb2f58"
server_key_version: "encryptionkey@0"
I20260808 04:40:27.358008 26273 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786164000593138-21443-0/minicluster-data/master-0/wal/instance:
uuid: "2fb87827a5314e51aa5049f3f7a76f73"
format_stamp: "Formatted at 2026-08-08 04:40:27 on dist-test-slave-vxj2"
server_key: "8e22d3a9c04c0f1c209ab2554c51431c"
server_key_iv: "50055abf19d607986730cd6cf7eb2f58"
server_key_version: "encryptionkey@0"
I20260808 04:40:27.362025 26273 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260808 04:40:27.364593 26288 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:27.366118 26273 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 04:40:27.366273 26273 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786164000593138-21443-0/minicluster-data/master-0/data,/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786164000593138-21443-0/minicluster-data/master-0/wal
uuid: "2fb87827a5314e51aa5049f3f7a76f73"
format_stamp: "Formatted at 2026-08-08 04:40:27 on dist-test-slave-vxj2"
server_key: "8e22d3a9c04c0f1c209ab2554c51431c"
server_key_iv: "50055abf19d607986730cd6cf7eb2f58"
server_key_version: "encryptionkey@0"
I20260808 04:40:27.366405 26273 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786164000593138-21443-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786164000593138-21443-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786164000593138-21443-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:40:27.371304 26273 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:40:27.372020 26273 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:40:27.372218 26273 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:40:27.379421 26273 rpc_server.cc:307] RPC server started. Bound to: 127.20.240.254:39471
I20260808 04:40:27.379441 26341 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.240.254:39471 every 8 connection(s)
I20260808 04:40:27.380664 26273 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786164000593138-21443-0/minicluster-data/master-0/data/info.pb
I20260808 04:40:27.385767 21443 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu as pid 26273
I20260808 04:40:27.385882 21443 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786164000593138-21443-0/minicluster-data/master-0/wal/instance
I20260808 04:40:27.386178 21443 external_mini_cluster.cc:1428] Setting key a408f983ea6625360ab0987f667b6936
I20260808 04:40:27.387701 26342 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:40:27.392004 26346 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:27.387764 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39258 (local address 127.20.240.254:39471)
0808 04:40:27.388437 (+ 673us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:27.388453 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:27.388490 (+ 37us) server_negotiation.cc:407] Connection header received
0808 04:40:27.389198 (+ 708us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:27.389221 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:27.389578 (+ 357us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:27.389853 (+ 275us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:27.390735 (+ 882us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:40:27.390740 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:40:27.390751 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 04:40:27.390762 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:40:27.390816 (+ 54us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 04:40:27.390832 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:40:27.390950 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:27.391041 (+ 91us) server_negotiation.cc:299] Negotiation successful
0808 04:40:27.391288 (+ 247us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":299,"thread_start_us":143,"threads_started":1}
I20260808 04:40:27.394097 26342 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2fb87827a5314e51aa5049f3f7a76f73: Bootstrap starting.
I20260808 04:40:27.396273 26342 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2fb87827a5314e51aa5049f3f7a76f73: Neither blocks nor log segments found. Creating new log.
I20260808 04:40:27.397060 26342 log.cc:824] T 00000000000000000000000000000000 P 2fb87827a5314e51aa5049f3f7a76f73: Log is configured to *not* fsync() on all Append() calls
I20260808 04:40:27.399120 26342 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2fb87827a5314e51aa5049f3f7a76f73: No bootstrap required, opened a new log
I20260808 04:40:27.402695 26342 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2fb87827a5314e51aa5049f3f7a76f73 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2fb87827a5314e51aa5049f3f7a76f73" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 39471 } }
I20260808 04:40:27.402971 26342 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2fb87827a5314e51aa5049f3f7a76f73 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:40:27.403056 26342 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2fb87827a5314e51aa5049f3f7a76f73 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fb87827a5314e51aa5049f3f7a76f73, State: Initialized, Role: FOLLOWER
I20260808 04:40:27.403489 26342 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2fb87827a5314e51aa5049f3f7a76f73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2fb87827a5314e51aa5049f3f7a76f73" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 39471 } }
I20260808 04:40:27.403644 26342 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2fb87827a5314e51aa5049f3f7a76f73 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 04:40:27.403734 26342 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2fb87827a5314e51aa5049f3f7a76f73 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 04:40:27.403863 26342 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2fb87827a5314e51aa5049f3f7a76f73 [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:40:27.404805 26342 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2fb87827a5314e51aa5049f3f7a76f73 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2fb87827a5314e51aa5049f3f7a76f73" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 39471 } }
I20260808 04:40:27.405198 26342 leader_election.cc:302] T 00000000000000000000000000000000 P 2fb87827a5314e51aa5049f3f7a76f73 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2fb87827a5314e51aa5049f3f7a76f73; no voters:
I20260808 04:40:27.405545 26342 leader_election.cc:288] T 00000000000000000000000000000000 P 2fb87827a5314e51aa5049f3f7a76f73 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 04:40:27.405678 26349 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2fb87827a5314e51aa5049f3f7a76f73 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 04:40:27.406009 26349 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2fb87827a5314e51aa5049f3f7a76f73 [term 1 LEADER]: Becoming Leader. State: Replica: 2fb87827a5314e51aa5049f3f7a76f73, State: Running, Role: LEADER
I20260808 04:40:27.406350 26349 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2fb87827a5314e51aa5049f3f7a76f73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2fb87827a5314e51aa5049f3f7a76f73" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 39471 } }
I20260808 04:40:27.406917 26342 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2fb87827a5314e51aa5049f3f7a76f73 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 04:40:27.408080 26351 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2fb87827a5314e51aa5049f3f7a76f73 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2fb87827a5314e51aa5049f3f7a76f73. Latest consensus state: current_term: 1 leader_uuid: "2fb87827a5314e51aa5049f3f7a76f73" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2fb87827a5314e51aa5049f3f7a76f73" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 39471 } } }
I20260808 04:40:27.408219 26351 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2fb87827a5314e51aa5049f3f7a76f73 [sys.catalog]: This master's current role is: LEADER
I20260808 04:40:27.408519 26350 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2fb87827a5314e51aa5049f3f7a76f73 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2fb87827a5314e51aa5049f3f7a76f73" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2fb87827a5314e51aa5049f3f7a76f73" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 39471 } } }
I20260808 04:40:27.408632 26350 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2fb87827a5314e51aa5049f3f7a76f73 [sys.catalog]: This master's current role is: LEADER
I20260808 04:40:27.408823 26358 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 04:40:27.412174 26358 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 04:40:27.418402 26358 catalog_manager.cc:1347] Generated new cluster ID: bf3312215d604709a4132d9f813b9025
I20260808 04:40:27.418501 26358 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 04:40:27.432443 26358 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 04:40:27.432814 26358 catalog_manager.cc:1504] Loading token signing keys...
I20260808 04:40:27.437820 26358 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2fb87827a5314e51aa5049f3f7a76f73: Generated new TSK 0
I20260808 04:40:27.438565 26358 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 04:40:27.447767 21443 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
/tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786164000593138-21443-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786164000593138-21443-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786164000593138-21443-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786164000593138-21443-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.240.193:0
--local_ip_for_outbound_sockets=127.20.240.193
--webserver_interface=127.20.240.193
--webserver_port=0
--tserver_master_addrs=127.20.240.254:39471
--builtin_ntp_servers=127.20.240.212:39519
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260808 04:40:27.563680 26369 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:40:27.563956 26369 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:40:27.563998 26369 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:40:27.568209 26369 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:40:27.568287 26369 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:40:27.568349 26369 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.240.193
I20260808 04:40:27.573757 26369 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.240.212:39519
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786164000593138-21443-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786164000593138-21443-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.240.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786164000593138-21443-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.240.193
--webserver_port=0
--tserver_master_addrs=127.20.240.254:39471
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26369
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.240.193
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786164000593138-21443-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 04:05:18 UTC on ccycloud.quasar-drfdgt.root.comops.site
build id 4574101
I20260808 04:40:27.574955 26369 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:40:27.576447 26369 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:40:27.586944 26378 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:40:27.586988 26375 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:40:27.587009 26376 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:40:27.587196 26369 server_base.cc:1034] running on GCE node
I20260808 04:40:27.587755 26369 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:40:27.588467 26369 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:40:27.589666 26369 hybrid_clock.cc:648] HybridClock initialized: now 1786164027589628 us; error 48 us; skew 500 ppm
I20260808 04:40:27.591661 26369 webserver.cc:460] Webserver started at http://127.20.240.193:35747/ using document root <none> and password file <none>
I20260808 04:40:27.592345 26369 fs_manager.cc:359] Metadata directory not provided
I20260808 04:40:27.592453 26369 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:40:27.592713 26369 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 04:40:27.595017 26369 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786164000593138-21443-0/minicluster-data/ts-0/data/instance:
uuid: "5d9e2c20741f48b091024503bd0b0236"
format_stamp: "Formatted at 2026-08-08 04:40:27 on dist-test-slave-vxj2"
server_key: "26208d7ca7f727f508b381b5641f8eea"
server_key_iv: "0a826de76039e65d624bedc531f04773"
server_key_version: "encryptionkey@0"
I20260808 04:40:27.595659 26369 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786164000593138-21443-0/minicluster-data/ts-0/wal/instance:
uuid: "5d9e2c20741f48b091024503bd0b0236"
format_stamp: "Formatted at 2026-08-08 04:40:27 on dist-test-slave-vxj2"
server_key: "26208d7ca7f727f508b381b5641f8eea"
server_key_iv: "0a826de76039e65d624bedc531f04773"
server_key_version: "encryptionkey@0"
I20260808 04:40:27.599689 26369 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.002s
I20260808 04:40:27.602543 26384 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:27.603925 26369 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260808 04:40:27.604115 26369 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786164000593138-21443-0/minicluster-data/ts-0/data,/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786164000593138-21443-0/minicluster-data/ts-0/wal
uuid: "5d9e2c20741f48b091024503bd0b0236"
format_stamp: "Formatted at 2026-08-08 04:40:27 on dist-test-slave-vxj2"
server_key: "26208d7ca7f727f508b381b5641f8eea"
server_key_iv: "0a826de76039e65d624bedc531f04773"
server_key_version: "encryptionkey@0"
I20260808 04:40:27.604254 26369 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786164000593138-21443-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786164000593138-21443-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786164000593138-21443-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:40:27.609416 26369 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:40:27.610101 26369 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:40:27.610308 26369 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:40:27.610932 26369 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 04:40:27.611953 26369 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 04:40:27.612025 26369 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:27.612106 26369 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 04:40:27.612149 26369 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:27.621104 26369 rpc_server.cc:307] RPC server started. Bound to: 127.20.240.193:37135
I20260808 04:40:27.621129 26503 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.240.193:37135 every 8 connection(s)
I20260808 04:40:27.622095 26369 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786164000593138-21443-0/minicluster-data/ts-0/data/info.pb
I20260808 04:40:27.624611 21443 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu as pid 26369
I20260808 04:40:27.624751 21443 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786164000593138-21443-0/minicluster-data/ts-0/wal/instance
I20260808 04:40:27.625061 21443 external_mini_cluster.cc:1428] Setting key 0c0aa7568ddd0ddf2299ab9f4e35a4c0
I20260808 04:40:27.627188 21443 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
/tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786164000593138-21443-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786164000593138-21443-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786164000593138-21443-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786164000593138-21443-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.240.194:0
--local_ip_for_outbound_sockets=127.20.240.194
--webserver_interface=127.20.240.194
--webserver_port=0
--tserver_master_addrs=127.20.240.254:39471
--builtin_ntp_servers=127.20.240.212:39519
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
I20260808 04:40:27.628939 26346 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:27.624045 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.240.193:53809 (local address 127.20.240.254:39471)
0808 04:40:27.624199 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:27.624203 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:27.625537 (+ 1334us) server_negotiation.cc:407] Connection header received
0808 04:40:27.627164 (+ 1627us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:27.627167 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:27.627209 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:27.627282 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:27.628451 (+ 1169us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:40:27.628454 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:40:27.628457 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 04:40:27.628477 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:40:27.628496 (+ 19us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 04:40:27.628504 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:40:27.628600 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:27.628747 (+ 147us) server_negotiation.cc:299] Negotiation successful
0808 04:40:27.628796 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260808 04:40:27.629873 26506 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:27.624557 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:39471 (local address 127.20.240.193:53809)
0808 04:40:27.625367 (+ 810us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:27.625421 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:27.626947 (+ 1526us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:27.627460 (+ 513us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:27.627467 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:27.627558 (+ 91us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:40:27.628177 (+ 619us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 04:40:27.628179 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:40:27.628219 (+ 40us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 04:40:27.628287 (+ 68us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:40:27.628586 (+ 299us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:40:27.628595 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:40:27.628601 (+ 6us) client_negotiation.cc:769] Sending connection context
0808 04:40:27.628785 (+ 184us) client_negotiation.cc:240] Negotiation successful
0808 04:40:27.629036 (+ 251us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":317,"thread_start_us":165,"threads_started":1}
I20260808 04:40:27.631220 26504 heartbeater.cc:347] Connected to a master server at 127.20.240.254:39471
I20260808 04:40:27.631497 26504 heartbeater.cc:464] Registering TS with master...
I20260808 04:40:27.632056 26504 heartbeater.cc:511] Master 127.20.240.254:39471 requested a full tablet report, sending...
I20260808 04:40:27.633827 26305 ts_manager.cc:194] Registered new tserver with Master: 5d9e2c20741f48b091024503bd0b0236 (127.20.240.193:37135)
W20260808 04:40:27.751703 26507 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:40:27.751988 26507 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:40:27.752030 26507 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:40:27.756296 26507 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:40:27.756371 26507 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:40:27.756469 26507 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.240.194
I20260808 04:40:27.761490 26507 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.240.212:39519
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786164000593138-21443-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786164000593138-21443-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.240.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786164000593138-21443-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.240.194
--webserver_port=0
--tserver_master_addrs=127.20.240.254:39471
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26507
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.240.194
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786164000593138-21443-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 04:05:18 UTC on ccycloud.quasar-drfdgt.root.comops.site
build id 4574101
I20260808 04:40:27.762663 26507 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:40:27.764091 26507 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:40:27.774377 26512 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:40:27.774500 26515 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:40:27.774480 26513 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:40:27.774741 26507 server_base.cc:1034] running on GCE node
I20260808 04:40:27.775430 26507 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:40:27.776187 26507 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:40:27.777397 26507 hybrid_clock.cc:648] HybridClock initialized: now 1786164027777380 us; error 33 us; skew 500 ppm
I20260808 04:40:27.779541 26507 webserver.cc:460] Webserver started at http://127.20.240.194:37527/ using document root <none> and password file <none>
I20260808 04:40:27.780225 26507 fs_manager.cc:359] Metadata directory not provided
I20260808 04:40:27.780336 26507 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:40:27.780593 26507 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 04:40:27.782958 26507 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786164000593138-21443-0/minicluster-data/ts-1/data/instance:
uuid: "b140a66d60a145cdabdcb378120ba1c4"
format_stamp: "Formatted at 2026-08-08 04:40:27 on dist-test-slave-vxj2"
server_key: "d0d52ab2fbcf71022221bdf050f69591"
server_key_iv: "f9aae0631d481f41a66654fb82469381"
server_key_version: "encryptionkey@0"
I20260808 04:40:27.783567 26507 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786164000593138-21443-0/minicluster-data/ts-1/wal/instance:
uuid: "b140a66d60a145cdabdcb378120ba1c4"
format_stamp: "Formatted at 2026-08-08 04:40:27 on dist-test-slave-vxj2"
server_key: "d0d52ab2fbcf71022221bdf050f69591"
server_key_iv: "f9aae0631d481f41a66654fb82469381"
server_key_version: "encryptionkey@0"
I20260808 04:40:27.787751 26507 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260808 04:40:27.791011 26521 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:27.792456 26507 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260808 04:40:27.792613 26507 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786164000593138-21443-0/minicluster-data/ts-1/data,/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786164000593138-21443-0/minicluster-data/ts-1/wal
uuid: "b140a66d60a145cdabdcb378120ba1c4"
format_stamp: "Formatted at 2026-08-08 04:40:27 on dist-test-slave-vxj2"
server_key: "d0d52ab2fbcf71022221bdf050f69591"
server_key_iv: "f9aae0631d481f41a66654fb82469381"
server_key_version: "encryptionkey@0"
I20260808 04:40:27.792753 26507 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786164000593138-21443-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786164000593138-21443-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786164000593138-21443-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:40:27.797675 26507 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:40:27.798342 26507 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:40:27.798556 26507 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:40:27.799152 26507 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 04:40:27.800124 26507 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 04:40:27.800199 26507 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:27.800266 26507 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 04:40:27.800318 26507 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:27.809975 26507 rpc_server.cc:307] RPC server started. Bound to: 127.20.240.194:39745
I20260808 04:40:27.810067 26640 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.240.194:39745 every 8 connection(s)
I20260808 04:40:27.810989 26507 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786164000593138-21443-0/minicluster-data/ts-1/data/info.pb
I20260808 04:40:27.815574 21443 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu as pid 26507
I20260808 04:40:27.815728 21443 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786164000593138-21443-0/minicluster-data/ts-1/wal/instance
I20260808 04:40:27.816007 21443 external_mini_cluster.cc:1428] Setting key faff0098d1e55b28080b97da7adcbfbb
I20260808 04:40:27.817809 26346 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:27.813064 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.240.194:45591 (local address 127.20.240.254:39471)
0808 04:40:27.813264 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:27.813268 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:27.814355 (+ 1087us) server_negotiation.cc:407] Connection header received
0808 04:40:27.815705 (+ 1350us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:27.815709 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:27.815757 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:27.815873 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:27.817278 (+ 1405us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:40:27.817281 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:40:27.817283 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 04:40:27.817294 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:40:27.817316 (+ 22us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 04:40:27.817324 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:40:27.817410 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:27.817623 (+ 213us) server_negotiation.cc:299] Negotiation successful
0808 04:40:27.817663 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260808 04:40:27.818341 21443 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
/tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786164000593138-21443-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786164000593138-21443-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786164000593138-21443-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786164000593138-21443-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.240.195:0
--local_ip_for_outbound_sockets=127.20.240.195
--webserver_interface=127.20.240.195
--webserver_port=0
--tserver_master_addrs=127.20.240.254:39471
--builtin_ntp_servers=127.20.240.212:39519
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
I20260808 04:40:27.818946 26643 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:27.813490 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:39471 (local address 127.20.240.194:45591)
0808 04:40:27.814177 (+ 687us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:27.814219 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:27.815481 (+ 1262us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:27.816050 (+ 569us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:27.816057 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:27.816190 (+ 133us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:40:27.816936 (+ 746us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 04:40:27.816939 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:40:27.816994 (+ 55us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 04:40:27.817081 (+ 87us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:40:27.817422 (+ 341us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:40:27.817433 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:40:27.817439 (+ 6us) client_negotiation.cc:769] Sending connection context
0808 04:40:27.817654 (+ 215us) client_negotiation.cc:240] Negotiation successful
0808 04:40:27.818043 (+ 389us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":274,"thread_start_us":113,"threads_started":1}
I20260808 04:40:27.820170 26641 heartbeater.cc:347] Connected to a master server at 127.20.240.254:39471
I20260808 04:40:27.820412 26641 heartbeater.cc:464] Registering TS with master...
I20260808 04:40:27.820850 26641 heartbeater.cc:511] Master 127.20.240.254:39471 requested a full tablet report, sending...
I20260808 04:40:27.821987 26305 ts_manager.cc:194] Registered new tserver with Master: b140a66d60a145cdabdcb378120ba1c4 (127.20.240.194:39745)
W20260808 04:40:27.935837 26644 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:40:27.936115 26644 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:40:27.936156 26644 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:40:27.940634 26644 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:40:27.940699 26644 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:40:27.940757 26644 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.240.195
I20260808 04:40:27.945721 26644 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.240.212:39519
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786164000593138-21443-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786164000593138-21443-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.240.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786164000593138-21443-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.240.195
--webserver_port=0
--tserver_master_addrs=127.20.240.254:39471
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26644
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.240.195
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786164000593138-21443-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 04:05:18 UTC on ccycloud.quasar-drfdgt.root.comops.site
build id 4574101
I20260808 04:40:27.946918 26644 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:40:27.948311 26644 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260808 04:40:27.958352 26644 server_base.cc:1034] running on GCE node
W20260808 04:40:27.958389 26649 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:40:27.958293 26652 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:40:27.958300 26650 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:40:27.959056 26644 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:40:27.959707 26644 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:40:27.960919 26644 hybrid_clock.cc:648] HybridClock initialized: now 1786164027960885 us; error 47 us; skew 500 ppm
I20260808 04:40:27.962919 26644 webserver.cc:460] Webserver started at http://127.20.240.195:44735/ using document root <none> and password file <none>
I20260808 04:40:27.963528 26644 fs_manager.cc:359] Metadata directory not provided
I20260808 04:40:27.963631 26644 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:40:27.963886 26644 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 04:40:27.966059 26644 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786164000593138-21443-0/minicluster-data/ts-2/data/instance:
uuid: "7df0ae5dbe334b318b6275656e2f3a23"
format_stamp: "Formatted at 2026-08-08 04:40:27 on dist-test-slave-vxj2"
server_key: "5bc54ae11dc4d5838a209c2bed158126"
server_key_iv: "4bab27e5b0a3d0d578062222e149a270"
server_key_version: "encryptionkey@0"
I20260808 04:40:27.966652 26644 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786164000593138-21443-0/minicluster-data/ts-2/wal/instance:
uuid: "7df0ae5dbe334b318b6275656e2f3a23"
format_stamp: "Formatted at 2026-08-08 04:40:27 on dist-test-slave-vxj2"
server_key: "5bc54ae11dc4d5838a209c2bed158126"
server_key_iv: "4bab27e5b0a3d0d578062222e149a270"
server_key_version: "encryptionkey@0"
I20260808 04:40:27.970551 26644 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260808 04:40:27.973243 26658 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:27.974499 26644 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 04:40:27.974642 26644 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786164000593138-21443-0/minicluster-data/ts-2/data,/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786164000593138-21443-0/minicluster-data/ts-2/wal
uuid: "7df0ae5dbe334b318b6275656e2f3a23"
format_stamp: "Formatted at 2026-08-08 04:40:27 on dist-test-slave-vxj2"
server_key: "5bc54ae11dc4d5838a209c2bed158126"
server_key_iv: "4bab27e5b0a3d0d578062222e149a270"
server_key_version: "encryptionkey@0"
I20260808 04:40:27.974771 26644 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786164000593138-21443-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786164000593138-21443-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786164000593138-21443-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:40:27.979440 26644 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:40:27.980082 26644 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:40:27.980275 26644 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:40:27.980823 26644 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 04:40:27.981810 26644 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 04:40:27.981881 26644 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:27.981952 26644 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 04:40:27.982003 26644 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:27.991073 26644 rpc_server.cc:307] RPC server started. Bound to: 127.20.240.195:35849
I20260808 04:40:27.991094 26777 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.240.195:35849 every 8 connection(s)
I20260808 04:40:27.991990 26644 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786164000593138-21443-0/minicluster-data/ts-2/data/info.pb
I20260808 04:40:27.995174 21443 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu as pid 26644
I20260808 04:40:27.995280 21443 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786164000593138-21443-0/minicluster-data/ts-2/wal/instance
I20260808 04:40:27.995548 21443 external_mini_cluster.cc:1428] Setting key 71ef60cb37eeffa9a00ab601c73fab0c
I20260808 04:40:27.998731 26346 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:27.993894 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.240.195:53051 (local address 127.20.240.254:39471)
0808 04:40:27.994047 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:27.994050 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:27.995117 (+ 1067us) server_negotiation.cc:407] Connection header received
0808 04:40:27.996845 (+ 1728us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:27.996848 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:27.996899 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:27.997037 (+ 138us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:27.998357 (+ 1320us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:40:27.998360 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:40:27.998362 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 04:40:27.998372 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:40:27.998391 (+ 19us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 04:40:27.998399 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:40:27.998470 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:27.998591 (+ 121us) server_negotiation.cc:299] Negotiation successful
0808 04:40:27.998628 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260808 04:40:27.999668 26780 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:27.994269 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:39471 (local address 127.20.240.195:53051)
0808 04:40:27.994959 (+ 690us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:27.995002 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:27.996589 (+ 1587us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:27.997280 (+ 691us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:27.997290 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:27.997401 (+ 111us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:40:27.998117 (+ 716us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 04:40:27.998119 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:40:27.998159 (+ 40us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 04:40:27.998222 (+ 63us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:40:27.998474 (+ 252us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:40:27.998480 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:40:27.998484 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 04:40:27.998611 (+ 127us) client_negotiation.cc:240] Negotiation successful
0808 04:40:27.998795 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":266,"thread_start_us":105,"threads_started":1}
I20260808 04:40:28.000799 26778 heartbeater.cc:347] Connected to a master server at 127.20.240.254:39471
I20260808 04:40:28.001046 26778 heartbeater.cc:464] Registering TS with master...
I20260808 04:40:28.001500 26778 heartbeater.cc:511] Master 127.20.240.254:39471 requested a full tablet report, sending...
I20260808 04:40:28.002548 26305 ts_manager.cc:194] Registered new tserver with Master: 7df0ae5dbe334b318b6275656e2f3a23 (127.20.240.195:35849)
I20260808 04:40:28.010327 21443 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 04:40:28.014299 26346 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:28.012569 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39266 (local address 127.20.240.254:39471)
0808 04:40:28.012730 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:28.012734 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:28.012952 (+ 218us) server_negotiation.cc:407] Connection header received
0808 04:40:28.013041 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:28.013044 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:28.013081 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:28.013222 (+ 141us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:28.013957 (+ 735us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:40:28.013960 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:40:28.013962 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 04:40:28.013981 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:40:28.014001 (+ 20us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 04:40:28.014009 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:40:28.014088 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:28.014148 (+ 60us) server_negotiation.cc:299] Negotiation successful
0808 04:40:28.014185 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260808 04:40:28.017601 26305 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39266:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 04:40:28.020851 26305 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 04:40:28.033514 26793 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:28.030597 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.194:39745 (local address 127.0.0.1:52762)
0808 04:40:28.031253 (+ 656us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:28.031266 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:28.031340 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:28.032097 (+ 757us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:28.032101 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:28.032122 (+ 21us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:40:28.032632 (+ 510us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 04:40:28.032637 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:40:28.032661 (+ 24us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 04:40:28.032740 (+ 79us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:40:28.033117 (+ 377us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:40:28.033128 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:40:28.033134 (+ 6us) client_negotiation.cc:769] Sending connection context
0808 04:40:28.033278 (+ 144us) client_negotiation.cc:240] Negotiation successful
0808 04:40:28.033365 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":602,"thread_start_us":92,"threads_started":1}
I20260808 04:40:28.033573 26794 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:28.031014 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52762 (local address 127.20.240.194:39745)
0808 04:40:28.031459 (+ 445us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:28.031469 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:28.031488 (+ 19us) server_negotiation.cc:407] Connection header received
0808 04:40:28.031531 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:28.031534 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:28.031712 (+ 178us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:28.031837 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:28.032897 (+ 1060us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:40:28.032907 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:40:28.032922 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 04:40:28.032936 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:40:28.032985 (+ 49us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 04:40:28.033019 (+ 34us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:40:28.033131 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:28.033356 (+ 225us) server_negotiation.cc:299] Negotiation successful
0808 04:40:28.033430 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":343,"thread_start_us":119,"threads_started":1}
I20260808 04:40:28.033707 26791 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:28.030044 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.195:35849 (local address 127.0.0.1:56822)
0808 04:40:28.030938 (+ 894us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:28.030952 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:28.031059 (+ 107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:28.031767 (+ 708us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:28.031770 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:28.031786 (+ 16us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:40:28.032785 (+ 999us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 04:40:28.032787 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:40:28.032827 (+ 40us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 04:40:28.032861 (+ 34us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:40:28.033248 (+ 387us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:40:28.033252 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:40:28.033255 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 04:40:28.033529 (+ 274us) client_negotiation.cc:240] Negotiation successful
0808 04:40:28.033571 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":826,"spinlock_wait_cycles":3712,"thread_start_us":113,"threads_started":1}
I20260808 04:40:28.034221 26789 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:28.029794 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.193:37135 (local address 127.0.0.1:46266)
0808 04:40:28.030827 (+ 1033us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:28.030930 (+ 103us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:28.031058 (+ 128us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:28.031684 (+ 626us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:28.031690 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:28.031769 (+ 79us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:40:28.032895 (+ 1126us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 04:40:28.032897 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:40:28.032906 (+ 9us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 04:40:28.032927 (+ 21us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:40:28.033945 (+ 1018us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:40:28.033950 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:40:28.033953 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 04:40:28.034029 (+ 76us) client_negotiation.cc:240] Negotiation successful
0808 04:40:28.034123 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":847,"spinlock_wait_cycles":10880,"thread_start_us":101,"threads_started":1}
I20260808 04:40:28.034375 26790 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:28.029990 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46266 (local address 127.20.240.193:37135)
0808 04:40:28.030776 (+ 786us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:28.030790 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:28.031170 (+ 380us) server_negotiation.cc:407] Connection header received
0808 04:40:28.031287 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:28.031295 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:28.031514 (+ 219us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:28.031684 (+ 170us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:28.033038 (+ 1354us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:40:28.033046 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:40:28.033058 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 04:40:28.033073 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:40:28.033116 (+ 43us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 04:40:28.033182 (+ 66us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:40:28.033290 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:28.034113 (+ 823us) server_negotiation.cc:299] Negotiation successful
0808 04:40:28.034222 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":671,"thread_start_us":118,"threads_started":1}
I20260808 04:40:28.034672 26792 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:28.030278 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56822 (local address 127.20.240.195:35849)
0808 04:40:28.031378 (+ 1100us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:28.031393 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:28.031418 (+ 25us) server_negotiation.cc:407] Connection header received
0808 04:40:28.031467 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:28.031471 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:28.031610 (+ 139us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:28.032364 (+ 754us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:28.032997 (+ 633us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:40:28.033005 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:40:28.033018 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 04:40:28.033028 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:40:28.033094 (+ 66us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 04:40:28.033124 (+ 30us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:40:28.033272 (+ 148us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:28.034476 (+ 1204us) server_negotiation.cc:299] Negotiation successful
0808 04:40:28.034546 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":963,"thread_start_us":166,"threads_started":1}
I20260808 04:40:28.037417 26710 tablet_service.cc:1467] Processing CreateTablet for tablet 6df1b5e7b652443186f5ce4543bde748 (DEFAULT_TABLE table=test-table [id=b03ccc16e1ad40408e4061ca534e488e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 04:40:28.037425 26574 tablet_service.cc:1467] Processing CreateTablet for tablet 6df1b5e7b652443186f5ce4543bde748 (DEFAULT_TABLE table=test-table [id=b03ccc16e1ad40408e4061ca534e488e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 04:40:28.037420 26436 tablet_service.cc:1467] Processing CreateTablet for tablet 6df1b5e7b652443186f5ce4543bde748 (DEFAULT_TABLE table=test-table [id=b03ccc16e1ad40408e4061ca534e488e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 04:40:28.038480 26710 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6df1b5e7b652443186f5ce4543bde748. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:40:28.038494 26436 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6df1b5e7b652443186f5ce4543bde748. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:40:28.038494 26574 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6df1b5e7b652443186f5ce4543bde748. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:40:28.045094 26795 tablet_bootstrap.cc:492] T 6df1b5e7b652443186f5ce4543bde748 P 7df0ae5dbe334b318b6275656e2f3a23: Bootstrap starting.
I20260808 04:40:28.047009 26796 tablet_bootstrap.cc:492] T 6df1b5e7b652443186f5ce4543bde748 P 5d9e2c20741f48b091024503bd0b0236: Bootstrap starting.
I20260808 04:40:28.047451 26797 tablet_bootstrap.cc:492] T 6df1b5e7b652443186f5ce4543bde748 P b140a66d60a145cdabdcb378120ba1c4: Bootstrap starting.
I20260808 04:40:28.048895 26795 tablet_bootstrap.cc:654] T 6df1b5e7b652443186f5ce4543bde748 P 7df0ae5dbe334b318b6275656e2f3a23: Neither blocks nor log segments found. Creating new log.
I20260808 04:40:28.049294 26797 tablet_bootstrap.cc:654] T 6df1b5e7b652443186f5ce4543bde748 P b140a66d60a145cdabdcb378120ba1c4: Neither blocks nor log segments found. Creating new log.
I20260808 04:40:28.049808 26795 log.cc:824] T 6df1b5e7b652443186f5ce4543bde748 P 7df0ae5dbe334b318b6275656e2f3a23: Log is configured to *not* fsync() on all Append() calls
I20260808 04:40:28.050184 26797 log.cc:824] T 6df1b5e7b652443186f5ce4543bde748 P b140a66d60a145cdabdcb378120ba1c4: Log is configured to *not* fsync() on all Append() calls
I20260808 04:40:28.051574 26796 tablet_bootstrap.cc:654] T 6df1b5e7b652443186f5ce4543bde748 P 5d9e2c20741f48b091024503bd0b0236: Neither blocks nor log segments found. Creating new log.
I20260808 04:40:28.052256 26797 tablet_bootstrap.cc:492] T 6df1b5e7b652443186f5ce4543bde748 P b140a66d60a145cdabdcb378120ba1c4: No bootstrap required, opened a new log
I20260808 04:40:28.052256 26795 tablet_bootstrap.cc:492] T 6df1b5e7b652443186f5ce4543bde748 P 7df0ae5dbe334b318b6275656e2f3a23: No bootstrap required, opened a new log
I20260808 04:40:28.052500 26795 ts_tablet_manager.cc:1397] T 6df1b5e7b652443186f5ce4543bde748 P 7df0ae5dbe334b318b6275656e2f3a23: Time spent bootstrapping tablet: real 0.008s user 0.002s sys 0.002s
I20260808 04:40:28.052515 26797 ts_tablet_manager.cc:1397] T 6df1b5e7b652443186f5ce4543bde748 P b140a66d60a145cdabdcb378120ba1c4: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.005s
I20260808 04:40:28.052502 26796 log.cc:824] T 6df1b5e7b652443186f5ce4543bde748 P 5d9e2c20741f48b091024503bd0b0236: Log is configured to *not* fsync() on all Append() calls
I20260808 04:40:28.055783 26796 tablet_bootstrap.cc:492] T 6df1b5e7b652443186f5ce4543bde748 P 5d9e2c20741f48b091024503bd0b0236: No bootstrap required, opened a new log
I20260808 04:40:28.056198 26796 ts_tablet_manager.cc:1397] T 6df1b5e7b652443186f5ce4543bde748 P 5d9e2c20741f48b091024503bd0b0236: Time spent bootstrapping tablet: real 0.009s user 0.004s sys 0.000s
I20260808 04:40:28.057508 26797 raft_consensus.cc:348] T 6df1b5e7b652443186f5ce4543bde748 P b140a66d60a145cdabdcb378120ba1c4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d9e2c20741f48b091024503bd0b0236" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 37135 } } peers { permanent_uuid: "7df0ae5dbe334b318b6275656e2f3a23" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 35849 } } peers { permanent_uuid: "b140a66d60a145cdabdcb378120ba1c4" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 39745 } }
I20260808 04:40:28.057824 26797 raft_consensus.cc:374] T 6df1b5e7b652443186f5ce4543bde748 P b140a66d60a145cdabdcb378120ba1c4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:40:28.057909 26797 raft_consensus.cc:729] T 6df1b5e7b652443186f5ce4543bde748 P b140a66d60a145cdabdcb378120ba1c4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b140a66d60a145cdabdcb378120ba1c4, State: Initialized, Role: FOLLOWER
I20260808 04:40:28.057772 26795 raft_consensus.cc:348] T 6df1b5e7b652443186f5ce4543bde748 P 7df0ae5dbe334b318b6275656e2f3a23 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d9e2c20741f48b091024503bd0b0236" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 37135 } } peers { permanent_uuid: "7df0ae5dbe334b318b6275656e2f3a23" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 35849 } } peers { permanent_uuid: "b140a66d60a145cdabdcb378120ba1c4" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 39745 } }
I20260808 04:40:28.058099 26795 raft_consensus.cc:374] T 6df1b5e7b652443186f5ce4543bde748 P 7df0ae5dbe334b318b6275656e2f3a23 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:40:28.058161 26795 raft_consensus.cc:729] T 6df1b5e7b652443186f5ce4543bde748 P 7df0ae5dbe334b318b6275656e2f3a23 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7df0ae5dbe334b318b6275656e2f3a23, State: Initialized, Role: FOLLOWER
I20260808 04:40:28.058568 26797 consensus_queue.cc:260] T 6df1b5e7b652443186f5ce4543bde748 P b140a66d60a145cdabdcb378120ba1c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d9e2c20741f48b091024503bd0b0236" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 37135 } } peers { permanent_uuid: "7df0ae5dbe334b318b6275656e2f3a23" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 35849 } } peers { permanent_uuid: "b140a66d60a145cdabdcb378120ba1c4" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 39745 } }
I20260808 04:40:28.058646 26795 consensus_queue.cc:260] T 6df1b5e7b652443186f5ce4543bde748 P 7df0ae5dbe334b318b6275656e2f3a23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d9e2c20741f48b091024503bd0b0236" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 37135 } } peers { permanent_uuid: "7df0ae5dbe334b318b6275656e2f3a23" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 35849 } } peers { permanent_uuid: "b140a66d60a145cdabdcb378120ba1c4" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 39745 } }
I20260808 04:40:28.059492 26641 heartbeater.cc:503] Master 127.20.240.254:39471 was elected leader, sending a full tablet report...
I20260808 04:40:28.060026 26795 ts_tablet_manager.cc:1428] T 6df1b5e7b652443186f5ce4543bde748 P 7df0ae5dbe334b318b6275656e2f3a23: Time spent starting tablet: real 0.007s user 0.006s sys 0.000s
I20260808 04:40:28.060745 26778 heartbeater.cc:503] Master 127.20.240.254:39471 was elected leader, sending a full tablet report...
I20260808 04:40:28.061367 26796 raft_consensus.cc:348] T 6df1b5e7b652443186f5ce4543bde748 P 5d9e2c20741f48b091024503bd0b0236 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d9e2c20741f48b091024503bd0b0236" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 37135 } } peers { permanent_uuid: "7df0ae5dbe334b318b6275656e2f3a23" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 35849 } } peers { permanent_uuid: "b140a66d60a145cdabdcb378120ba1c4" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 39745 } }
I20260808 04:40:28.061579 26796 raft_consensus.cc:374] T 6df1b5e7b652443186f5ce4543bde748 P 5d9e2c20741f48b091024503bd0b0236 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:40:28.061615 26796 raft_consensus.cc:729] T 6df1b5e7b652443186f5ce4543bde748 P 5d9e2c20741f48b091024503bd0b0236 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d9e2c20741f48b091024503bd0b0236, State: Initialized, Role: FOLLOWER
I20260808 04:40:28.062333 26796 consensus_queue.cc:260] T 6df1b5e7b652443186f5ce4543bde748 P 5d9e2c20741f48b091024503bd0b0236 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d9e2c20741f48b091024503bd0b0236" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 37135 } } peers { permanent_uuid: "7df0ae5dbe334b318b6275656e2f3a23" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 35849 } } peers { permanent_uuid: "b140a66d60a145cdabdcb378120ba1c4" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 39745 } }
I20260808 04:40:28.062585 26797 ts_tablet_manager.cc:1428] T 6df1b5e7b652443186f5ce4543bde748 P b140a66d60a145cdabdcb378120ba1c4: Time spent starting tablet: real 0.010s user 0.007s sys 0.000s
I20260808 04:40:28.063525 26796 ts_tablet_manager.cc:1428] T 6df1b5e7b652443186f5ce4543bde748 P 5d9e2c20741f48b091024503bd0b0236: Time spent starting tablet: real 0.007s user 0.009s sys 0.000s
I20260808 04:40:28.063890 26504 heartbeater.cc:503] Master 127.20.240.254:39471 was elected leader, sending a full tablet report...
W20260808 04:40:28.123353 26505 tablet.cc:2369] T 6df1b5e7b652443186f5ce4543bde748 P 5d9e2c20741f48b091024503bd0b0236: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 04:40:28.243115 26779 tablet.cc:2369] T 6df1b5e7b652443186f5ce4543bde748 P 7df0ae5dbe334b318b6275656e2f3a23: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 04:40:28.312515 26642 tablet.cc:2369] T 6df1b5e7b652443186f5ce4543bde748 P b140a66d60a145cdabdcb378120ba1c4: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 04:40:28.402630 26804 raft_consensus.cc:482] T 6df1b5e7b652443186f5ce4543bde748 P 5d9e2c20741f48b091024503bd0b0236 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 04:40:28.402897 26804 raft_consensus.cc:504] T 6df1b5e7b652443186f5ce4543bde748 P 5d9e2c20741f48b091024503bd0b0236 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d9e2c20741f48b091024503bd0b0236" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 37135 } } peers { permanent_uuid: "7df0ae5dbe334b318b6275656e2f3a23" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 35849 } } peers { permanent_uuid: "b140a66d60a145cdabdcb378120ba1c4" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 39745 } }
I20260808 04:40:28.404048 26804 leader_election.cc:288] T 6df1b5e7b652443186f5ce4543bde748 P 5d9e2c20741f48b091024503bd0b0236 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7df0ae5dbe334b318b6275656e2f3a23 (127.20.240.195:35849), b140a66d60a145cdabdcb378120ba1c4 (127.20.240.194:39745)
I20260808 04:40:28.409731 26794 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:28.404983 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.240.193:57811 (local address 127.20.240.194:39745)
0808 04:40:28.405116 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:28.405121 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:28.405135 (+ 14us) server_negotiation.cc:407] Connection header received
0808 04:40:28.405303 (+ 168us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:28.405309 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:28.405362 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:28.405445 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:28.409275 (+ 3830us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:40:28.409287 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:40:28.409292 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 04:40:28.409307 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:40:28.409331 (+ 24us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 04:40:28.409360 (+ 29us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:40:28.409468 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:28.409543 (+ 75us) server_negotiation.cc:299] Negotiation successful
0808 04:40:28.409584 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260808 04:40:28.409754 26806 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:28.404733 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.194:39745 (local address 127.20.240.193:57811)
0808 04:40:28.405073 (+ 340us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:28.405089 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:28.405191 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:28.405520 (+ 329us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:28.405524 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:28.405541 (+ 17us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:40:28.409054 (+ 3513us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 04:40:28.409055 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:40:28.409066 (+ 11us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 04:40:28.409092 (+ 26us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:40:28.409449 (+ 357us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:40:28.409452 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:40:28.409456 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 04:40:28.409542 (+ 86us) client_negotiation.cc:240] Negotiation successful
0808 04:40:28.409584 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":260,"thread_start_us":80,"threads_started":1}
I20260808 04:40:28.409772 26792 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:28.404419 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.240.193:46805 (local address 127.20.240.195:35849)
0808 04:40:28.404563 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:28.404567 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:28.404772 (+ 205us) server_negotiation.cc:407] Connection header received
0808 04:40:28.404890 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:28.404897 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:28.404946 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:28.405060 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:28.409364 (+ 4304us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:40:28.409367 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:40:28.409369 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 04:40:28.409380 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:40:28.409401 (+ 21us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 04:40:28.409409 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:40:28.409515 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:28.409591 (+ 76us) server_negotiation.cc:299] Negotiation successful
0808 04:40:28.409633 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260808 04:40:28.409866 26805 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:28.404283 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.195:35849 (local address 127.20.240.193:46805)
0808 04:40:28.404653 (+ 370us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:28.404671 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:28.404774 (+ 103us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:28.405124 (+ 350us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:28.405130 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:28.405149 (+ 19us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:40:28.409030 (+ 3881us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 04:40:28.409032 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:40:28.409042 (+ 10us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 04:40:28.409227 (+ 185us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:40:28.409509 (+ 282us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:40:28.409513 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:40:28.409516 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 04:40:28.409598 (+ 82us) client_negotiation.cc:240] Negotiation successful
0808 04:40:28.409633 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":247,"thread_start_us":115,"threads_started":1}
I20260808 04:40:28.410531 26732 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6df1b5e7b652443186f5ce4543bde748" candidate_uuid: "5d9e2c20741f48b091024503bd0b0236" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7df0ae5dbe334b318b6275656e2f3a23" is_pre_election: true
I20260808 04:40:28.410531 26595 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6df1b5e7b652443186f5ce4543bde748" candidate_uuid: "5d9e2c20741f48b091024503bd0b0236" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b140a66d60a145cdabdcb378120ba1c4" is_pre_election: true
I20260808 04:40:28.410884 26732 raft_consensus.cc:2454] T 6df1b5e7b652443186f5ce4543bde748 P 7df0ae5dbe334b318b6275656e2f3a23 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d9e2c20741f48b091024503bd0b0236 in term 0.
I20260808 04:40:28.410876 26595 raft_consensus.cc:2454] T 6df1b5e7b652443186f5ce4543bde748 P b140a66d60a145cdabdcb378120ba1c4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d9e2c20741f48b091024503bd0b0236 in term 0.
I20260808 04:40:28.411377 26387 leader_election.cc:302] T 6df1b5e7b652443186f5ce4543bde748 P 5d9e2c20741f48b091024503bd0b0236 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d9e2c20741f48b091024503bd0b0236, 7df0ae5dbe334b318b6275656e2f3a23; no voters:
I20260808 04:40:28.411629 26804 raft_consensus.cc:2781] T 6df1b5e7b652443186f5ce4543bde748 P 5d9e2c20741f48b091024503bd0b0236 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 04:40:28.411775 26804 raft_consensus.cc:482] T 6df1b5e7b652443186f5ce4543bde748 P 5d9e2c20741f48b091024503bd0b0236 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 04:40:28.411849 26804 raft_consensus.cc:3037] T 6df1b5e7b652443186f5ce4543bde748 P 5d9e2c20741f48b091024503bd0b0236 [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:40:28.412982 26804 raft_consensus.cc:504] T 6df1b5e7b652443186f5ce4543bde748 P 5d9e2c20741f48b091024503bd0b0236 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d9e2c20741f48b091024503bd0b0236" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 37135 } } peers { permanent_uuid: "7df0ae5dbe334b318b6275656e2f3a23" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 35849 } } peers { permanent_uuid: "b140a66d60a145cdabdcb378120ba1c4" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 39745 } }
I20260808 04:40:28.413441 26804 leader_election.cc:288] T 6df1b5e7b652443186f5ce4543bde748 P 5d9e2c20741f48b091024503bd0b0236 [CANDIDATE]: Term 1 election: Requested vote from peers 7df0ae5dbe334b318b6275656e2f3a23 (127.20.240.195:35849), b140a66d60a145cdabdcb378120ba1c4 (127.20.240.194:39745)
I20260808 04:40:28.413949 26595 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6df1b5e7b652443186f5ce4543bde748" candidate_uuid: "5d9e2c20741f48b091024503bd0b0236" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b140a66d60a145cdabdcb378120ba1c4"
I20260808 04:40:28.413960 26732 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6df1b5e7b652443186f5ce4543bde748" candidate_uuid: "5d9e2c20741f48b091024503bd0b0236" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7df0ae5dbe334b318b6275656e2f3a23"
I20260808 04:40:28.414060 26595 raft_consensus.cc:3037] T 6df1b5e7b652443186f5ce4543bde748 P b140a66d60a145cdabdcb378120ba1c4 [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:40:28.414112 26732 raft_consensus.cc:3037] T 6df1b5e7b652443186f5ce4543bde748 P 7df0ae5dbe334b318b6275656e2f3a23 [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:40:28.415133 26595 raft_consensus.cc:2454] T 6df1b5e7b652443186f5ce4543bde748 P b140a66d60a145cdabdcb378120ba1c4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d9e2c20741f48b091024503bd0b0236 in term 1.
I20260808 04:40:28.415316 26732 raft_consensus.cc:2454] T 6df1b5e7b652443186f5ce4543bde748 P 7df0ae5dbe334b318b6275656e2f3a23 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d9e2c20741f48b091024503bd0b0236 in term 1.
I20260808 04:40:28.415480 26387 leader_election.cc:302] T 6df1b5e7b652443186f5ce4543bde748 P 5d9e2c20741f48b091024503bd0b0236 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d9e2c20741f48b091024503bd0b0236, b140a66d60a145cdabdcb378120ba1c4; no voters:
I20260808 04:40:28.415670 26804 raft_consensus.cc:2781] T 6df1b5e7b652443186f5ce4543bde748 P 5d9e2c20741f48b091024503bd0b0236 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 04:40:28.415948 26804 raft_consensus.cc:686] T 6df1b5e7b652443186f5ce4543bde748 P 5d9e2c20741f48b091024503bd0b0236 [term 1 LEADER]: Becoming Leader. State: Replica: 5d9e2c20741f48b091024503bd0b0236, State: Running, Role: LEADER
I20260808 04:40:28.416302 26804 consensus_queue.cc:237] T 6df1b5e7b652443186f5ce4543bde748 P 5d9e2c20741f48b091024503bd0b0236 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d9e2c20741f48b091024503bd0b0236" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 37135 } } peers { permanent_uuid: "7df0ae5dbe334b318b6275656e2f3a23" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 35849 } } peers { permanent_uuid: "b140a66d60a145cdabdcb378120ba1c4" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 39745 } }
I20260808 04:40:28.419641 26305 catalog_manager.cc:5495] T 6df1b5e7b652443186f5ce4543bde748 P 5d9e2c20741f48b091024503bd0b0236 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5d9e2c20741f48b091024503bd0b0236 (127.20.240.193). New cstate: current_term: 1 leader_uuid: "5d9e2c20741f48b091024503bd0b0236" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d9e2c20741f48b091024503bd0b0236" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 37135 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7df0ae5dbe334b318b6275656e2f3a23" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 35849 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b140a66d60a145cdabdcb378120ba1c4" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 39745 } health_report { overall_health: UNKNOWN } } }
I20260808 04:40:28.488884 26790 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:28.487135 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46276 (local address 127.20.240.193:37135)
0808 04:40:28.487292 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:28.487295 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:28.487310 (+ 15us) server_negotiation.cc:407] Connection header received
0808 04:40:28.487532 (+ 222us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:28.487535 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:28.487608 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:28.487688 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:28.488510 (+ 822us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:40:28.488513 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:40:28.488515 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 04:40:28.488527 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:40:28.488548 (+ 21us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 04:40:28.488556 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:40:28.488643 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:28.488715 (+ 72us) server_negotiation.cc:299] Negotiation successful
0808 04:40:28.488751 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260808 04:40:28.495568 26595 raft_consensus.cc:1261] T 6df1b5e7b652443186f5ce4543bde748 P b140a66d60a145cdabdcb378120ba1c4 [term 1 FOLLOWER]: Refusing update from remote peer 5d9e2c20741f48b091024503bd0b0236: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 04:40:28.495568 26732 raft_consensus.cc:1261] T 6df1b5e7b652443186f5ce4543bde748 P 7df0ae5dbe334b318b6275656e2f3a23 [term 1 FOLLOWER]: Refusing update from remote peer 5d9e2c20741f48b091024503bd0b0236: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 04:40:28.496364 26804 consensus_queue.cc:1035] T 6df1b5e7b652443186f5ce4543bde748 P 5d9e2c20741f48b091024503bd0b0236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b140a66d60a145cdabdcb378120ba1c4" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 39745 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 04:40:28.496618 26807 consensus_queue.cc:1035] T 6df1b5e7b652443186f5ce4543bde748 P 5d9e2c20741f48b091024503bd0b0236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7df0ae5dbe334b318b6275656e2f3a23" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 35849 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 04:40:28.514851 26305 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:39266:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 04:40:28.515043 26305 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:39266:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 04:40:28.517802 26305 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fb87827a5314e51aa5049f3f7a76f73: Sending DeleteTablet for 3 replicas of tablet 6df1b5e7b652443186f5ce4543bde748
I20260808 04:40:28.518761 26436 tablet_service.cc:1514] Processing DeleteTablet for tablet 6df1b5e7b652443186f5ce4543bde748 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 04:40:28 UTC) from {username='slave'} at 127.0.0.1:46266
I20260808 04:40:28.519065 26710 tablet_service.cc:1514] Processing DeleteTablet for tablet 6df1b5e7b652443186f5ce4543bde748 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 04:40:28 UTC) from {username='slave'} at 127.0.0.1:56822
I20260808 04:40:28.519562 26821 tablet_replica.cc:330] T 6df1b5e7b652443186f5ce4543bde748 P 5d9e2c20741f48b091024503bd0b0236: stopping tablet replica
I20260808 04:40:28.519588 26822 tablet_replica.cc:330] T 6df1b5e7b652443186f5ce4543bde748 P 7df0ae5dbe334b318b6275656e2f3a23: stopping tablet replica
I20260808 04:40:28.519613 26574 tablet_service.cc:1514] Processing DeleteTablet for tablet 6df1b5e7b652443186f5ce4543bde748 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 04:40:28 UTC) from {username='slave'} at 127.0.0.1:52762
I20260808 04:40:28.519971 26821 raft_consensus.cc:2229] T 6df1b5e7b652443186f5ce4543bde748 P 5d9e2c20741f48b091024503bd0b0236 [term 1 LEADER]: Raft consensus shutting down.
I20260808 04:40:28.519971 26822 raft_consensus.cc:2229] T 6df1b5e7b652443186f5ce4543bde748 P 7df0ae5dbe334b318b6275656e2f3a23 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 04:40:28.520237 21443 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu with pid 26369
I20260808 04:40:28.520349 26822 raft_consensus.cc:2258] T 6df1b5e7b652443186f5ce4543bde748 P 7df0ae5dbe334b318b6275656e2f3a23 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 04:40:28.520398 26821 raft_consensus.cc:2258] T 6df1b5e7b652443186f5ce4543bde748 P 5d9e2c20741f48b091024503bd0b0236 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 04:40:28.522912 26822 ts_tablet_manager.cc:1905] T 6df1b5e7b652443186f5ce4543bde748 P 7df0ae5dbe334b318b6275656e2f3a23: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 04:40:28.525472 26823 tablet_replica.cc:330] T 6df1b5e7b652443186f5ce4543bde748 P b140a66d60a145cdabdcb378120ba1c4: stopping tablet replica
I20260808 04:40:28.525926 26823 raft_consensus.cc:2229] T 6df1b5e7b652443186f5ce4543bde748 P b140a66d60a145cdabdcb378120ba1c4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 04:40:28.526227 26822 ts_tablet_manager.cc:1918] T 6df1b5e7b652443186f5ce4543bde748 P 7df0ae5dbe334b318b6275656e2f3a23: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 04:40:28.526351 26822 log.cc:1196] T 6df1b5e7b652443186f5ce4543bde748 P 7df0ae5dbe334b318b6275656e2f3a23: Deleting WAL directory at /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786164000593138-21443-0/minicluster-data/ts-2/wal/wals/6df1b5e7b652443186f5ce4543bde748
I20260808 04:40:28.526451 26823 raft_consensus.cc:2258] T 6df1b5e7b652443186f5ce4543bde748 P b140a66d60a145cdabdcb378120ba1c4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 04:40:28.526760 26822 ts_tablet_manager.cc:1939] T 6df1b5e7b652443186f5ce4543bde748 P 7df0ae5dbe334b318b6275656e2f3a23: Deleting consensus metadata
I20260808 04:40:28.528256 26823 ts_tablet_manager.cc:1905] T 6df1b5e7b652443186f5ce4543bde748 P b140a66d60a145cdabdcb378120ba1c4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 04:40:28.528364 26290 catalog_manager.cc:4841] TS 7df0ae5dbe334b318b6275656e2f3a23 (127.20.240.195:35849): tablet 6df1b5e7b652443186f5ce4543bde748 (table test-table [id=b03ccc16e1ad40408e4061ca534e488e]) successfully deleted
W20260808 04:40:28.529542 26292 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.20.240.193:37135 (error 108)
I20260808 04:40:28.529840 21443 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu with pid 26507
I20260808 04:40:28.532186 26789 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:28.531864 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.193:37135 (local address 127.0.0.1:46284)
0808 04:40:28.532010 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:28.532100 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.240.193:37135: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
W20260808 04:40:28.532474 26292 catalog_manager.cc:4584] TS 5d9e2c20741f48b091024503bd0b0236 (127.20.240.193:37135): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 6df1b5e7b652443186f5ce4543bde748: Network error: Client connection negotiation failed: client connection to 127.20.240.193:37135: connect: Connection refused (error 111)
I20260808 04:40:28.542022 21443 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu with pid 26644
I20260808 04:40:28.542243 26789 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:28.541866 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.194:39745 (local address 127.0.0.1:52778)
0808 04:40:28.542049 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:28.542123 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.240.194:39745: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":69}
I20260808 04:40:28.550367 21443 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu with pid 26273
2026-08-08T04:40:28Z chronyd exiting
[ OK ] SecurityITest.TestDisableAuthenticationEncryption (1373 ms)
[ RUN ] SecurityITest.TestJwtMiniCluster
I20260808 04:40:28.574172 21443 mini_oidc.cc:152] Starting JWKS server
I20260808 04:40:28.576015 21443 webserver.cc:460] Webserver started at https://127.0.0.1:46075/ using document root <none> and password file <none>
I20260808 04:40:28.576201 21443 mini_oidc.cc:189] Starting OIDC Discovery server
I20260808 04:40:28.576515 21443 webserver.cc:460] Webserver started at http://127.0.0.1:43151/ using document root <none> and password file <none>
2026-08-08T04:40:28Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T04:40:28Z Disabled control of system clock
I20260808 04:40:28.589372 21443 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
/tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786164000593138-21443-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786164000593138-21443-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786164000593138-21443-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786164000593138-21443-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.240.254:34949
--webserver_interface=127.20.240.254
--webserver_port=0
--builtin_ntp_servers=127.20.240.212:34029
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.240.254:34949
--enable_jwt_token_auth=true
--jwks_url=https://localhost:46075/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786164000593138-21443-0/testchainca.cert with env {}
W20260808 04:40:28.722649 26830 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:40:28.722944 26830 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:40:28.722986 26830 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:40:28.727025 26830 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 04:40:28.727080 26830 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:40:28.727097 26830 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:40:28.727114 26830 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 04:40:28.727129 26830 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260808 04:40:28.727146 26830 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260808 04:40:28.727159 26830 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:46075/jwks.json
I20260808 04:40:28.732580 26830 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.240.212:34029
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786164000593138-21443-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786164000593138-21443-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.240.254:34949
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.240.254:34949
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:46075/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786164000593138-21443-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.240.254
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786164000593138-21443-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26830
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786164000593138-21443-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 04:05:18 UTC on ccycloud.quasar-drfdgt.root.comops.site
build id 4574101
I20260808 04:40:28.733763 26830 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:40:28.734745 26830 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260808 04:40:28.743678 26830 server_base.cc:1034] running on GCE node
W20260808 04:40:28.743641 26838 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:40:28.743626 26835 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:40:28.743626 26836 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:40:28.744593 26830 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:40:28.745826 26830 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:40:28.747031 26830 hybrid_clock.cc:648] HybridClock initialized: now 1786164028747004 us; error 41 us; skew 500 ppm
I20260808 04:40:28.749003 26830 webserver.cc:460] Webserver started at http://127.20.240.254:40627/ using document root <none> and password file <none>
I20260808 04:40:28.749702 26830 fs_manager.cc:359] Metadata directory not provided
I20260808 04:40:28.749801 26830 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:40:28.750046 26830 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 04:40:28.752223 26830 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786164000593138-21443-0/minicluster-data/master-0/data/instance:
uuid: "68fd753598c140928274f1b42a0a0afb"
format_stamp: "Formatted at 2026-08-08 04:40:28 on dist-test-slave-vxj2"
server_key: "e031a4b234e341cad4d76c84ff81522d"
server_key_iv: "6896eaa076d2bde22ca6457a236ed358"
server_key_version: "encryptionkey@0"
I20260808 04:40:28.752902 26830 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786164000593138-21443-0/minicluster-data/master-0/wal/instance:
uuid: "68fd753598c140928274f1b42a0a0afb"
format_stamp: "Formatted at 2026-08-08 04:40:28 on dist-test-slave-vxj2"
server_key: "e031a4b234e341cad4d76c84ff81522d"
server_key_iv: "6896eaa076d2bde22ca6457a236ed358"
server_key_version: "encryptionkey@0"
I20260808 04:40:28.756803 26830 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.001s
I20260808 04:40:28.759492 26845 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:28.760973 26830 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260808 04:40:28.761219 26830 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786164000593138-21443-0/minicluster-data/master-0/data,/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786164000593138-21443-0/minicluster-data/master-0/wal
uuid: "68fd753598c140928274f1b42a0a0afb"
format_stamp: "Formatted at 2026-08-08 04:40:28 on dist-test-slave-vxj2"
server_key: "e031a4b234e341cad4d76c84ff81522d"
server_key_iv: "6896eaa076d2bde22ca6457a236ed358"
server_key_version: "encryptionkey@0"
I20260808 04:40:28.761363 26830 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786164000593138-21443-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786164000593138-21443-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786164000593138-21443-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:40:28.790895 26830 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:40:28.791649 26830 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:40:28.791994 26830 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:40:28.800010 26830 rpc_server.cc:307] RPC server started. Bound to: 127.20.240.254:34949
I20260808 04:40:28.800041 26902 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.240.254:34949 every 8 connection(s)
I20260808 04:40:28.801080 26830 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786164000593138-21443-0/minicluster-data/master-0/data/info.pb
I20260808 04:40:28.804819 26903 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:40:28.807933 21443 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu as pid 26830
I20260808 04:40:28.808049 21443 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786164000593138-21443-0/minicluster-data/master-0/wal/instance
I20260808 04:40:28.808362 21443 external_mini_cluster.cc:1428] Setting key ca1b8e981ec96be0fefd46aed5ab7807
I20260808 04:40:28.812135 26903 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 68fd753598c140928274f1b42a0a0afb: Bootstrap starting.
I20260808 04:40:28.814646 26903 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 68fd753598c140928274f1b42a0a0afb: Neither blocks nor log segments found. Creating new log.
I20260808 04:40:28.815424 26903 log.cc:824] T 00000000000000000000000000000000 P 68fd753598c140928274f1b42a0a0afb: Log is configured to *not* fsync() on all Append() calls
I20260808 04:40:28.817613 26903 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 68fd753598c140928274f1b42a0a0afb: No bootstrap required, opened a new log
I20260808 04:40:28.819402 26906 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:28.810012 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42208 (local address 127.20.240.254:34949)
0808 04:40:28.810976 (+ 964us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:28.810999 (+ 23us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:28.811043 (+ 44us) server_negotiation.cc:407] Connection header received
0808 04:40:28.811810 (+ 767us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:28.811829 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:28.812274 (+ 445us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:28.812837 (+ 563us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:28.813374 (+ 537us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:28.814438 (+ 1064us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:28.815559 (+ 1121us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:28.816102 (+ 543us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:28.816299 (+ 197us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:28.817375 (+ 1076us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:40:28.817381 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:40:28.817395 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 04:40:28.817896 (+ 501us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:40:28.817962 (+ 66us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 04:40:28.817984 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:40:28.818099 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:28.818283 (+ 184us) server_negotiation.cc:299] Negotiation successful
0808 04:40:28.818596 (+ 313us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":362,"thread_start_us":159,"threads_started":1}
I20260808 04:40:28.821897 26903 raft_consensus.cc:348] T 00000000000000000000000000000000 P 68fd753598c140928274f1b42a0a0afb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "68fd753598c140928274f1b42a0a0afb" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 34949 } }
I20260808 04:40:28.822227 26903 raft_consensus.cc:374] T 00000000000000000000000000000000 P 68fd753598c140928274f1b42a0a0afb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:40:28.822315 26903 raft_consensus.cc:729] T 00000000000000000000000000000000 P 68fd753598c140928274f1b42a0a0afb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 68fd753598c140928274f1b42a0a0afb, State: Initialized, Role: FOLLOWER
I20260808 04:40:28.822744 21443 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 04:40:28.822842 26903 consensus_queue.cc:260] T 00000000000000000000000000000000 P 68fd753598c140928274f1b42a0a0afb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "68fd753598c140928274f1b42a0a0afb" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 34949 } }
I20260808 04:40:28.823020 26903 raft_consensus.cc:388] T 00000000000000000000000000000000 P 68fd753598c140928274f1b42a0a0afb [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 04:40:28.823083 26903 raft_consensus.cc:482] T 00000000000000000000000000000000 P 68fd753598c140928274f1b42a0a0afb [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 04:40:28.823175 26903 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 68fd753598c140928274f1b42a0a0afb [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:40:28.824440 26903 raft_consensus.cc:504] T 00000000000000000000000000000000 P 68fd753598c140928274f1b42a0a0afb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "68fd753598c140928274f1b42a0a0afb" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 34949 } }
I20260808 04:40:28.824815 26903 leader_election.cc:302] T 00000000000000000000000000000000 P 68fd753598c140928274f1b42a0a0afb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 68fd753598c140928274f1b42a0a0afb; no voters:
I20260808 04:40:28.825096 26903 leader_election.cc:288] T 00000000000000000000000000000000 P 68fd753598c140928274f1b42a0a0afb [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 04:40:28.825295 26908 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 68fd753598c140928274f1b42a0a0afb [term 1 FOLLOWER]: Leader election won for term 1
I20260808 04:40:28.825563 26908 raft_consensus.cc:686] T 00000000000000000000000000000000 P 68fd753598c140928274f1b42a0a0afb [term 1 LEADER]: Becoming Leader. State: Replica: 68fd753598c140928274f1b42a0a0afb, State: Running, Role: LEADER
I20260808 04:40:28.825958 26908 consensus_queue.cc:237] T 00000000000000000000000000000000 P 68fd753598c140928274f1b42a0a0afb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "68fd753598c140928274f1b42a0a0afb" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 34949 } }
I20260808 04:40:28.826448 26903 sys_catalog.cc:564] T 00000000000000000000000000000000 P 68fd753598c140928274f1b42a0a0afb [sys.catalog]: configured and running, proceeding with master startup.
I20260808 04:40:28.827637 26910 sys_catalog.cc:455] T 00000000000000000000000000000000 P 68fd753598c140928274f1b42a0a0afb [sys.catalog]: SysCatalogTable state changed. Reason: New leader 68fd753598c140928274f1b42a0a0afb. Latest consensus state: current_term: 1 leader_uuid: "68fd753598c140928274f1b42a0a0afb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "68fd753598c140928274f1b42a0a0afb" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 34949 } } }
I20260808 04:40:28.827791 26910 sys_catalog.cc:458] T 00000000000000000000000000000000 P 68fd753598c140928274f1b42a0a0afb [sys.catalog]: This master's current role is: LEADER
I20260808 04:40:28.828176 26909 sys_catalog.cc:455] T 00000000000000000000000000000000 P 68fd753598c140928274f1b42a0a0afb [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "68fd753598c140928274f1b42a0a0afb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "68fd753598c140928274f1b42a0a0afb" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 34949 } } }
I20260808 04:40:28.828261 26917 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 04:40:28.828368 26909 sys_catalog.cc:458] T 00000000000000000000000000000000 P 68fd753598c140928274f1b42a0a0afb [sys.catalog]: This master's current role is: LEADER
I20260808 04:40:28.831341 26917 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 04:40:28.837080 26917 catalog_manager.cc:1347] Generated new cluster ID: 8f64fc2395ab4960bf28d5bbe8bad38c
I20260808 04:40:28.837374 26917 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 04:40:28.848618 26917 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 04:40:28.850035 26917 catalog_manager.cc:1504] Loading token signing keys...
I20260808 04:40:28.860253 26917 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 68fd753598c140928274f1b42a0a0afb: Generated new TSK 0
I20260808 04:40:28.861243 26917 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260808 04:40:28.891642 26933 webserver.cc:533] Webserver: sslize failed: error:14094415:SSL routines:ssl3_read_bytes:sslv3 alert certificate expired
E20260808 04:40:28.891917 26933 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260808 04:40:28.892508 26906 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:28.874310 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42212 (local address 127.20.240.254:34949)
0808 04:40:28.874462 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:28.874468 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:28.874670 (+ 202us) server_negotiation.cc:407] Connection header received
0808 04:40:28.874891 (+ 221us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:28.874895 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:28.874957 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:28.875083 (+ 126us) server_negotiation.cc:226] Negotiated authn=JWT
0808 04:40:28.875330 (+ 247us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:28.876180 (+ 850us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:28.877047 (+ 867us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:28.877435 (+ 388us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:28.877544 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:28.877911 (+ 367us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0808 04:40:28.891985 (+ 14074us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:46075/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0808 04:40:28.892359 (+ 374us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:42212: Failed to load JWKS: Error downloading JWKS from 'https://localhost:46075/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"server-negotiator.queue_time_us":57}
W20260808 04:40:28.892601 26906 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:42212: Failed to load JWKS: Error downloading JWKS from 'https://localhost:46075/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
W20260808 04:40:28.894066 26932 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 04:40:28.874162 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:34949 (local address 127.0.0.1:42212)
0808 04:40:28.874581 (+ 419us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:28.874595 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:28.874715 (+ 120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:28.875104 (+ 389us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:28.875107 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:28.875114 (+ 7us) client_negotiation.cc:189] Negotiated authn=JWT
0808 04:40:28.875221 (+ 107us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:28.875225 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:28.876296 (+ 1071us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:28.876299 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:28.876910 (+ 611us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:28.876918 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:28.877560 (+ 642us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:28.877563 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:28.877636 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:28.877684 (+ 48us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0808 04:40:28.892346 (+ 14662us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:46075/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0808 04:40:28.892633 (+ 287us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.20.240.254:34949: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:46075/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"client-negotiator.queue_time_us":287,"thread_start_us":133,"threads_started":1}
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:597: Failure
Failed
Bad status: Runtime error: Could not connect to the cluster: Client connection negotiation failed: client connection to 127.20.240.254:34949: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:46075/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Google Test trace:
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:593: Valid JWT
I20260808 04:40:28.895089 21443 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu with pid 26830
2026-08-08T04:40:28Z chronyd exiting
I20260808 04:40:28.935012 21443 test_util.cc:175] -----------------------------------------------
I20260808 04:40:28.935153 21443 test_util.cc:176] Had fatal failures, leaving test files at /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786164000593138-21443-0
[ FAILED ] SecurityITest.TestJwtMiniCluster (363 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithInvalidCert
I20260808 04:40:28.936571 21443 mini_oidc.cc:152] Starting JWKS server
I20260808 04:40:28.937597 21443 webserver.cc:460] Webserver started at https://127.0.0.1:40573/ using document root <none> and password file <none>
I20260808 04:40:28.937736 21443 mini_oidc.cc:189] Starting OIDC Discovery server
I20260808 04:40:28.938023 21443 webserver.cc:460] Webserver started at http://127.0.0.1:39123/ using document root <none> and password file <none>
2026-08-08T04:40:28Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T04:40:28Z Disabled control of system clock
I20260808 04:40:28.948278 21443 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
/tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786164000593138-21443-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786164000593138-21443-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786164000593138-21443-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786164000593138-21443-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.240.254:39655
--webserver_interface=127.20.240.254
--webserver_port=0
--builtin_ntp_servers=127.20.240.212:45921
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.240.254:39655
--enable_jwt_token_auth=true
--jwks_url=https://localhost:40573/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786164000593138-21443-0/testchainca.cert with env {}
W20260808 04:40:29.066457 26940 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:40:29.066802 26940 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:40:29.066850 26940 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:40:29.070992 26940 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 04:40:29.071069 26940 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:40:29.071086 26940 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:40:29.071103 26940 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 04:40:29.071120 26940 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260808 04:40:29.071137 26940 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260808 04:40:29.071151 26940 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:40573/jwks.json
I20260808 04:40:29.076877 26940 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.240.212:45921
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786164000593138-21443-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786164000593138-21443-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.240.254:39655
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.240.254:39655
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:40573/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786164000593138-21443-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.240.254
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786164000593138-21443-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26940
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786164000593138-21443-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 04:05:18 UTC on ccycloud.quasar-drfdgt.root.comops.site
build id 4574101
I20260808 04:40:29.078133 26940 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:40:29.079205 26940 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:40:29.088357 26949 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:40:29.088376 26947 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:40:29.088376 26946 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:40:29.088673 26940 server_base.cc:1034] running on GCE node
I20260808 04:40:29.089320 26940 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:40:29.090546 26940 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:40:29.091749 26940 hybrid_clock.cc:648] HybridClock initialized: now 1786164029091715 us; error 46 us; skew 500 ppm
I20260808 04:40:29.093940 26940 webserver.cc:460] Webserver started at http://127.20.240.254:45117/ using document root <none> and password file <none>
I20260808 04:40:29.094568 26940 fs_manager.cc:359] Metadata directory not provided
I20260808 04:40:29.094663 26940 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:40:29.094947 26940 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 04:40:29.097085 26940 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786164000593138-21443-0/minicluster-data/master-0/data/instance:
uuid: "63651253435343ae81a0e83ef638d291"
format_stamp: "Formatted at 2026-08-08 04:40:29 on dist-test-slave-vxj2"
server_key: "77ae94818f1401ac619af63831ec2db8"
server_key_iv: "bb9674c3c9d0ec539fd0e15bfac1d786"
server_key_version: "encryptionkey@0"
I20260808 04:40:29.097790 26940 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786164000593138-21443-0/minicluster-data/master-0/wal/instance:
uuid: "63651253435343ae81a0e83ef638d291"
format_stamp: "Formatted at 2026-08-08 04:40:29 on dist-test-slave-vxj2"
server_key: "77ae94818f1401ac619af63831ec2db8"
server_key_iv: "bb9674c3c9d0ec539fd0e15bfac1d786"
server_key_version: "encryptionkey@0"
I20260808 04:40:29.101778 26940 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260808 04:40:29.104518 26955 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:29.106033 26940 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 04:40:29.106199 26940 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786164000593138-21443-0/minicluster-data/master-0/data,/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786164000593138-21443-0/minicluster-data/master-0/wal
uuid: "63651253435343ae81a0e83ef638d291"
format_stamp: "Formatted at 2026-08-08 04:40:29 on dist-test-slave-vxj2"
server_key: "77ae94818f1401ac619af63831ec2db8"
server_key_iv: "bb9674c3c9d0ec539fd0e15bfac1d786"
server_key_version: "encryptionkey@0"
I20260808 04:40:29.106341 26940 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786164000593138-21443-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786164000593138-21443-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786164000593138-21443-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:40:29.130213 26940 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:40:29.131032 26940 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:40:29.131255 26940 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:40:29.139219 26940 rpc_server.cc:307] RPC server started. Bound to: 127.20.240.254:39655
I20260808 04:40:29.139393 27010 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.240.254:39655 every 8 connection(s)
I20260808 04:40:29.140291 26940 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786164000593138-21443-0/minicluster-data/master-0/data/info.pb
I20260808 04:40:29.143805 27011 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:40:29.145994 21443 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu as pid 26940
I20260808 04:40:29.146145 21443 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786164000593138-21443-0/minicluster-data/master-0/wal/instance
I20260808 04:40:29.146443 21443 external_mini_cluster.cc:1428] Setting key 5d84beaba53e2b864bb0dc121bc60792
I20260808 04:40:29.151659 27011 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 63651253435343ae81a0e83ef638d291: Bootstrap starting.
I20260808 04:40:29.154872 27011 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 63651253435343ae81a0e83ef638d291: Neither blocks nor log segments found. Creating new log.
I20260808 04:40:29.155850 27011 log.cc:824] T 00000000000000000000000000000000 P 63651253435343ae81a0e83ef638d291: Log is configured to *not* fsync() on all Append() calls
I20260808 04:40:29.157770 27014 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:29.147943 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53016 (local address 127.20.240.254:39655)
0808 04:40:29.148656 (+ 713us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:29.148680 (+ 24us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:29.148729 (+ 49us) server_negotiation.cc:407] Connection header received
0808 04:40:29.149618 (+ 889us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:29.149644 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:29.150162 (+ 518us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:29.150575 (+ 413us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:29.151061 (+ 486us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:29.152599 (+ 1538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:29.153661 (+ 1062us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:29.154426 (+ 765us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:29.154601 (+ 175us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:29.155495 (+ 894us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:40:29.155502 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:40:29.155520 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 04:40:29.156097 (+ 577us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:40:29.156178 (+ 81us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 04:40:29.156214 (+ 36us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:40:29.156352 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:29.156534 (+ 182us) server_negotiation.cc:299] Negotiation successful
0808 04:40:29.156923 (+ 389us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":310,"thread_start_us":117,"threads_started":1}
I20260808 04:40:29.158226 27011 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 63651253435343ae81a0e83ef638d291: No bootstrap required, opened a new log
I20260808 04:40:29.160938 21443 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 04:40:29.162820 27011 raft_consensus.cc:348] T 00000000000000000000000000000000 P 63651253435343ae81a0e83ef638d291 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "63651253435343ae81a0e83ef638d291" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 39655 } }
I20260808 04:40:29.163071 27011 raft_consensus.cc:374] T 00000000000000000000000000000000 P 63651253435343ae81a0e83ef638d291 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:40:29.163130 27011 raft_consensus.cc:729] T 00000000000000000000000000000000 P 63651253435343ae81a0e83ef638d291 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 63651253435343ae81a0e83ef638d291, State: Initialized, Role: FOLLOWER
I20260808 04:40:29.163560 27011 consensus_queue.cc:260] T 00000000000000000000000000000000 P 63651253435343ae81a0e83ef638d291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "63651253435343ae81a0e83ef638d291" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 39655 } }
I20260808 04:40:29.163709 27011 raft_consensus.cc:388] T 00000000000000000000000000000000 P 63651253435343ae81a0e83ef638d291 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 04:40:29.163782 27011 raft_consensus.cc:482] T 00000000000000000000000000000000 P 63651253435343ae81a0e83ef638d291 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 04:40:29.163887 27011 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 63651253435343ae81a0e83ef638d291 [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:40:29.165012 27011 raft_consensus.cc:504] T 00000000000000000000000000000000 P 63651253435343ae81a0e83ef638d291 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "63651253435343ae81a0e83ef638d291" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 39655 } }
I20260808 04:40:29.165391 27011 leader_election.cc:302] T 00000000000000000000000000000000 P 63651253435343ae81a0e83ef638d291 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 63651253435343ae81a0e83ef638d291; no voters:
I20260808 04:40:29.165732 27011 leader_election.cc:288] T 00000000000000000000000000000000 P 63651253435343ae81a0e83ef638d291 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 04:40:29.165938 27017 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 63651253435343ae81a0e83ef638d291 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 04:40:29.166204 27017 raft_consensus.cc:686] T 00000000000000000000000000000000 P 63651253435343ae81a0e83ef638d291 [term 1 LEADER]: Becoming Leader. State: Replica: 63651253435343ae81a0e83ef638d291, State: Running, Role: LEADER
I20260808 04:40:29.166523 27017 consensus_queue.cc:237] T 00000000000000000000000000000000 P 63651253435343ae81a0e83ef638d291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "63651253435343ae81a0e83ef638d291" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 39655 } }
I20260808 04:40:29.167093 27011 sys_catalog.cc:564] T 00000000000000000000000000000000 P 63651253435343ae81a0e83ef638d291 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 04:40:29.168274 27018 sys_catalog.cc:455] T 00000000000000000000000000000000 P 63651253435343ae81a0e83ef638d291 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "63651253435343ae81a0e83ef638d291" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "63651253435343ae81a0e83ef638d291" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 39655 } } }
I20260808 04:40:29.168324 27020 sys_catalog.cc:455] T 00000000000000000000000000000000 P 63651253435343ae81a0e83ef638d291 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 63651253435343ae81a0e83ef638d291. Latest consensus state: current_term: 1 leader_uuid: "63651253435343ae81a0e83ef638d291" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "63651253435343ae81a0e83ef638d291" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 39655 } } }
I20260808 04:40:29.168419 27018 sys_catalog.cc:458] T 00000000000000000000000000000000 P 63651253435343ae81a0e83ef638d291 [sys.catalog]: This master's current role is: LEADER
I20260808 04:40:29.168450 27020 sys_catalog.cc:458] T 00000000000000000000000000000000 P 63651253435343ae81a0e83ef638d291 [sys.catalog]: This master's current role is: LEADER
I20260808 04:40:29.168814 27027 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 04:40:29.171996 27027 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 04:40:29.178424 27027 catalog_manager.cc:1347] Generated new cluster ID: d424407ff1244d48b8a524d48f1944a5
I20260808 04:40:29.178521 27027 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 04:40:29.205581 27027 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 04:40:29.206923 27027 catalog_manager.cc:1504] Loading token signing keys...
I20260808 04:40:29.215565 27027 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 63651253435343ae81a0e83ef638d291: Generated new TSK 0
I20260808 04:40:29.216482 27027 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260808 04:40:29.252892 27044 webserver.cc:533] Webserver: sslize failed: error:14094418:SSL routines:ssl3_read_bytes:tlsv1 alert unknown ca
E20260808 04:40:29.253026 27044 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260808 04:40:29.253759 27014 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:29.237132 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53022 (local address 127.20.240.254:39655)
0808 04:40:29.237314 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:29.237319 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:29.237436 (+ 117us) server_negotiation.cc:407] Connection header received
0808 04:40:29.237600 (+ 164us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:29.237604 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:29.237670 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:29.237806 (+ 136us) server_negotiation.cc:226] Negotiated authn=JWT
0808 04:40:29.238108 (+ 302us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:29.238962 (+ 854us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:29.239940 (+ 978us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:29.240300 (+ 360us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:29.240409 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:29.240778 (+ 369us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0808 04:40:29.253309 (+ 12531us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:40573/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0808 04:40:29.253608 (+ 299us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:53022: Failed to load JWKS: Error downloading JWKS from 'https://localhost:40573/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"server-negotiator.queue_time_us":91}
W20260808 04:40:29.253837 27014 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:53022: Failed to load JWKS: Error downloading JWKS from 'https://localhost:40573/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
W20260808 04:40:29.253991 27043 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 04:40:29.236968 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:39655 (local address 127.0.0.1:53022)
0808 04:40:29.237332 (+ 364us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:29.237346 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:29.237457 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:29.237822 (+ 365us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:29.237825 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:29.237838 (+ 13us) client_negotiation.cc:189] Negotiated authn=JWT
0808 04:40:29.237990 (+ 152us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:29.237996 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:29.239135 (+ 1139us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:29.239138 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:29.239813 (+ 675us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:29.239822 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:29.240463 (+ 641us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:29.240466 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:29.240544 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:29.240574 (+ 30us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0808 04:40:29.253553 (+ 12979us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:40573/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0808 04:40:29.253716 (+ 163us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.20.240.254:39655: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:40573/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"client-negotiator.queue_time_us":263,"thread_start_us":135,"threads_started":1}
I20260808 04:40:29.254743 21443 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu with pid 26940
2026-08-08T04:40:29Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithInvalidCert (359 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithUntrustedCert
I20260808 04:40:29.295869 21443 mini_oidc.cc:152] Starting JWKS server
I20260808 04:40:29.296793 21443 webserver.cc:460] Webserver started at https://127.0.0.1:44629/ using document root <none> and password file <none>
I20260808 04:40:29.296936 21443 mini_oidc.cc:189] Starting OIDC Discovery server
I20260808 04:40:29.297263 21443 webserver.cc:460] Webserver started at http://127.0.0.1:36321/ using document root <none> and password file <none>
2026-08-08T04:40:29Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T04:40:29Z Disabled control of system clock
I20260808 04:40:29.307928 21443 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
/tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786164000593138-21443-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786164000593138-21443-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786164000593138-21443-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786164000593138-21443-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.240.254:35449
--webserver_interface=127.20.240.254
--webserver_port=0
--builtin_ntp_servers=127.20.240.212:33499
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.240.254:35449
--enable_jwt_token_auth=true
--jwks_url=https://localhost:44629/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260808 04:40:29.429100 27050 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:40:29.429440 27050 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:40:29.429484 27050 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:40:29.433538 27050 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 04:40:29.433604 27050 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:40:29.433619 27050 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:40:29.433636 27050 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 04:40:29.433651 27050 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260808 04:40:29.433668 27050 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260808 04:40:29.433682 27050 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:44629/jwks.json
I20260808 04:40:29.438616 27050 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.240.212:33499
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786164000593138-21443-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786164000593138-21443-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.240.254:35449
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.240.254:35449
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:44629/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786164000593138-21443-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.240.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27050
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786164000593138-21443-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 04:05:18 UTC on ccycloud.quasar-drfdgt.root.comops.site
build id 4574101
I20260808 04:40:29.439774 27050 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:40:29.441195 27050 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:40:29.450519 27055 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:40:29.450538 27058 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:40:29.450523 27056 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:40:29.451009 27050 server_base.cc:1034] running on GCE node
I20260808 04:40:29.451756 27050 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:40:29.453143 27050 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:40:29.454449 27050 hybrid_clock.cc:648] HybridClock initialized: now 1786164029454416 us; error 52 us; skew 500 ppm
I20260808 04:40:29.456714 27050 webserver.cc:460] Webserver started at http://127.20.240.254:40663/ using document root <none> and password file <none>
I20260808 04:40:29.457463 27050 fs_manager.cc:359] Metadata directory not provided
I20260808 04:40:29.457576 27050 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:40:29.457847 27050 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 04:40:29.460228 27050 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786164000593138-21443-0/minicluster-data/master-0/data/instance:
uuid: "604845aae9b54a5e9b82e1bb1aa1343b"
format_stamp: "Formatted at 2026-08-08 04:40:29 on dist-test-slave-vxj2"
server_key: "06d1fe1f5ffd4c214ac00f21b9c0cda7"
server_key_iv: "11a4ad9f8a5d9c792bd986f4a120e884"
server_key_version: "encryptionkey@0"
I20260808 04:40:29.460991 27050 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786164000593138-21443-0/minicluster-data/master-0/wal/instance:
uuid: "604845aae9b54a5e9b82e1bb1aa1343b"
format_stamp: "Formatted at 2026-08-08 04:40:29 on dist-test-slave-vxj2"
server_key: "06d1fe1f5ffd4c214ac00f21b9c0cda7"
server_key_iv: "11a4ad9f8a5d9c792bd986f4a120e884"
server_key_version: "encryptionkey@0"
I20260808 04:40:29.465371 27050 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20260808 04:40:29.468015 27064 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:29.469374 27050 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 04:40:29.469532 27050 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786164000593138-21443-0/minicluster-data/master-0/data,/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786164000593138-21443-0/minicluster-data/master-0/wal
uuid: "604845aae9b54a5e9b82e1bb1aa1343b"
format_stamp: "Formatted at 2026-08-08 04:40:29 on dist-test-slave-vxj2"
server_key: "06d1fe1f5ffd4c214ac00f21b9c0cda7"
server_key_iv: "11a4ad9f8a5d9c792bd986f4a120e884"
server_key_version: "encryptionkey@0"
I20260808 04:40:29.469655 27050 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786164000593138-21443-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786164000593138-21443-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786164000593138-21443-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:40:29.480535 27050 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:40:29.481410 27050 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:40:29.481630 27050 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:40:29.489475 27050 rpc_server.cc:307] RPC server started. Bound to: 127.20.240.254:35449
I20260808 04:40:29.489526 27120 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.240.254:35449 every 8 connection(s)
I20260808 04:40:29.490558 27050 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786164000593138-21443-0/minicluster-data/master-0/data/info.pb
I20260808 04:40:29.494243 27121 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:40:29.494776 21443 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu as pid 27050
I20260808 04:40:29.494913 21443 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786164000593138-21443-0/minicluster-data/master-0/wal/instance
I20260808 04:40:29.495254 21443 external_mini_cluster.cc:1428] Setting key 2cfbd43575d7660b60ea250b93eae78d
I20260808 04:40:29.501221 27121 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 604845aae9b54a5e9b82e1bb1aa1343b: Bootstrap starting.
I20260808 04:40:29.504120 27121 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 604845aae9b54a5e9b82e1bb1aa1343b: Neither blocks nor log segments found. Creating new log.
I20260808 04:40:29.505117 27121 log.cc:824] T 00000000000000000000000000000000 P 604845aae9b54a5e9b82e1bb1aa1343b: Log is configured to *not* fsync() on all Append() calls
I20260808 04:40:29.505579 27124 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:29.496770 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51880 (local address 127.20.240.254:35449)
0808 04:40:29.497602 (+ 832us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:29.497619 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:29.497661 (+ 42us) server_negotiation.cc:407] Connection header received
0808 04:40:29.498319 (+ 658us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:29.498336 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:29.498784 (+ 448us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:29.499126 (+ 342us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:29.499572 (+ 446us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:29.500552 (+ 980us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:29.501654 (+ 1102us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:29.502219 (+ 565us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:29.502421 (+ 202us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:29.503522 (+ 1101us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:40:29.503528 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:40:29.503542 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 04:40:29.503993 (+ 451us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:40:29.504054 (+ 61us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 04:40:29.504076 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:40:29.504199 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:29.504362 (+ 163us) server_negotiation.cc:299] Negotiation successful
0808 04:40:29.504662 (+ 300us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":403,"thread_start_us":181,"threads_started":1}
I20260808 04:40:29.507678 27121 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 604845aae9b54a5e9b82e1bb1aa1343b: No bootstrap required, opened a new log
I20260808 04:40:29.509059 21443 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 04:40:29.512216 27121 raft_consensus.cc:348] T 00000000000000000000000000000000 P 604845aae9b54a5e9b82e1bb1aa1343b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "604845aae9b54a5e9b82e1bb1aa1343b" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 35449 } }
I20260808 04:40:29.512499 27121 raft_consensus.cc:374] T 00000000000000000000000000000000 P 604845aae9b54a5e9b82e1bb1aa1343b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:40:29.512575 27121 raft_consensus.cc:729] T 00000000000000000000000000000000 P 604845aae9b54a5e9b82e1bb1aa1343b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 604845aae9b54a5e9b82e1bb1aa1343b, State: Initialized, Role: FOLLOWER
I20260808 04:40:29.513113 27121 consensus_queue.cc:260] T 00000000000000000000000000000000 P 604845aae9b54a5e9b82e1bb1aa1343b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "604845aae9b54a5e9b82e1bb1aa1343b" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 35449 } }
I20260808 04:40:29.513337 27121 raft_consensus.cc:388] T 00000000000000000000000000000000 P 604845aae9b54a5e9b82e1bb1aa1343b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 04:40:29.513423 27121 raft_consensus.cc:482] T 00000000000000000000000000000000 P 604845aae9b54a5e9b82e1bb1aa1343b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 04:40:29.513569 27121 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 604845aae9b54a5e9b82e1bb1aa1343b [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:40:29.514778 27121 raft_consensus.cc:504] T 00000000000000000000000000000000 P 604845aae9b54a5e9b82e1bb1aa1343b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "604845aae9b54a5e9b82e1bb1aa1343b" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 35449 } }
I20260808 04:40:29.515168 27121 leader_election.cc:302] T 00000000000000000000000000000000 P 604845aae9b54a5e9b82e1bb1aa1343b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 604845aae9b54a5e9b82e1bb1aa1343b; no voters:
I20260808 04:40:29.515537 27121 leader_election.cc:288] T 00000000000000000000000000000000 P 604845aae9b54a5e9b82e1bb1aa1343b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 04:40:29.515671 27126 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 604845aae9b54a5e9b82e1bb1aa1343b [term 1 FOLLOWER]: Leader election won for term 1
I20260808 04:40:29.515977 27126 raft_consensus.cc:686] T 00000000000000000000000000000000 P 604845aae9b54a5e9b82e1bb1aa1343b [term 1 LEADER]: Becoming Leader. State: Replica: 604845aae9b54a5e9b82e1bb1aa1343b, State: Running, Role: LEADER
I20260808 04:40:29.516297 27126 consensus_queue.cc:237] T 00000000000000000000000000000000 P 604845aae9b54a5e9b82e1bb1aa1343b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "604845aae9b54a5e9b82e1bb1aa1343b" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 35449 } }
I20260808 04:40:29.517184 27121 sys_catalog.cc:564] T 00000000000000000000000000000000 P 604845aae9b54a5e9b82e1bb1aa1343b [sys.catalog]: configured and running, proceeding with master startup.
I20260808 04:40:29.518386 27128 sys_catalog.cc:455] T 00000000000000000000000000000000 P 604845aae9b54a5e9b82e1bb1aa1343b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 604845aae9b54a5e9b82e1bb1aa1343b. Latest consensus state: current_term: 1 leader_uuid: "604845aae9b54a5e9b82e1bb1aa1343b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "604845aae9b54a5e9b82e1bb1aa1343b" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 35449 } } }
I20260808 04:40:29.518581 27128 sys_catalog.cc:458] T 00000000000000000000000000000000 P 604845aae9b54a5e9b82e1bb1aa1343b [sys.catalog]: This master's current role is: LEADER
I20260808 04:40:29.519120 27127 sys_catalog.cc:455] T 00000000000000000000000000000000 P 604845aae9b54a5e9b82e1bb1aa1343b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "604845aae9b54a5e9b82e1bb1aa1343b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "604845aae9b54a5e9b82e1bb1aa1343b" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 35449 } } }
I20260808 04:40:29.519199 27136 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 04:40:29.519238 27127 sys_catalog.cc:458] T 00000000000000000000000000000000 P 604845aae9b54a5e9b82e1bb1aa1343b [sys.catalog]: This master's current role is: LEADER
I20260808 04:40:29.522783 27136 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 04:40:29.528729 27136 catalog_manager.cc:1347] Generated new cluster ID: b83cd44c74ac40eebcd90abd968484c1
I20260808 04:40:29.528867 27136 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 04:40:29.560560 27136 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 04:40:29.562060 27136 catalog_manager.cc:1504] Loading token signing keys...
I20260808 04:40:29.583094 27136 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 604845aae9b54a5e9b82e1bb1aa1343b: Generated new TSK 0
I20260808 04:40:29.584086 27136 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 04:40:29.604430 27124 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:29.599209 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51882 (local address 127.20.240.254:35449)
0808 04:40:29.599371 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:29.599376 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:29.599601 (+ 225us) server_negotiation.cc:407] Connection header received
0808 04:40:29.599823 (+ 222us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:29.599825 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:29.599877 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:29.599997 (+ 120us) server_negotiation.cc:226] Negotiated authn=JWT
0808 04:40:29.600248 (+ 251us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:29.600811 (+ 563us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:29.601801 (+ 990us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:29.602038 (+ 237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:29.602154 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:29.602496 (+ 342us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0808 04:40:29.604010 (+ 1514us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:44629/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0808 04:40:29.604256 (+ 246us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:51882: Failed to load JWKS: Error downloading JWKS from 'https://localhost:44629/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"server-negotiator.queue_time_us":60}
W20260808 04:40:29.604511 27124 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:51882: Failed to load JWKS: Error downloading JWKS from 'https://localhost:44629/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
W20260808 04:40:29.606357 27151 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 04:40:29.599112 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:35449 (local address 127.0.0.1:51882)
0808 04:40:29.599508 (+ 396us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:29.599521 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:29.599659 (+ 138us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:29.599999 (+ 340us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:29.600003 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:29.600011 (+ 8us) client_negotiation.cc:189] Negotiated authn=JWT
0808 04:40:29.600125 (+ 114us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:29.600141 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:29.600960 (+ 819us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:29.600964 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:29.601667 (+ 703us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:29.601676 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:29.602168 (+ 492us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:29.602172 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:29.602266 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:29.602291 (+ 25us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0808 04:40:29.604200 (+ 1909us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:44629/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0808 04:40:29.606165 (+ 1965us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.20.240.254:35449: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:44629/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"client-negotiator.queue_time_us":331,"mutex_wait_us":1718,"thread_start_us":128,"threads_started":1}
I20260808 04:40:29.607159 21443 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu with pid 27050
E20260808 04:40:29.615435 27152 webserver.cc:533] Webserver: sslize failed:
E20260808 04:40:29.615545 27152 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
2026-08-08T04:40:29Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithUntrustedCert (352 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS
2026-08-08T04:40:29Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T04:40:29Z Disabled control of system clock
I20260808 04:40:29.657894 21443 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
/tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786164000593138-21443-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786164000593138-21443-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786164000593138-21443-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786164000593138-21443-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.240.254:33923
--webserver_interface=127.20.240.254
--webserver_port=0
--builtin_ntp_servers=127.20.240.212:44635
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.240.254:33923
--enable_jwt_token_auth=true
--jwks_url=default.url
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786164000593138-21443-0/testchainca.cert with env {}
W20260808 04:40:29.773245 27156 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:40:29.773540 27156 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:40:29.773659 27156 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:40:29.777729 27156 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 04:40:29.777802 27156 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:40:29.777818 27156 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:40:29.777837 27156 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 04:40:29.777858 27156 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260808 04:40:29.777925 27156 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260808 04:40:29.777946 27156 flags.cc:425] Enabled experimental flag: --jwks_url=default.url
I20260808 04:40:29.783624 27156 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.240.212:44635
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786164000593138-21443-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786164000593138-21443-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.240.254:33923
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.240.254:33923
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=default.url
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786164000593138-21443-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.240.254
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786164000593138-21443-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27156
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786164000593138-21443-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 04:05:18 UTC on ccycloud.quasar-drfdgt.root.comops.site
build id 4574101
I20260808 04:40:29.784797 27156 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:40:29.785871 27156 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:40:29.794770 27161 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:40:29.794771 27162 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:40:29.794775 27164 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:40:29.795140 27156 server_base.cc:1034] running on GCE node
I20260808 04:40:29.795749 27156 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:40:29.796903 27156 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:40:29.798121 27156 hybrid_clock.cc:648] HybridClock initialized: now 1786164029798115 us; error 70 us; skew 500 ppm
I20260808 04:40:29.800148 27156 webserver.cc:460] Webserver started at http://127.20.240.254:35083/ using document root <none> and password file <none>
I20260808 04:40:29.800765 27156 fs_manager.cc:359] Metadata directory not provided
I20260808 04:40:29.800863 27156 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:40:29.801092 27156 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 04:40:29.803270 27156 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786164000593138-21443-0/minicluster-data/master-0/data/instance:
uuid: "2a4a7e6e7c45434c92141f641e9b5396"
format_stamp: "Formatted at 2026-08-08 04:40:29 on dist-test-slave-vxj2"
server_key: "d0f94da62ffc0f73d6b52f98bc0b3b0b"
server_key_iv: "1623a7b024055488ed1d9dd946e8e948"
server_key_version: "encryptionkey@0"
I20260808 04:40:29.803918 27156 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786164000593138-21443-0/minicluster-data/master-0/wal/instance:
uuid: "2a4a7e6e7c45434c92141f641e9b5396"
format_stamp: "Formatted at 2026-08-08 04:40:29 on dist-test-slave-vxj2"
server_key: "d0f94da62ffc0f73d6b52f98bc0b3b0b"
server_key_iv: "1623a7b024055488ed1d9dd946e8e948"
server_key_version: "encryptionkey@0"
I20260808 04:40:29.807873 27156 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260808 04:40:29.810667 27170 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:29.812068 27156 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260808 04:40:29.812268 27156 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786164000593138-21443-0/minicluster-data/master-0/data,/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786164000593138-21443-0/minicluster-data/master-0/wal
uuid: "2a4a7e6e7c45434c92141f641e9b5396"
format_stamp: "Formatted at 2026-08-08 04:40:29 on dist-test-slave-vxj2"
server_key: "d0f94da62ffc0f73d6b52f98bc0b3b0b"
server_key_iv: "1623a7b024055488ed1d9dd946e8e948"
server_key_version: "encryptionkey@0"
I20260808 04:40:29.812417 27156 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786164000593138-21443-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786164000593138-21443-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786164000593138-21443-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:40:29.864130 27156 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:40:29.864939 27156 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:40:29.865198 27156 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:40:29.872602 27156 rpc_server.cc:307] RPC server started. Bound to: 127.20.240.254:33923
I20260808 04:40:29.872620 27229 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.240.254:33923 every 8 connection(s)
I20260808 04:40:29.873719 27156 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786164000593138-21443-0/minicluster-data/master-0/data/info.pb
I20260808 04:40:29.875289 21443 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu as pid 27156
I20260808 04:40:29.875415 21443 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786164000593138-21443-0/minicluster-data/master-0/wal/instance
I20260808 04:40:29.875735 21443 external_mini_cluster.cc:1428] Setting key fad3678c05d62559fc9f05b296211121
I20260808 04:40:29.877041 27230 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:40:29.882833 27230 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2a4a7e6e7c45434c92141f641e9b5396: Bootstrap starting.
I20260808 04:40:29.885190 27230 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2a4a7e6e7c45434c92141f641e9b5396: Neither blocks nor log segments found. Creating new log.
I20260808 04:40:29.885982 27230 log.cc:824] T 00000000000000000000000000000000 P 2a4a7e6e7c45434c92141f641e9b5396: Log is configured to *not* fsync() on all Append() calls
I20260808 04:40:29.886194 27233 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:29.877324 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60440 (local address 127.20.240.254:33923)
0808 04:40:29.878019 (+ 695us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:29.878036 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:29.878076 (+ 40us) server_negotiation.cc:407] Connection header received
0808 04:40:29.878788 (+ 712us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:29.878805 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:29.879279 (+ 474us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:29.879667 (+ 388us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:29.880128 (+ 461us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:29.881302 (+ 1174us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:29.882362 (+ 1060us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:29.882890 (+ 528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:29.883117 (+ 227us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:29.884122 (+ 1005us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:40:29.884128 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:40:29.884141 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 04:40:29.884567 (+ 426us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:40:29.884630 (+ 63us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 04:40:29.884652 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:40:29.884774 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:29.884957 (+ 183us) server_negotiation.cc:299] Negotiation successful
0808 04:40:29.885334 (+ 377us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":316,"thread_start_us":146,"threads_started":1}
I20260808 04:40:29.888370 27230 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2a4a7e6e7c45434c92141f641e9b5396: No bootstrap required, opened a new log
I20260808 04:40:29.889698 21443 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 04:40:29.892810 27230 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2a4a7e6e7c45434c92141f641e9b5396 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2a4a7e6e7c45434c92141f641e9b5396" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 33923 } }
I20260808 04:40:29.893080 27230 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2a4a7e6e7c45434c92141f641e9b5396 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:40:29.893126 27230 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2a4a7e6e7c45434c92141f641e9b5396 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2a4a7e6e7c45434c92141f641e9b5396, State: Initialized, Role: FOLLOWER
I20260808 04:40:29.893592 27230 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2a4a7e6e7c45434c92141f641e9b5396 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2a4a7e6e7c45434c92141f641e9b5396" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 33923 } }
I20260808 04:40:29.893711 27230 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2a4a7e6e7c45434c92141f641e9b5396 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 04:40:29.893752 27230 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2a4a7e6e7c45434c92141f641e9b5396 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 04:40:29.893828 27230 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2a4a7e6e7c45434c92141f641e9b5396 [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:40:29.895112 27230 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2a4a7e6e7c45434c92141f641e9b5396 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2a4a7e6e7c45434c92141f641e9b5396" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 33923 } }
I20260808 04:40:29.895432 27230 leader_election.cc:302] T 00000000000000000000000000000000 P 2a4a7e6e7c45434c92141f641e9b5396 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2a4a7e6e7c45434c92141f641e9b5396; no voters:
I20260808 04:40:29.895709 27230 leader_election.cc:288] T 00000000000000000000000000000000 P 2a4a7e6e7c45434c92141f641e9b5396 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 04:40:29.895910 27235 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2a4a7e6e7c45434c92141f641e9b5396 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 04:40:29.896251 27235 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2a4a7e6e7c45434c92141f641e9b5396 [term 1 LEADER]: Becoming Leader. State: Replica: 2a4a7e6e7c45434c92141f641e9b5396, State: Running, Role: LEADER
I20260808 04:40:29.896654 27235 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2a4a7e6e7c45434c92141f641e9b5396 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2a4a7e6e7c45434c92141f641e9b5396" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 33923 } }
I20260808 04:40:29.897257 27230 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2a4a7e6e7c45434c92141f641e9b5396 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 04:40:29.898535 27236 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2a4a7e6e7c45434c92141f641e9b5396 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2a4a7e6e7c45434c92141f641e9b5396" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2a4a7e6e7c45434c92141f641e9b5396" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 33923 } } }
I20260808 04:40:29.898695 27236 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2a4a7e6e7c45434c92141f641e9b5396 [sys.catalog]: This master's current role is: LEADER
I20260808 04:40:29.899130 27244 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 04:40:29.899505 27237 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2a4a7e6e7c45434c92141f641e9b5396 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2a4a7e6e7c45434c92141f641e9b5396. Latest consensus state: current_term: 1 leader_uuid: "2a4a7e6e7c45434c92141f641e9b5396" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2a4a7e6e7c45434c92141f641e9b5396" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 33923 } } }
I20260808 04:40:29.899667 27237 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2a4a7e6e7c45434c92141f641e9b5396 [sys.catalog]: This master's current role is: LEADER
I20260808 04:40:29.902228 27244 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 04:40:29.908141 27244 catalog_manager.cc:1347] Generated new cluster ID: 8998d98356d4422daf5aa459c4957cf0
I20260808 04:40:29.908231 27244 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 04:40:29.945927 27244 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 04:40:29.947311 27244 catalog_manager.cc:1504] Loading token signing keys...
I20260808 04:40:29.953346 27244 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2a4a7e6e7c45434c92141f641e9b5396: Generated new TSK 0
I20260808 04:40:29.954196 27244 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 04:40:30.008072 27233 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:29.963876 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60452 (local address 127.20.240.254:33923)
0808 04:40:29.964039 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:29.964044 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:29.964240 (+ 196us) server_negotiation.cc:407] Connection header received
0808 04:40:29.964450 (+ 210us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:29.964452 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:29.964502 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:29.964589 (+ 87us) server_negotiation.cc:226] Negotiated authn=JWT
0808 04:40:29.964919 (+ 330us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:29.965573 (+ 654us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:29.966862 (+ 1289us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:29.967136 (+ 274us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:29.967238 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:29.967652 (+ 414us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0808 04:40:30.007624 (+ 39972us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0808 04:40:30.007939 (+ 315us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:60452: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"server-negotiator.queue_time_us":69}
W20260808 04:40:30.008191 27233 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:60452: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
W20260808 04:40:30.008363 27261 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 04:40:29.963786 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:33923 (local address 127.0.0.1:60452)
0808 04:40:29.964132 (+ 346us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:29.964150 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:29.964291 (+ 141us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:29.964627 (+ 336us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:29.964631 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:29.964640 (+ 9us) client_negotiation.cc:189] Negotiated authn=JWT
0808 04:40:29.964769 (+ 129us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:29.964777 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:29.965701 (+ 924us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:29.965706 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:29.966699 (+ 993us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:29.966711 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:29.967297 (+ 586us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:29.967302 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:29.967410 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:29.967444 (+ 34us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0808 04:40:30.007916 (+ 40472us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0808 04:40:30.008153 (+ 237us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.20.240.254:33923: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"client-negotiator.queue_time_us":246,"thread_start_us":128,"threads_started":1}
I20260808 04:40:30.009027 21443 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu with pid 27156
2026-08-08T04:40:30Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS (381 ms)
[ RUN ] SecurityITest.TestWorldReadableKeytab
[ OK ] SecurityITest.TestWorldReadableKeytab (133 ms)
[ RUN ] SecurityITest.TestWorldReadablePrivateKey
[ OK ] SecurityITest.TestWorldReadablePrivateKey (131 ms)
[ RUN ] SecurityITest.TestCorruptKerberosCC
Loading random data
Initializing database '/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786164000593138-21443-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 04:40:30 dist-test-slave-vxj2 krb5kdc[27273](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 04:40:30 dist-test-slave-vxj2 krb5kdc[27273](info): set up 2 sockets
Aug 08 04:40:30 dist-test-slave-vxj2 krb5kdc[27273](info): commencing operation
krb5kdc: starting...
W20260808 04:40:31.416584 21443 mini_kdc.cc:121] Time spent starting KDC: real 1.121s user 0.003s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786164000593138-21443-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786164000593138-21443-0/krb5kdc/test-user.keytab.
Aug 08 04:40:31 dist-test-slave-vxj2 krb5kdc[27273](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164031, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T04:40:31Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T04:40:31Z Disabled control of system clock
WARNING: no policy specified for kudu/127.20.240.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.240.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.240.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.254.keytab.
Entry for principal kudu/127.20.240.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.254.keytab.
I20260808 04:40:31.554134 21443 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
/tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786164000593138-21443-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786164000593138-21443-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786164000593138-21443-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786164000593138-21443-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.240.254:39251
--webserver_interface=127.20.240.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.254.keytab
--principal=kudu/127.20.240.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.240.212:36203
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.240.254:39251
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786164000593138-21443-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786164000593138-21443-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786164000593138-21443-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 04:40:31.668123 27288 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:40:31.668473 27288 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:40:31.668560 27288 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:40:31.672732 27288 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 04:40:31.672851 27288 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:40:31.672888 27288 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:40:31.672941 27288 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 04:40:31.672982 27288 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 04:40:31.679190 27288 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.240.212:36203
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786164000593138-21443-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786164000593138-21443-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.240.254:39251
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.254.keytab
--principal=kudu/127.20.240.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.240.254:39251
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786164000593138-21443-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.240.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27288
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786164000593138-21443-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 04:05:18 UTC on ccycloud.quasar-drfdgt.root.comops.site
build id 4574101
I20260808 04:40:31.680341 27288 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:40:31.681473 27288 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:40:31.690001 27298 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:40:31.690004 27296 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:40:31.690016 27295 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:40:31.690119 27288 server_base.cc:1034] running on GCE node
I20260808 04:40:31.690901 27288 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:40:31.692111 27288 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:40:31.693320 27288 hybrid_clock.cc:648] HybridClock initialized: now 1786164031693284 us; error 36 us; skew 500 ppm
Aug 08 04:40:31 dist-test-slave-vxj2 krb5kdc[27273](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164031, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.240.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:40:31.700098 27288 init.cc:377] Logged in from keytab as kudu/127.20.240.254@KRBTEST.COM (short username kudu)
I20260808 04:40:31.701308 27288 webserver.cc:460] Webserver started at http://127.20.240.254:38279/ using document root <none> and password file <none>
I20260808 04:40:31.701931 27288 fs_manager.cc:359] Metadata directory not provided
I20260808 04:40:31.702029 27288 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:40:31.702282 27288 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 04:40:31.704560 27288 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786164000593138-21443-0/minicluster-data/master-0/data/instance:
uuid: "886858d9a9d54447b82498caa748bdae"
format_stamp: "Formatted at 2026-08-08 04:40:31 on dist-test-slave-vxj2"
server_key: "ddee01f3a28d3f79b496c7be45bca530"
server_key_iv: "f802ae3b929ff1db604a5c04928a1af7"
server_key_version: "encryptionkey@0"
I20260808 04:40:31.705242 27288 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786164000593138-21443-0/minicluster-data/master-0/wal/instance:
uuid: "886858d9a9d54447b82498caa748bdae"
format_stamp: "Formatted at 2026-08-08 04:40:31 on dist-test-slave-vxj2"
server_key: "ddee01f3a28d3f79b496c7be45bca530"
server_key_iv: "f802ae3b929ff1db604a5c04928a1af7"
server_key_version: "encryptionkey@0"
I20260808 04:40:31.709270 27288 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.001s sys 0.003s
I20260808 04:40:31.711966 27305 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:31.713872 27288 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 04:40:31.714025 27288 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786164000593138-21443-0/minicluster-data/master-0/data,/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786164000593138-21443-0/minicluster-data/master-0/wal
uuid: "886858d9a9d54447b82498caa748bdae"
format_stamp: "Formatted at 2026-08-08 04:40:31 on dist-test-slave-vxj2"
server_key: "ddee01f3a28d3f79b496c7be45bca530"
server_key_iv: "f802ae3b929ff1db604a5c04928a1af7"
server_key_version: "encryptionkey@0"
I20260808 04:40:31.714157 27288 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786164000593138-21443-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786164000593138-21443-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786164000593138-21443-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:40:31.733814 27288 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:40:31.737291 27288 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:40:31.737511 27288 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:40:31.744879 27288 rpc_server.cc:307] RPC server started. Bound to: 127.20.240.254:39251
I20260808 04:40:31.744915 27358 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.240.254:39251 every 8 connection(s)
I20260808 04:40:31.745934 27288 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786164000593138-21443-0/minicluster-data/master-0/data/info.pb
I20260808 04:40:31.749099 27359 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:40:31.751938 21443 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu as pid 27288
I20260808 04:40:31.752095 21443 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786164000593138-21443-0/minicluster-data/master-0/wal/instance
I20260808 04:40:31.752465 21443 external_mini_cluster.cc:1428] Setting key f7c42bd988a715539ebced946f968f1a
I20260808 04:40:31.756532 27359 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 886858d9a9d54447b82498caa748bdae: Bootstrap starting.
I20260808 04:40:31.759449 27359 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 886858d9a9d54447b82498caa748bdae: Neither blocks nor log segments found. Creating new log.
I20260808 04:40:31.760418 27359 log.cc:824] T 00000000000000000000000000000000 P 886858d9a9d54447b82498caa748bdae: Log is configured to *not* fsync() on all Append() calls
Aug 08 04:40:31 dist-test-slave-vxj2 krb5kdc[27273](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164031, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.240.254@KRBTEST.COM
I20260808 04:40:31.763113 27359 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 886858d9a9d54447b82498caa748bdae: No bootstrap required, opened a new log
I20260808 04:40:31.768249 27359 raft_consensus.cc:348] T 00000000000000000000000000000000 P 886858d9a9d54447b82498caa748bdae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "886858d9a9d54447b82498caa748bdae" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 39251 } }
I20260808 04:40:31.768582 27359 raft_consensus.cc:374] T 00000000000000000000000000000000 P 886858d9a9d54447b82498caa748bdae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:40:31.768672 27359 raft_consensus.cc:729] T 00000000000000000000000000000000 P 886858d9a9d54447b82498caa748bdae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 886858d9a9d54447b82498caa748bdae, State: Initialized, Role: FOLLOWER
I20260808 04:40:31.769322 27359 consensus_queue.cc:260] T 00000000000000000000000000000000 P 886858d9a9d54447b82498caa748bdae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "886858d9a9d54447b82498caa748bdae" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 39251 } }
I20260808 04:40:31.769569 27359 raft_consensus.cc:388] T 00000000000000000000000000000000 P 886858d9a9d54447b82498caa748bdae [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 04:40:31.769660 27359 raft_consensus.cc:482] T 00000000000000000000000000000000 P 886858d9a9d54447b82498caa748bdae [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 04:40:31.769838 27359 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 886858d9a9d54447b82498caa748bdae [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:40:31.770803 27363 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:31.754028 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53900 (local address 127.20.240.254:39251)
0808 04:40:31.754460 (+ 432us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:31.754476 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:31.754511 (+ 35us) server_negotiation.cc:407] Connection header received
0808 04:40:31.755372 (+ 861us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:31.755392 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:31.755742 (+ 350us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:31.756025 (+ 283us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:31.757243 (+ 1218us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:31.758315 (+ 1072us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:31.759666 (+ 1351us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:31.760138 (+ 472us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:31.760262 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:31.763585 (+ 3323us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:40:31.763593 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:40:31.763613 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:40:31.763651 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:40:31.766883 (+ 3232us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:31.767399 (+ 516us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:31.767406 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:31.767413 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:31.767590 (+ 177us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:31.767890 (+ 300us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:31.767894 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:31.767896 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:31.768504 (+ 608us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:40:31.768769 (+ 265us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:31.769078 (+ 309us) server_negotiation.cc:299] Negotiation successful
0808 04:40:31.769460 (+ 382us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":285,"thread_start_us":150,"threads_started":1}
I20260808 04:40:31.771343 27359 raft_consensus.cc:504] T 00000000000000000000000000000000 P 886858d9a9d54447b82498caa748bdae [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "886858d9a9d54447b82498caa748bdae" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 39251 } }
I20260808 04:40:31.771739 27359 leader_election.cc:302] T 00000000000000000000000000000000 P 886858d9a9d54447b82498caa748bdae [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 886858d9a9d54447b82498caa748bdae; no voters:
I20260808 04:40:31.772113 27359 leader_election.cc:288] T 00000000000000000000000000000000 P 886858d9a9d54447b82498caa748bdae [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 04:40:31.772202 27365 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 886858d9a9d54447b82498caa748bdae [term 1 FOLLOWER]: Leader election won for term 1
I20260808 04:40:31.772431 27365 raft_consensus.cc:686] T 00000000000000000000000000000000 P 886858d9a9d54447b82498caa748bdae [term 1 LEADER]: Becoming Leader. State: Replica: 886858d9a9d54447b82498caa748bdae, State: Running, Role: LEADER
I20260808 04:40:31.772773 27365 consensus_queue.cc:237] T 00000000000000000000000000000000 P 886858d9a9d54447b82498caa748bdae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "886858d9a9d54447b82498caa748bdae" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 39251 } }
I20260808 04:40:31.773603 27359 sys_catalog.cc:564] T 00000000000000000000000000000000 P 886858d9a9d54447b82498caa748bdae [sys.catalog]: configured and running, proceeding with master startup.
I20260808 04:40:31.774703 27366 sys_catalog.cc:455] T 00000000000000000000000000000000 P 886858d9a9d54447b82498caa748bdae [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "886858d9a9d54447b82498caa748bdae" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "886858d9a9d54447b82498caa748bdae" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 39251 } } }
I20260808 04:40:31.774762 27367 sys_catalog.cc:455] T 00000000000000000000000000000000 P 886858d9a9d54447b82498caa748bdae [sys.catalog]: SysCatalogTable state changed. Reason: New leader 886858d9a9d54447b82498caa748bdae. Latest consensus state: current_term: 1 leader_uuid: "886858d9a9d54447b82498caa748bdae" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "886858d9a9d54447b82498caa748bdae" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 39251 } } }
I20260808 04:40:31.774922 27367 sys_catalog.cc:458] T 00000000000000000000000000000000 P 886858d9a9d54447b82498caa748bdae [sys.catalog]: This master's current role is: LEADER
I20260808 04:40:31.774957 27366 sys_catalog.cc:458] T 00000000000000000000000000000000 P 886858d9a9d54447b82498caa748bdae [sys.catalog]: This master's current role is: LEADER
I20260808 04:40:31.775939 27375 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 04:40:31.779141 27375 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 04:40:31.785172 27375 catalog_manager.cc:1347] Generated new cluster ID: 35c36c3d7ea64ac6a37f8b3feddd2e05
I20260808 04:40:31.785262 27375 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 04:40:31.806012 27375 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 04:40:31.807042 27375 catalog_manager.cc:1504] Loading token signing keys...
I20260808 04:40:31.821580 27375 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 886858d9a9d54447b82498caa748bdae: Generated new TSK 0
I20260808 04:40:31.822414 27375 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.20.240.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.240.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.240.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.193.keytab.
Entry for principal kudu/127.20.240.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.193.keytab.
I20260808 04:40:31.857101 21443 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
/tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786164000593138-21443-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786164000593138-21443-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786164000593138-21443-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786164000593138-21443-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.240.193:0
--local_ip_for_outbound_sockets=127.20.240.193
--webserver_interface=127.20.240.193
--webserver_port=0
--tserver_master_addrs=127.20.240.254:39251
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.193.keytab
--principal=kudu/127.20.240.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.240.212:36203
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786164000593138-21443-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786164000593138-21443-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786164000593138-21443-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 04:40:31.986536 27387 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:40:31.986848 27387 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:40:31.986896 27387 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:40:31.991021 27387 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:40:31.991097 27387 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:40:31.991160 27387 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.240.193
I20260808 04:40:31.996629 27387 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.240.212:36203
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786164000593138-21443-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786164000593138-21443-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.193.keytab
--principal=kudu/127.20.240.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.240.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786164000593138-21443-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.240.193
--webserver_port=0
--tserver_master_addrs=127.20.240.254:39251
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27387
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.240.193
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786164000593138-21443-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 04:05:18 UTC on ccycloud.quasar-drfdgt.root.comops.site
build id 4574101
I20260808 04:40:31.997785 27387 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:40:31.998847 27387 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260808 04:40:32.009004 27387 server_base.cc:1034] running on GCE node
W20260808 04:40:32.009218 27392 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:40:32.009054 27396 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:40:32.009061 27393 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:40:32.009888 27387 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:40:32.010584 27387 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:40:32.011809 27387 hybrid_clock.cc:648] HybridClock initialized: now 1786164032011791 us; error 37 us; skew 500 ppm
Aug 08 04:40:32 dist-test-slave-vxj2 krb5kdc[27273](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164032, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.240.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:40:32.015079 27387 init.cc:377] Logged in from keytab as kudu/127.20.240.193@KRBTEST.COM (short username kudu)
I20260808 04:40:32.016142 27387 webserver.cc:460] Webserver started at http://127.20.240.193:36437/ using document root <none> and password file <none>
I20260808 04:40:32.016808 27387 fs_manager.cc:359] Metadata directory not provided
I20260808 04:40:32.016914 27387 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:40:32.017236 27387 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 04:40:32.019522 27387 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786164000593138-21443-0/minicluster-data/ts-0/data/instance:
uuid: "4e44d892476c47bdaeb82f1950913298"
format_stamp: "Formatted at 2026-08-08 04:40:32 on dist-test-slave-vxj2"
server_key: "2689c2db9353e7d63ead0326a74ac4a4"
server_key_iv: "dc62539dd5637a679bbc50b2a5023ef3"
server_key_version: "encryptionkey@0"
I20260808 04:40:32.020217 27387 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786164000593138-21443-0/minicluster-data/ts-0/wal/instance:
uuid: "4e44d892476c47bdaeb82f1950913298"
format_stamp: "Formatted at 2026-08-08 04:40:32 on dist-test-slave-vxj2"
server_key: "2689c2db9353e7d63ead0326a74ac4a4"
server_key_iv: "dc62539dd5637a679bbc50b2a5023ef3"
server_key_version: "encryptionkey@0"
I20260808 04:40:32.024610 27387 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.002s
I20260808 04:40:32.027745 27403 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:32.029278 27387 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260808 04:40:32.029456 27387 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786164000593138-21443-0/minicluster-data/ts-0/data,/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786164000593138-21443-0/minicluster-data/ts-0/wal
uuid: "4e44d892476c47bdaeb82f1950913298"
format_stamp: "Formatted at 2026-08-08 04:40:32 on dist-test-slave-vxj2"
server_key: "2689c2db9353e7d63ead0326a74ac4a4"
server_key_iv: "dc62539dd5637a679bbc50b2a5023ef3"
server_key_version: "encryptionkey@0"
I20260808 04:40:32.029598 27387 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786164000593138-21443-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786164000593138-21443-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786164000593138-21443-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:40:32.043107 27387 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:40:32.046818 27387 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:40:32.047055 27387 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:40:32.047705 27387 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 04:40:32.048629 27387 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 04:40:32.048702 27387 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:32.048780 27387 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 04:40:32.048827 27387 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:32.059142 27387 rpc_server.cc:307] RPC server started. Bound to: 127.20.240.193:45239
I20260808 04:40:32.059222 27523 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.240.193:45239 every 8 connection(s)
I20260808 04:40:32.060196 27387 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786164000593138-21443-0/minicluster-data/ts-0/data/info.pb
I20260808 04:40:32.065397 21443 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu as pid 27387
I20260808 04:40:32.065506 21443 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786164000593138-21443-0/minicluster-data/ts-0/wal/instance
I20260808 04:40:32.065773 21443 external_mini_cluster.cc:1428] Setting key 0ca3e8f1b979cdfc1487290c8d60ee8e
Aug 08 04:40:32 dist-test-slave-vxj2 krb5kdc[27273](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164032, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.240.193@KRBTEST.COM for kudu/127.20.240.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.20.240.194@KRBTEST.COM; defaulting to no policy
I20260808 04:40:32.077288 27363 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:32.062371 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.240.193:57377 (local address 127.20.240.254:39251)
0808 04:40:32.062558 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:32.062562 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:32.063368 (+ 806us) server_negotiation.cc:407] Connection header received
0808 04:40:32.064913 (+ 1545us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:32.064917 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:32.064985 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:32.065070 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:32.066658 (+ 1588us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:32.067283 (+ 625us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:32.069104 (+ 1821us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:32.069585 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:32.069725 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:32.072769 (+ 3044us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:40:32.072772 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:40:32.072774 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:40:32.072831 (+ 57us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:40:32.074691 (+ 1860us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:32.075412 (+ 721us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:32.075419 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:32.075423 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:32.075512 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:32.075984 (+ 472us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:32.075986 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:32.075987 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:32.076179 (+ 192us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:40:32.076258 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:32.076975 (+ 717us) server_negotiation.cc:299] Negotiation successful
0808 04:40:32.077103 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82}
I20260808 04:40:32.078246 27526 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:32.062697 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:39251 (local address 127.20.240.193:57377)
0808 04:40:32.063184 (+ 487us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:32.063238 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:32.064584 (+ 1346us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:32.065274 (+ 690us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:32.065281 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:32.065760 (+ 479us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:40:32.066490 (+ 730us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:32.066510 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:32.067430 (+ 920us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:32.067433 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:32.068924 (+ 1491us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:32.068939 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:32.069756 (+ 817us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:32.069759 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:32.069927 (+ 168us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:32.070599 (+ 672us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:40:32.070616 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:40:32.072545 (+ 1929us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:40:32.074826 (+ 2281us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:32.074835 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:32.074855 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:32.075263 (+ 408us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:32.075642 (+ 379us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:32.075648 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:32.075652 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:32.075878 (+ 226us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:32.076298 (+ 420us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:40:32.076307 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:40:32.076668 (+ 361us) client_negotiation.cc:769] Sending connection context
0808 04:40:32.076920 (+ 252us) client_negotiation.cc:240] Negotiation successful
0808 04:40:32.077298 (+ 378us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":288,"thread_start_us":120,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.240.194@KRBTEST.COM" created.
I20260808 04:40:32.081086 27524 heartbeater.cc:347] Connected to a master server at 127.20.240.254:39251
I20260808 04:40:32.081383 27524 heartbeater.cc:464] Registering TS with master...
I20260808 04:40:32.081912 27524 heartbeater.cc:511] Master 127.20.240.254:39251 requested a full tablet report, sending...
I20260808 04:40:32.083539 27322 ts_manager.cc:194] Registered new tserver with Master: 4e44d892476c47bdaeb82f1950913298 (127.20.240.193:45239)
I20260808 04:40:32.084688 27322 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.240.193@KRBTEST.COM'} at 127.20.240.193:57377
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.240.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.194.keytab.
Entry for principal kudu/127.20.240.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.194.keytab.
I20260808 04:40:32.096702 21443 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
/tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786164000593138-21443-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786164000593138-21443-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786164000593138-21443-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786164000593138-21443-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.240.194:0
--local_ip_for_outbound_sockets=127.20.240.194
--webserver_interface=127.20.240.194
--webserver_port=0
--tserver_master_addrs=127.20.240.254:39251
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.194.keytab
--principal=kudu/127.20.240.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.240.212:36203
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786164000593138-21443-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786164000593138-21443-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786164000593138-21443-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 04:40:32.211014 27529 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:40:32.211355 27529 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:40:32.211436 27529 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:40:32.216341 27529 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:40:32.216470 27529 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:40:32.216594 27529 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.240.194
I20260808 04:40:32.222465 27529 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.240.212:36203
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786164000593138-21443-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786164000593138-21443-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.194.keytab
--principal=kudu/127.20.240.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.240.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786164000593138-21443-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.240.194
--webserver_port=0
--tserver_master_addrs=127.20.240.254:39251
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27529
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.240.194
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786164000593138-21443-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 04:05:18 UTC on ccycloud.quasar-drfdgt.root.comops.site
build id 4574101
I20260808 04:40:32.223711 27529 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:40:32.224848 27529 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:40:32.235193 27538 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:40:32.235175 27535 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:40:32.235194 27536 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:40:32.235491 27529 server_base.cc:1034] running on GCE node
I20260808 04:40:32.235952 27529 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:40:32.236657 27529 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:40:32.237843 27529 hybrid_clock.cc:648] HybridClock initialized: now 1786164032237829 us; error 33 us; skew 500 ppm
Aug 08 04:40:32 dist-test-slave-vxj2 krb5kdc[27273](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164032, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.240.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:40:32.240694 27529 init.cc:377] Logged in from keytab as kudu/127.20.240.194@KRBTEST.COM (short username kudu)
I20260808 04:40:32.241717 27529 webserver.cc:460] Webserver started at http://127.20.240.194:45053/ using document root <none> and password file <none>
I20260808 04:40:32.242259 27529 fs_manager.cc:359] Metadata directory not provided
I20260808 04:40:32.242324 27529 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:40:32.242496 27529 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 04:40:32.244648 27529 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786164000593138-21443-0/minicluster-data/ts-1/data/instance:
uuid: "fc755ebea19c47c18a99d49669e217d9"
format_stamp: "Formatted at 2026-08-08 04:40:32 on dist-test-slave-vxj2"
server_key: "cd841006c0f1d377d03962bcda3c3227"
server_key_iv: "44830aaf21b8c123e52972d9fb127eea"
server_key_version: "encryptionkey@0"
I20260808 04:40:32.245255 27529 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786164000593138-21443-0/minicluster-data/ts-1/wal/instance:
uuid: "fc755ebea19c47c18a99d49669e217d9"
format_stamp: "Formatted at 2026-08-08 04:40:32 on dist-test-slave-vxj2"
server_key: "cd841006c0f1d377d03962bcda3c3227"
server_key_iv: "44830aaf21b8c123e52972d9fb127eea"
server_key_version: "encryptionkey@0"
I20260808 04:40:32.249083 27529 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.001s
I20260808 04:40:32.251587 27546 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:32.252957 27529 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20260808 04:40:32.253089 27529 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786164000593138-21443-0/minicluster-data/ts-1/data,/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786164000593138-21443-0/minicluster-data/ts-1/wal
uuid: "fc755ebea19c47c18a99d49669e217d9"
format_stamp: "Formatted at 2026-08-08 04:40:32 on dist-test-slave-vxj2"
server_key: "cd841006c0f1d377d03962bcda3c3227"
server_key_iv: "44830aaf21b8c123e52972d9fb127eea"
server_key_version: "encryptionkey@0"
I20260808 04:40:32.253260 27529 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786164000593138-21443-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786164000593138-21443-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786164000593138-21443-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:40:32.282932 27529 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:40:32.286437 27529 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:40:32.286679 27529 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:40:32.287343 27529 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 04:40:32.288244 27529 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 04:40:32.288317 27529 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:32.288393 27529 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 04:40:32.288445 27529 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:32.298192 27529 rpc_server.cc:307] RPC server started. Bound to: 127.20.240.194:35815
I20260808 04:40:32.298223 27664 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.240.194:35815 every 8 connection(s)
I20260808 04:40:32.299165 27529 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786164000593138-21443-0/minicluster-data/ts-1/data/info.pb
I20260808 04:40:32.304594 21443 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu as pid 27529
I20260808 04:40:32.304750 21443 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786164000593138-21443-0/minicluster-data/ts-1/wal/instance
I20260808 04:40:32.305020 21443 external_mini_cluster.cc:1428] Setting key e7ae3a2ceadbf95dfa134896f016180d
Aug 08 04:40:32 dist-test-slave-vxj2 krb5kdc[27273](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164032, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.240.194@KRBTEST.COM for kudu/127.20.240.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.20.240.195@KRBTEST.COM; defaulting to no policy
I20260808 04:40:32.314553 27363 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:32.301350 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.240.194:45735 (local address 127.20.240.254:39251)
0808 04:40:32.301506 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:32.301510 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:32.302413 (+ 903us) server_negotiation.cc:407] Connection header received
0808 04:40:32.303878 (+ 1465us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:32.303882 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:32.303946 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:32.304056 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:32.305442 (+ 1386us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:32.306103 (+ 661us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:32.307392 (+ 1289us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:32.307634 (+ 242us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:32.307750 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:32.310595 (+ 2845us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:40:32.310599 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:40:32.310602 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:40:32.310633 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:40:32.312274 (+ 1641us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:32.312846 (+ 572us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:32.312850 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:32.312852 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:32.312941 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:32.313370 (+ 429us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:32.313373 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:32.313375 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:32.313574 (+ 199us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:40:32.313681 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:32.314225 (+ 544us) server_negotiation.cc:299] Negotiation successful
0808 04:40:32.314374 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260808 04:40:32.315413 27667 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:32.301662 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:39251 (local address 127.20.240.194:45735)
0808 04:40:32.302229 (+ 567us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:32.302276 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:32.303637 (+ 1361us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:32.304232 (+ 595us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:32.304240 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:32.304641 (+ 401us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:40:32.305271 (+ 630us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:32.305287 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:32.306238 (+ 951us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:32.306241 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:32.307253 (+ 1012us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:32.307263 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:32.307796 (+ 533us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:32.307801 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:32.307988 (+ 187us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:32.308647 (+ 659us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:40:32.308664 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:40:32.310413 (+ 1749us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:40:32.312431 (+ 2018us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:32.312438 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:32.312455 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:32.312728 (+ 273us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:32.313042 (+ 314us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:32.313045 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:32.313046 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:32.313262 (+ 216us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:32.313693 (+ 431us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:40:32.313702 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:40:32.313978 (+ 276us) client_negotiation.cc:769] Sending connection context
0808 04:40:32.314166 (+ 188us) client_negotiation.cc:240] Negotiation successful
0808 04:40:32.314516 (+ 350us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":303,"thread_start_us":121,"threads_started":1}
I20260808 04:40:32.316675 27665 heartbeater.cc:347] Connected to a master server at 127.20.240.254:39251
I20260808 04:40:32.316941 27665 heartbeater.cc:464] Registering TS with master...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.240.195@KRBTEST.COM" created.
I20260808 04:40:32.317618 27665 heartbeater.cc:511] Master 127.20.240.254:39251 requested a full tablet report, sending...
I20260808 04:40:32.318858 27322 ts_manager.cc:194] Registered new tserver with Master: fc755ebea19c47c18a99d49669e217d9 (127.20.240.194:35815)
I20260808 04:40:32.319667 27322 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.240.194@KRBTEST.COM'} at 127.20.240.194:45735
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.240.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.195.keytab.
Entry for principal kudu/127.20.240.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.195.keytab.
I20260808 04:40:32.336592 21443 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
/tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786164000593138-21443-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786164000593138-21443-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786164000593138-21443-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786164000593138-21443-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.240.195:0
--local_ip_for_outbound_sockets=127.20.240.195
--webserver_interface=127.20.240.195
--webserver_port=0
--tserver_master_addrs=127.20.240.254:39251
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.195.keytab
--principal=kudu/127.20.240.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.240.212:36203
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786164000593138-21443-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786164000593138-21443-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786164000593138-21443-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 04:40:32.454011 27670 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:40:32.454356 27670 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:40:32.454437 27670 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:40:32.458765 27670 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:40:32.458887 27670 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:40:32.458987 27670 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.240.195
I20260808 04:40:32.464922 27670 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.240.212:36203
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786164000593138-21443-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786164000593138-21443-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.195.keytab
--principal=kudu/127.20.240.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.240.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786164000593138-21443-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.240.195
--webserver_port=0
--tserver_master_addrs=127.20.240.254:39251
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27670
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.240.195
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786164000593138-21443-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 04:05:18 UTC on ccycloud.quasar-drfdgt.root.comops.site
build id 4574101
I20260808 04:40:32.466203 27670 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:40:32.467298 27670 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:40:32.477620 27676 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:40:32.477674 27670 server_base.cc:1034] running on GCE node
W20260808 04:40:32.477620 27675 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:40:32.477620 27678 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:40:32.478354 27670 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:40:32.479118 27670 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:40:32.480334 27670 hybrid_clock.cc:648] HybridClock initialized: now 1786164032480310 us; error 33 us; skew 500 ppm
Aug 08 04:40:32 dist-test-slave-vxj2 krb5kdc[27273](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164032, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.240.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:40:32.483562 27670 init.cc:377] Logged in from keytab as kudu/127.20.240.195@KRBTEST.COM (short username kudu)
I20260808 04:40:32.484586 27670 webserver.cc:460] Webserver started at http://127.20.240.195:39353/ using document root <none> and password file <none>
I20260808 04:40:32.485232 27670 fs_manager.cc:359] Metadata directory not provided
I20260808 04:40:32.485303 27670 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:40:32.485488 27670 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 04:40:32.487677 27670 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786164000593138-21443-0/minicluster-data/ts-2/data/instance:
uuid: "5c2494426819402ea49c524ea5cfb83f"
format_stamp: "Formatted at 2026-08-08 04:40:32 on dist-test-slave-vxj2"
server_key: "e7b143f201d996df1ef459a09f20de70"
server_key_iv: "977a662beee73b44880487e132c92ea9"
server_key_version: "encryptionkey@0"
I20260808 04:40:32.488302 27670 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786164000593138-21443-0/minicluster-data/ts-2/wal/instance:
uuid: "5c2494426819402ea49c524ea5cfb83f"
format_stamp: "Formatted at 2026-08-08 04:40:32 on dist-test-slave-vxj2"
server_key: "e7b143f201d996df1ef459a09f20de70"
server_key_iv: "977a662beee73b44880487e132c92ea9"
server_key_version: "encryptionkey@0"
I20260808 04:40:32.492399 27670 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.005s
I20260808 04:40:32.495116 27686 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:32.496435 27670 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 04:40:32.496604 27670 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786164000593138-21443-0/minicluster-data/ts-2/data,/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786164000593138-21443-0/minicluster-data/ts-2/wal
uuid: "5c2494426819402ea49c524ea5cfb83f"
format_stamp: "Formatted at 2026-08-08 04:40:32 on dist-test-slave-vxj2"
server_key: "e7b143f201d996df1ef459a09f20de70"
server_key_iv: "977a662beee73b44880487e132c92ea9"
server_key_version: "encryptionkey@0"
I20260808 04:40:32.496729 27670 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786164000593138-21443-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786164000593138-21443-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786164000593138-21443-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:40:32.527215 27670 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:40:32.530740 27670 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:40:32.531031 27670 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:40:32.531728 27670 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 04:40:32.532693 27670 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 04:40:32.532743 27670 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:32.532785 27670 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 04:40:32.532800 27670 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:32.542733 27670 rpc_server.cc:307] RPC server started. Bound to: 127.20.240.195:40149
I20260808 04:40:32.542770 27808 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.240.195:40149 every 8 connection(s)
I20260808 04:40:32.543704 27670 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786164000593138-21443-0/minicluster-data/ts-2/data/info.pb
I20260808 04:40:32.544514 21443 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu as pid 27670
I20260808 04:40:32.544667 21443 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786164000593138-21443-0/minicluster-data/ts-2/wal/instance
I20260808 04:40:32.545050 21443 external_mini_cluster.cc:1428] Setting key cd9b69d82bf3bcf534de738ab50af45a
Aug 08 04:40:32 dist-test-slave-vxj2 krb5kdc[27273](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164032, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.240.195@KRBTEST.COM for kudu/127.20.240.254@KRBTEST.COM
I20260808 04:40:32.559473 27363 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:32.545950 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.240.195:54037 (local address 127.20.240.254:39251)
0808 04:40:32.546105 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:32.546113 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:32.547219 (+ 1106us) server_negotiation.cc:407] Connection header received
0808 04:40:32.548608 (+ 1389us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:32.548611 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:32.548669 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:32.548751 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:32.550088 (+ 1337us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:32.550664 (+ 576us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:32.551934 (+ 1270us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:32.552211 (+ 277us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:32.552340 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:32.555161 (+ 2821us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:40:32.555165 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:40:32.555168 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:40:32.555205 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:40:32.556792 (+ 1587us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:32.557479 (+ 687us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:32.557483 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:32.557485 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:32.557577 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:32.558048 (+ 471us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:32.558051 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:32.558053 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:32.558276 (+ 223us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:40:32.558403 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:32.559146 (+ 743us) server_negotiation.cc:299] Negotiation successful
0808 04:40:32.559299 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260808 04:40:32.560400 27811 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:32.546508 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:39251 (local address 127.20.240.195:54037)
0808 04:40:32.547073 (+ 565us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:32.547118 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:32.548402 (+ 1284us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:32.548933 (+ 531us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:32.548941 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:32.549410 (+ 469us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:40:32.549936 (+ 526us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:32.549950 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:32.550811 (+ 861us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:32.550814 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:32.551776 (+ 962us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:32.551787 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:32.552384 (+ 597us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:32.552389 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:32.552571 (+ 182us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:32.553282 (+ 711us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:40:32.553299 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:40:32.554968 (+ 1669us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:40:32.556949 (+ 1981us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:32.556956 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:32.556978 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:32.557372 (+ 394us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:32.557739 (+ 367us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:32.557741 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:32.557742 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:32.557935 (+ 193us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:32.558418 (+ 483us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:40:32.558424 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:40:32.558846 (+ 422us) client_negotiation.cc:769] Sending connection context
0808 04:40:32.559047 (+ 201us) client_negotiation.cc:240] Negotiation successful
0808 04:40:32.559454 (+ 407us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":367,"thread_start_us":167,"threads_started":1}
I20260808 04:40:32.561714 27809 heartbeater.cc:347] Connected to a master server at 127.20.240.254:39251
I20260808 04:40:32.562006 27809 heartbeater.cc:464] Registering TS with master...
I20260808 04:40:32.562507 27809 heartbeater.cc:511] Master 127.20.240.254:39251 requested a full tablet report, sending...
I20260808 04:40:32.563621 27322 ts_manager.cc:194] Registered new tserver with Master: 5c2494426819402ea49c524ea5cfb83f (127.20.240.195:40149)
I20260808 04:40:32.564350 27322 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.240.195@KRBTEST.COM'} at 127.20.240.195:54037
I20260808 04:40:32.572186 21443 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal test-admin with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786164000593138-21443-0/krb5kdc/test-admin.keytab.
Entry for principal test-admin with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786164000593138-21443-0/krb5kdc/test-admin.keytab.
Aug 08 04:40:32 dist-test-slave-vxj2 krb5kdc[27273](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164032, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:40:32.590445 21443 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
W20260808 04:40:32.593633 27816 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 04:40:32.592019 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34692 (local address 127.20.240.193:45239)
0808 04:40:32.592426 (+ 407us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:32.592433 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:32.592455 (+ 22us) server_negotiation.cc:407] Connection header received
0808 04:40:32.592504 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:32.592509 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:32.592701 (+ 192us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:32.592898 (+ 197us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:32.593460 (+ 562us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:34692: BlockingRecv error: recv got EOF from 127.0.0.1:34692 (error 108)
Metrics: {"server-negotiator.queue_time_us":288,"thread_start_us":130,"threads_started":1}
W20260808 04:40:32.593827 21443 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786164000593138-21443-0/krb5kdc/krb5cc' of type FILE
Aug 08 04:40:32 dist-test-slave-vxj2 krb5kdc[27273](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164032, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:40:32.595058 21443 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 08 04:40:32 dist-test-slave-vxj2 krb5kdc[27273](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164032, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:40:32.596135 21443 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 08 04:40:32 dist-test-slave-vxj2 krb5kdc[27273](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164032, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.240.193@KRBTEST.COM
I20260808 04:40:32.607453 27816 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:32.597262 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34706 (local address 127.20.240.193:45239)
0808 04:40:32.597402 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:32.597408 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:32.597510 (+ 102us) server_negotiation.cc:407] Connection header received
0808 04:40:32.597686 (+ 176us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:32.597689 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:32.597743 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:32.597836 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:32.598474 (+ 638us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:32.599254 (+ 780us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:32.600295 (+ 1041us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:32.600764 (+ 469us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:32.600963 (+ 199us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:32.603734 (+ 2771us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:40:32.603747 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:40:32.603762 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:40:32.603790 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:40:32.605636 (+ 1846us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:32.606084 (+ 448us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:32.606091 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:32.606093 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:32.606196 (+ 103us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:32.606438 (+ 242us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:32.606440 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:32.606441 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:32.606715 (+ 274us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:40:32.606922 (+ 207us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:32.607059 (+ 137us) server_negotiation.cc:299] Negotiation successful
0808 04:40:32.607237 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
W20260808 04:40:32.611550 27816 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 04:40:32.610607 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34716 (local address 127.20.240.193:45239)
0808 04:40:32.610746 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:32.610749 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:32.610794 (+ 45us) server_negotiation.cc:407] Connection header received
0808 04:40:32.610900 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:32.610902 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:32.610940 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:32.611006 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:32.611452 (+ 446us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:34716: BlockingRecv error: recv got EOF from 127.0.0.1:34716 (error 108)
Metrics: {"server-negotiator.queue_time_us":57}
W20260808 04:40:32.611651 21443 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786164000593138-21443-0/krb5kdc/krb5cc' of type FILE
Aug 08 04:40:32 dist-test-slave-vxj2 krb5kdc[27273](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164032, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:40:32.612776 21443 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 08 04:40:32 dist-test-slave-vxj2 krb5kdc[27273](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164032, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:40:32.613788 21443 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 08 04:40:32 dist-test-slave-vxj2 krb5kdc[27273](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164032, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.240.193@KRBTEST.COM
I20260808 04:40:32.623720 27816 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:32.614788 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34730 (local address 127.20.240.193:45239)
0808 04:40:32.614947 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:32.614951 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:32.614977 (+ 26us) server_negotiation.cc:407] Connection header received
0808 04:40:32.615096 (+ 119us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:32.615099 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:32.615140 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:32.615212 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:32.615754 (+ 542us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:32.616329 (+ 575us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:32.617230 (+ 901us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:32.617478 (+ 248us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:32.617566 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:32.620179 (+ 2613us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:40:32.620185 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:40:32.620187 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:40:32.620217 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:40:32.621955 (+ 1738us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:32.622469 (+ 514us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:32.622473 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:32.622474 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:32.622566 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:32.622889 (+ 323us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:32.622893 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:32.622894 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:32.623101 (+ 207us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:40:32.623247 (+ 146us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:32.623480 (+ 233us) server_negotiation.cc:299] Negotiation successful
0808 04:40:32.623595 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
W20260808 04:40:32.627357 27816 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 04:40:32.625937 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34736 (local address 127.20.240.193:45239)
0808 04:40:32.626112 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:32.626117 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:32.626226 (+ 109us) server_negotiation.cc:407] Connection header received
0808 04:40:32.626420 (+ 194us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:32.626423 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:32.626476 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:32.626564 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:32.627208 (+ 644us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:34736: BlockingRecv error: recv got EOF from 127.0.0.1:34736 (error 108)
Metrics: {"server-negotiator.queue_time_us":73}
W20260808 04:40:32.627568 21443 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786164000593138-21443-0/krb5kdc/krb5cc' of type FILE
Aug 08 04:40:32 dist-test-slave-vxj2 krb5kdc[27273](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164032, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:40:32.628746 21443 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 08 04:40:32 dist-test-slave-vxj2 krb5kdc[27273](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164032, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:40:32.629769 21443 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 08 04:40:32 dist-test-slave-vxj2 krb5kdc[27273](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164032, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.240.193@KRBTEST.COM
I20260808 04:40:32.639227 27816 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:32.630733 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34738 (local address 127.20.240.193:45239)
0808 04:40:32.630898 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:32.630901 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:32.630916 (+ 15us) server_negotiation.cc:407] Connection header received
0808 04:40:32.631015 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:32.631017 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:32.631058 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:32.631133 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:32.631688 (+ 555us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:32.632211 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:32.633048 (+ 837us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:32.633369 (+ 321us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:32.633457 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:32.636025 (+ 2568us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:40:32.636028 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:40:32.636030 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:40:32.636058 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:40:32.637663 (+ 1605us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:32.638063 (+ 400us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:32.638066 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:32.638068 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:32.638143 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:32.638371 (+ 228us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:32.638373 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:32.638374 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:32.638542 (+ 168us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:40:32.638662 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:32.638902 (+ 240us) server_negotiation.cc:299] Negotiation successful
0808 04:40:32.639023 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":96}
I20260808 04:40:32.640688 21443 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu with pid 27387
I20260808 04:40:32.650521 21443 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu with pid 27529
I20260808 04:40:32.657711 21443 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu with pid 27670
I20260808 04:40:32.667178 21443 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu with pid 27288
2026-08-08T04:40:32Z chronyd exiting
[ OK ] SecurityITest.TestCorruptKerberosCC (2396 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipalMultipleMaster
Loading random data
Initializing database '/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164000593138-21443-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 04:40:32 dist-test-slave-vxj2 krb5kdc[27829](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 04:40:32 dist-test-slave-vxj2 krb5kdc[27829](info): set up 2 sockets
Aug 08 04:40:32 dist-test-slave-vxj2 krb5kdc[27829](info): commencing operation
krb5kdc: starting...
W20260808 04:40:33.780637 21443 mini_kdc.cc:121] Time spent starting KDC: real 1.088s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164000593138-21443-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164000593138-21443-0/krb5kdc/test-user.keytab.
Aug 08 04:40:33 dist-test-slave-vxj2 krb5kdc[27829](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164033, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T04:40:33Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T04:40:33Z Disabled control of system clock
WARNING: no policy specified for oryx/127.20.240.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.20.240.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.20.240.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164000593138-21443-0/krb5kdc/oryx_127.20.240.254.keytab.
Entry for principal oryx/127.20.240.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164000593138-21443-0/krb5kdc/oryx_127.20.240.254.keytab.
I20260808 04:40:33.913309 21443 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
/tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164000593138-21443-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164000593138-21443-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164000593138-21443-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164000593138-21443-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.240.254:33559
--webserver_interface=127.20.240.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164000593138-21443-0/krb5kdc/oryx_127.20.240.254.keytab
--principal=oryx/127.20.240.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.240.212:39295
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.240.254:33559
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164000593138-21443-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164000593138-21443-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164000593138-21443-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 04:40:34.028587 27844 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:40:34.028892 27844 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:40:34.028944 27844 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:40:34.033089 27844 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 04:40:34.033195 27844 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:40:34.033215 27844 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:40:34.033232 27844 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 04:40:34.033248 27844 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 04:40:34.038862 27844 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.240.212:39295
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164000593138-21443-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164000593138-21443-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.240.254:33559
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164000593138-21443-0/krb5kdc/oryx_127.20.240.254.keytab
--principal=oryx/127.20.240.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.240.254:33559
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164000593138-21443-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.240.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27844
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164000593138-21443-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 04:05:18 UTC on ccycloud.quasar-drfdgt.root.comops.site
build id 4574101
I20260808 04:40:34.040042 27844 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:40:34.041121 27844 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:40:34.050266 27853 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:40:34.050254 27850 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:40:34.050535 27844 server_base.cc:1034] running on GCE node
W20260808 04:40:34.050254 27851 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:40:34.051522 27844 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:40:34.052830 27844 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:40:34.054047 27844 hybrid_clock.cc:648] HybridClock initialized: now 1786164034054005 us; error 55 us; skew 500 ppm
Aug 08 04:40:34 dist-test-slave-vxj2 krb5kdc[27829](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164034, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.240.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:40:34.057607 27844 init.cc:377] Logged in from keytab as oryx/127.20.240.254@KRBTEST.COM (short username oryx)
I20260808 04:40:34.058779 27844 webserver.cc:460] Webserver started at http://127.20.240.254:35409/ using document root <none> and password file <none>
I20260808 04:40:34.059435 27844 fs_manager.cc:359] Metadata directory not provided
I20260808 04:40:34.059505 27844 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:40:34.059751 27844 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 04:40:34.062119 27844 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164000593138-21443-0/minicluster-data/master-0/data/instance:
uuid: "2a361414698e49a880ae63c23c2991be"
format_stamp: "Formatted at 2026-08-08 04:40:34 on dist-test-slave-vxj2"
server_key: "d1a09cbd21200e5a3796b26f7b11a5b9"
server_key_iv: "db18d23307f871e86159d8fe21ab3134"
server_key_version: "encryptionkey@0"
I20260808 04:40:34.062762 27844 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164000593138-21443-0/minicluster-data/master-0/wal/instance:
uuid: "2a361414698e49a880ae63c23c2991be"
format_stamp: "Formatted at 2026-08-08 04:40:34 on dist-test-slave-vxj2"
server_key: "d1a09cbd21200e5a3796b26f7b11a5b9"
server_key_iv: "db18d23307f871e86159d8fe21ab3134"
server_key_version: "encryptionkey@0"
I20260808 04:40:34.067103 27844 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260808 04:40:34.070029 27860 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:34.071513 27844 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260808 04:40:34.071784 27844 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164000593138-21443-0/minicluster-data/master-0/data,/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164000593138-21443-0/minicluster-data/master-0/wal
uuid: "2a361414698e49a880ae63c23c2991be"
format_stamp: "Formatted at 2026-08-08 04:40:34 on dist-test-slave-vxj2"
server_key: "d1a09cbd21200e5a3796b26f7b11a5b9"
server_key_iv: "db18d23307f871e86159d8fe21ab3134"
server_key_version: "encryptionkey@0"
I20260808 04:40:34.071921 27844 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164000593138-21443-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164000593138-21443-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164000593138-21443-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:40:34.082594 27844 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:40:34.085973 27844 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:40:34.086202 27844 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:40:34.093824 27844 rpc_server.cc:307] RPC server started. Bound to: 127.20.240.254:33559
I20260808 04:40:34.094146 27913 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.240.254:33559 every 8 connection(s)
I20260808 04:40:34.094901 27844 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164000593138-21443-0/minicluster-data/master-0/data/info.pb
I20260808 04:40:34.097790 27914 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:40:34.100649 21443 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu as pid 27844
I20260808 04:40:34.100850 21443 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164000593138-21443-0/minicluster-data/master-0/wal/instance
I20260808 04:40:34.101212 21443 external_mini_cluster.cc:1428] Setting key fb8ab6970b0a24701dbc9845513b8f93
I20260808 04:40:34.104456 27914 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2a361414698e49a880ae63c23c2991be: Bootstrap starting.
I20260808 04:40:34.107314 27914 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2a361414698e49a880ae63c23c2991be: Neither blocks nor log segments found. Creating new log.
I20260808 04:40:34.108268 27914 log.cc:824] T 00000000000000000000000000000000 P 2a361414698e49a880ae63c23c2991be: Log is configured to *not* fsync() on all Append() calls
I20260808 04:40:34.110574 27914 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2a361414698e49a880ae63c23c2991be: No bootstrap required, opened a new log
Aug 08 04:40:34 dist-test-slave-vxj2 krb5kdc[27829](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164033, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.20.240.254@KRBTEST.COM
I20260808 04:40:34.114573 27914 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2a361414698e49a880ae63c23c2991be [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2a361414698e49a880ae63c23c2991be" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 33559 } }
I20260808 04:40:34.114840 27914 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2a361414698e49a880ae63c23c2991be [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:40:34.114926 27914 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2a361414698e49a880ae63c23c2991be [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2a361414698e49a880ae63c23c2991be, State: Initialized, Role: FOLLOWER
I20260808 04:40:34.115458 27914 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2a361414698e49a880ae63c23c2991be [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2a361414698e49a880ae63c23c2991be" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 33559 } }
I20260808 04:40:34.115628 27914 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2a361414698e49a880ae63c23c2991be [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 04:40:34.115715 27914 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2a361414698e49a880ae63c23c2991be [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 04:40:34.115844 27914 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2a361414698e49a880ae63c23c2991be [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:40:34.117117 27914 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2a361414698e49a880ae63c23c2991be [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2a361414698e49a880ae63c23c2991be" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 33559 } }
I20260808 04:40:34.117509 27914 leader_election.cc:302] T 00000000000000000000000000000000 P 2a361414698e49a880ae63c23c2991be [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2a361414698e49a880ae63c23c2991be; no voters:
I20260808 04:40:34.117849 27914 leader_election.cc:288] T 00000000000000000000000000000000 P 2a361414698e49a880ae63c23c2991be [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 04:40:34.118012 27917 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:34.102793 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39154 (local address 127.20.240.254:33559)
0808 04:40:34.103296 (+ 503us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:34.103314 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:34.103356 (+ 42us) server_negotiation.cc:407] Connection header received
0808 04:40:34.104144 (+ 788us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:34.104166 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:34.104562 (+ 396us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:34.104940 (+ 378us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:34.105976 (+ 1036us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:34.107090 (+ 1114us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:34.108317 (+ 1227us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:34.108930 (+ 613us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:34.109125 (+ 195us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:34.112081 (+ 2956us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:40:34.112087 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:40:34.112102 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:40:34.112133 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:40:34.114001 (+ 1868us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:34.114484 (+ 483us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:34.114491 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:34.114497 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:34.114611 (+ 114us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:34.115071 (+ 460us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:34.115075 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:34.115077 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:34.115592 (+ 515us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:40:34.116460 (+ 868us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:34.116635 (+ 175us) server_negotiation.cc:299] Negotiation successful
0808 04:40:34.116971 (+ 336us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":324,"thread_start_us":155,"threads_started":1}
I20260808 04:40:34.118043 27919 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2a361414698e49a880ae63c23c2991be [term 1 FOLLOWER]: Leader election won for term 1
I20260808 04:40:34.118991 27914 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2a361414698e49a880ae63c23c2991be [sys.catalog]: configured and running, proceeding with master startup.
I20260808 04:40:34.119428 27919 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2a361414698e49a880ae63c23c2991be [term 1 LEADER]: Becoming Leader. State: Replica: 2a361414698e49a880ae63c23c2991be, State: Running, Role: LEADER
I20260808 04:40:34.119801 27919 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2a361414698e49a880ae63c23c2991be [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2a361414698e49a880ae63c23c2991be" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 33559 } }
I20260808 04:40:34.121223 27919 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2a361414698e49a880ae63c23c2991be [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2a361414698e49a880ae63c23c2991be. Latest consensus state: current_term: 1 leader_uuid: "2a361414698e49a880ae63c23c2991be" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2a361414698e49a880ae63c23c2991be" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 33559 } } }
I20260808 04:40:34.121374 27919 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2a361414698e49a880ae63c23c2991be [sys.catalog]: This master's current role is: LEADER
I20260808 04:40:34.121603 27920 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2a361414698e49a880ae63c23c2991be [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2a361414698e49a880ae63c23c2991be" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2a361414698e49a880ae63c23c2991be" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 33559 } } }
I20260808 04:40:34.121809 27920 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2a361414698e49a880ae63c23c2991be [sys.catalog]: This master's current role is: LEADER
W20260808 04:40:34.124636 27934 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 2a361414698e49a880ae63c23c2991be: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 04:40:34.124725 27934 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 04:40:34.124825 27935 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 04:40:34.125788 27935 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 04:40:34.132025 27935 catalog_manager.cc:1347] Generated new cluster ID: b59e5a78215d4b33b7d72afd96aa3b8f
I20260808 04:40:34.132110 27935 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 04:40:34.146059 27935 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 04:40:34.147444 27935 catalog_manager.cc:1504] Loading token signing keys...
I20260808 04:40:34.157516 27935 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2a361414698e49a880ae63c23c2991be: Generated new TSK 0
I20260808 04:40:34.158278 27935 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.20.240.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.20.240.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.20.240.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164000593138-21443-0/krb5kdc/oryx_127.20.240.193.keytab.
Entry for principal oryx/127.20.240.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164000593138-21443-0/krb5kdc/oryx_127.20.240.193.keytab.
I20260808 04:40:34.201512 21443 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
/tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164000593138-21443-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164000593138-21443-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164000593138-21443-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164000593138-21443-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.240.193:0
--local_ip_for_outbound_sockets=127.20.240.193
--webserver_interface=127.20.240.193
--webserver_port=0
--tserver_master_addrs=127.20.240.254:33559
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164000593138-21443-0/krb5kdc/oryx_127.20.240.193.keytab
--principal=oryx/127.20.240.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.240.212:39295
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164000593138-21443-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164000593138-21443-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164000593138-21443-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 04:40:34.336337 27941 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:40:34.336644 27941 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:40:34.336694 27941 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:40:34.341017 27941 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:40:34.341089 27941 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:40:34.341214 27941 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.240.193
I20260808 04:40:34.346794 27941 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.240.212:39295
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164000593138-21443-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164000593138-21443-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164000593138-21443-0/krb5kdc/oryx_127.20.240.193.keytab
--principal=oryx/127.20.240.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.240.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164000593138-21443-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.240.193
--webserver_port=0
--tserver_master_addrs=127.20.240.254:33559
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27941
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.240.193
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164000593138-21443-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 04:05:18 UTC on ccycloud.quasar-drfdgt.root.comops.site
build id 4574101
I20260808 04:40:34.347882 27941 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:40:34.348891 27941 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:40:34.359135 27949 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:40:34.359072 27947 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:40:34.359241 27941 server_base.cc:1034] running on GCE node
W20260808 04:40:34.359078 27946 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:40:34.359833 27941 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:40:34.360548 27941 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:40:34.361735 27941 hybrid_clock.cc:648] HybridClock initialized: now 1786164034361721 us; error 27 us; skew 500 ppm
Aug 08 04:40:34 dist-test-slave-vxj2 krb5kdc[27829](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164034, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.240.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:40:34.364549 27941 init.cc:377] Logged in from keytab as oryx/127.20.240.193@KRBTEST.COM (short username oryx)
I20260808 04:40:34.365502 27941 webserver.cc:460] Webserver started at http://127.20.240.193:35149/ using document root <none> and password file <none>
I20260808 04:40:34.366075 27941 fs_manager.cc:359] Metadata directory not provided
I20260808 04:40:34.366165 27941 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:40:34.366416 27941 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 04:40:34.368512 27941 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164000593138-21443-0/minicluster-data/ts-0/data/instance:
uuid: "13451d5e45d9432c9a40de3584233526"
format_stamp: "Formatted at 2026-08-08 04:40:34 on dist-test-slave-vxj2"
server_key: "fd7b2fb11f0fb3c6eed81ba1b2a7a7cf"
server_key_iv: "97d5970936ed7610db16e87b529a45d2"
server_key_version: "encryptionkey@0"
I20260808 04:40:34.369112 27941 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164000593138-21443-0/minicluster-data/ts-0/wal/instance:
uuid: "13451d5e45d9432c9a40de3584233526"
format_stamp: "Formatted at 2026-08-08 04:40:34 on dist-test-slave-vxj2"
server_key: "fd7b2fb11f0fb3c6eed81ba1b2a7a7cf"
server_key_iv: "97d5970936ed7610db16e87b529a45d2"
server_key_version: "encryptionkey@0"
I20260808 04:40:34.372892 27941 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260808 04:40:34.375422 27956 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:34.376763 27941 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 04:40:34.376895 27941 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164000593138-21443-0/minicluster-data/ts-0/data,/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164000593138-21443-0/minicluster-data/ts-0/wal
uuid: "13451d5e45d9432c9a40de3584233526"
format_stamp: "Formatted at 2026-08-08 04:40:34 on dist-test-slave-vxj2"
server_key: "fd7b2fb11f0fb3c6eed81ba1b2a7a7cf"
server_key_iv: "97d5970936ed7610db16e87b529a45d2"
server_key_version: "encryptionkey@0"
I20260808 04:40:34.377015 27941 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164000593138-21443-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164000593138-21443-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164000593138-21443-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:40:34.396636 27941 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:40:34.400187 27941 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:40:34.400429 27941 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:40:34.401223 27941 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 04:40:34.402199 27941 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 04:40:34.402249 27941 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:34.402292 27941 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 04:40:34.402307 27941 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:34.411466 27941 rpc_server.cc:307] RPC server started. Bound to: 127.20.240.193:41911
I20260808 04:40:34.411485 28076 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.240.193:41911 every 8 connection(s)
I20260808 04:40:34.412400 27941 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164000593138-21443-0/minicluster-data/ts-0/data/info.pb
I20260808 04:40:34.419994 21443 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu as pid 27941
I20260808 04:40:34.420141 21443 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164000593138-21443-0/minicluster-data/ts-0/wal/instance
I20260808 04:40:34.420524 21443 external_mini_cluster.cc:1428] Setting key d751059b352599ecc4f2318b988d8de5
Aug 08 04:40:34 dist-test-slave-vxj2 krb5kdc[27829](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164034, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.240.193@KRBTEST.COM for oryx/127.20.240.254@KRBTEST.COM
I20260808 04:40:34.427402 27917 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:34.414338 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.240.193:48975 (local address 127.20.240.254:33559)
0808 04:40:34.414497 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:34.414501 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:34.415290 (+ 789us) server_negotiation.cc:407] Connection header received
0808 04:40:34.416714 (+ 1424us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:34.416717 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:34.416766 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:34.416842 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:34.418197 (+ 1355us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:34.418780 (+ 583us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:34.420463 (+ 1683us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:34.420783 (+ 320us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:34.420866 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:34.423727 (+ 2861us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:40:34.423730 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:40:34.423732 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:40:34.423757 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:40:34.425296 (+ 1539us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:34.425822 (+ 526us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:34.425827 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:34.425829 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:34.425920 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:34.426273 (+ 353us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:34.426277 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:34.426279 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:34.426484 (+ 205us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:40:34.426595 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:34.427099 (+ 504us) server_negotiation.cc:299] Negotiation successful
0808 04:40:34.427235 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260808 04:40:34.428238 28079 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:34.414612 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:33559 (local address 127.20.240.193:48975)
0808 04:40:34.415113 (+ 501us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:34.415159 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:34.416512 (+ 1353us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:34.417034 (+ 522us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:34.417041 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:34.417534 (+ 493us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:40:34.418041 (+ 507us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:34.418056 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:34.418917 (+ 861us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:34.418920 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:34.420335 (+ 1415us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:34.420349 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:34.420959 (+ 610us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:34.420964 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:34.421217 (+ 253us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:34.421848 (+ 631us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:40:34.421871 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:40:34.423551 (+ 1680us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:40:34.425423 (+ 1872us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:34.425429 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:34.425446 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:34.425713 (+ 267us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:34.426015 (+ 302us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:34.426018 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:34.426020 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:34.426175 (+ 155us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:34.426593 (+ 418us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:40:34.426600 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:40:34.426859 (+ 259us) client_negotiation.cc:769] Sending connection context
0808 04:40:34.427058 (+ 199us) client_negotiation.cc:240] Negotiation successful
0808 04:40:34.427398 (+ 340us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":300,"thread_start_us":108,"threads_started":1}
I20260808 04:40:34.429569 28077 heartbeater.cc:347] Connected to a master server at 127.20.240.254:33559
I20260808 04:40:34.429829 28077 heartbeater.cc:464] Registering TS with master...
I20260808 04:40:34.430339 28077 heartbeater.cc:511] Master 127.20.240.254:33559 requested a full tablet report, sending...
WARNING: no policy specified for oryx/127.20.240.194@KRBTEST.COM; defaulting to no policy
I20260808 04:40:34.431851 27877 ts_manager.cc:194] Registered new tserver with Master: 13451d5e45d9432c9a40de3584233526 (127.20.240.193:41911)
I20260808 04:40:34.433015 27877 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.20.240.193@KRBTEST.COM'} at 127.20.240.193:48975
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.20.240.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.20.240.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164000593138-21443-0/krb5kdc/oryx_127.20.240.194.keytab.
Entry for principal oryx/127.20.240.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164000593138-21443-0/krb5kdc/oryx_127.20.240.194.keytab.
I20260808 04:40:34.452512 21443 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
/tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164000593138-21443-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164000593138-21443-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164000593138-21443-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164000593138-21443-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.240.194:0
--local_ip_for_outbound_sockets=127.20.240.194
--webserver_interface=127.20.240.194
--webserver_port=0
--tserver_master_addrs=127.20.240.254:33559
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164000593138-21443-0/krb5kdc/oryx_127.20.240.194.keytab
--principal=oryx/127.20.240.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.240.212:39295
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164000593138-21443-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164000593138-21443-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164000593138-21443-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 04:40:34.564942 28082 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:40:34.565238 28082 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:40:34.565291 28082 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:40:34.569646 28082 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:40:34.569710 28082 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:40:34.569805 28082 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.240.194
I20260808 04:40:34.575234 28082 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.240.212:39295
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164000593138-21443-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164000593138-21443-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164000593138-21443-0/krb5kdc/oryx_127.20.240.194.keytab
--principal=oryx/127.20.240.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.240.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164000593138-21443-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.240.194
--webserver_port=0
--tserver_master_addrs=127.20.240.254:33559
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28082
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.240.194
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164000593138-21443-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 04:05:18 UTC on ccycloud.quasar-drfdgt.root.comops.site
build id 4574101
I20260808 04:40:34.576514 28082 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:40:34.577648 28082 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:40:34.588580 28090 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:40:34.588760 28082 server_base.cc:1034] running on GCE node
W20260808 04:40:34.588580 28087 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:40:34.588951 28088 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:40:34.589494 28082 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:40:34.590217 28082 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:40:34.591423 28082 hybrid_clock.cc:648] HybridClock initialized: now 1786164034591404 us; error 31 us; skew 500 ppm
Aug 08 04:40:34 dist-test-slave-vxj2 krb5kdc[27829](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164034, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.240.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:40:34.594314 28082 init.cc:377] Logged in from keytab as oryx/127.20.240.194@KRBTEST.COM (short username oryx)
I20260808 04:40:34.595280 28082 webserver.cc:460] Webserver started at http://127.20.240.194:34987/ using document root <none> and password file <none>
I20260808 04:40:34.595871 28082 fs_manager.cc:359] Metadata directory not provided
I20260808 04:40:34.595966 28082 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:40:34.596203 28082 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 04:40:34.598430 28082 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164000593138-21443-0/minicluster-data/ts-1/data/instance:
uuid: "6135fa034b434540bf65da8cedaf4de2"
format_stamp: "Formatted at 2026-08-08 04:40:34 on dist-test-slave-vxj2"
server_key: "05db60b0554c06893040f455c3b8ccaf"
server_key_iv: "f0af44339c50f4e91799aa245fd0b526"
server_key_version: "encryptionkey@0"
I20260808 04:40:34.599107 28082 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164000593138-21443-0/minicluster-data/ts-1/wal/instance:
uuid: "6135fa034b434540bf65da8cedaf4de2"
format_stamp: "Formatted at 2026-08-08 04:40:34 on dist-test-slave-vxj2"
server_key: "05db60b0554c06893040f455c3b8ccaf"
server_key_iv: "f0af44339c50f4e91799aa245fd0b526"
server_key_version: "encryptionkey@0"
I20260808 04:40:34.603076 28082 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260808 04:40:34.605795 28098 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:34.607151 28082 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 04:40:34.607338 28082 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164000593138-21443-0/minicluster-data/ts-1/data,/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164000593138-21443-0/minicluster-data/ts-1/wal
uuid: "6135fa034b434540bf65da8cedaf4de2"
format_stamp: "Formatted at 2026-08-08 04:40:34 on dist-test-slave-vxj2"
server_key: "05db60b0554c06893040f455c3b8ccaf"
server_key_iv: "f0af44339c50f4e91799aa245fd0b526"
server_key_version: "encryptionkey@0"
I20260808 04:40:34.607470 28082 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164000593138-21443-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164000593138-21443-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164000593138-21443-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:40:34.618854 28082 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:40:34.622380 28082 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:40:34.622594 28082 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:40:34.623214 28082 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 04:40:34.624076 28082 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 04:40:34.624152 28082 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:34.624230 28082 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 04:40:34.624289 28082 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:34.633309 28082 rpc_server.cc:307] RPC server started. Bound to: 127.20.240.194:44761
I20260808 04:40:34.633351 28217 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.240.194:44761 every 8 connection(s)
I20260808 04:40:34.634279 28082 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164000593138-21443-0/minicluster-data/ts-1/data/info.pb
I20260808 04:40:34.639761 21443 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu as pid 28082
I20260808 04:40:34.639977 21443 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164000593138-21443-0/minicluster-data/ts-1/wal/instance
I20260808 04:40:34.640273 21443 external_mini_cluster.cc:1428] Setting key 2ff14a9a7f662ca31a6ade7fe992e685
Aug 08 04:40:34 dist-test-slave-vxj2 krb5kdc[27829](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164034, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.240.194@KRBTEST.COM for oryx/127.20.240.254@KRBTEST.COM
I20260808 04:40:34.650460 27917 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:34.636372 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.240.194:44087 (local address 127.20.240.254:33559)
0808 04:40:34.636518 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:34.636522 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:34.637416 (+ 894us) server_negotiation.cc:407] Connection header received
0808 04:40:34.638802 (+ 1386us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:34.638806 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:34.638866 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:34.638996 (+ 130us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:34.640262 (+ 1266us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:34.640960 (+ 698us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:34.642627 (+ 1667us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:34.642846 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:34.642938 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:34.645841 (+ 2903us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:40:34.645847 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:40:34.645854 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:40:34.645896 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:40:34.647815 (+ 1919us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:34.648460 (+ 645us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:34.648465 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:34.648470 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:34.648577 (+ 107us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:34.649053 (+ 476us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:34.649056 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:34.649058 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:34.649372 (+ 314us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:40:34.649483 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:34.650097 (+ 614us) server_negotiation.cc:299] Negotiation successful
0808 04:40:34.650245 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
WARNING: no policy specified for oryx/127.20.240.195@KRBTEST.COM; defaulting to no policy
I20260808 04:40:34.651283 28221 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:34.636751 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:33559 (local address 127.20.240.194:44087)
0808 04:40:34.637273 (+ 522us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:34.637316 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:34.638591 (+ 1275us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:34.639166 (+ 575us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:34.639173 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:34.639556 (+ 383us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:40:34.640121 (+ 565us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:34.640137 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:34.641108 (+ 971us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:34.641110 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:34.642491 (+ 1381us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:34.642506 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:34.643032 (+ 526us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:34.643039 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:34.643277 (+ 238us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:34.643905 (+ 628us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:40:34.643923 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:40:34.645657 (+ 1734us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:40:34.647986 (+ 2329us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:34.647992 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:34.648006 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:34.648326 (+ 320us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:34.648714 (+ 388us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:34.648716 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:34.648718 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:34.648919 (+ 201us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:34.649497 (+ 578us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:40:34.649504 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:40:34.649760 (+ 256us) client_negotiation.cc:769] Sending connection context
0808 04:40:34.649978 (+ 218us) client_negotiation.cc:240] Negotiation successful
0808 04:40:34.650273 (+ 295us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":275,"thread_start_us":114,"threads_started":1}
I20260808 04:40:34.652593 28218 heartbeater.cc:347] Connected to a master server at 127.20.240.254:33559
I20260808 04:40:34.652846 28218 heartbeater.cc:464] Registering TS with master...
I20260808 04:40:34.653419 28218 heartbeater.cc:511] Master 127.20.240.254:33559 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.20.240.195@KRBTEST.COM" created.
I20260808 04:40:34.654631 27877 ts_manager.cc:194] Registered new tserver with Master: 6135fa034b434540bf65da8cedaf4de2 (127.20.240.194:44761)
I20260808 04:40:34.655511 27877 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.20.240.194@KRBTEST.COM'} at 127.20.240.194:44087
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.20.240.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164000593138-21443-0/krb5kdc/oryx_127.20.240.195.keytab.
Entry for principal oryx/127.20.240.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164000593138-21443-0/krb5kdc/oryx_127.20.240.195.keytab.
I20260808 04:40:34.672623 21443 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
/tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164000593138-21443-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164000593138-21443-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164000593138-21443-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164000593138-21443-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.240.195:0
--local_ip_for_outbound_sockets=127.20.240.195
--webserver_interface=127.20.240.195
--webserver_port=0
--tserver_master_addrs=127.20.240.254:33559
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164000593138-21443-0/krb5kdc/oryx_127.20.240.195.keytab
--principal=oryx/127.20.240.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.240.212:39295
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164000593138-21443-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164000593138-21443-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164000593138-21443-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 04:40:34.787236 28224 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:40:34.787578 28224 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:40:34.787676 28224 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:40:34.791878 28224 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:40:34.791989 28224 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:40:34.792084 28224 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.240.195
I20260808 04:40:34.797689 28224 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.240.212:39295
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164000593138-21443-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164000593138-21443-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164000593138-21443-0/krb5kdc/oryx_127.20.240.195.keytab
--principal=oryx/127.20.240.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.240.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164000593138-21443-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.240.195
--webserver_port=0
--tserver_master_addrs=127.20.240.254:33559
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28224
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.240.195
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164000593138-21443-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 04:05:18 UTC on ccycloud.quasar-drfdgt.root.comops.site
build id 4574101
I20260808 04:40:34.798810 28224 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:40:34.799844 28224 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260808 04:40:34.809909 28224 server_base.cc:1034] running on GCE node
W20260808 04:40:34.809847 28232 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:40:34.809894 28230 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:40:34.809850 28229 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:40:34.810591 28224 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:40:34.811239 28224 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:40:34.812433 28224 hybrid_clock.cc:648] HybridClock initialized: now 1786164034812374 us; error 72 us; skew 500 ppm
Aug 08 04:40:34 dist-test-slave-vxj2 krb5kdc[27829](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164034, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.240.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:40:34.815271 28224 init.cc:377] Logged in from keytab as oryx/127.20.240.195@KRBTEST.COM (short username oryx)
I20260808 04:40:34.816210 28224 webserver.cc:460] Webserver started at http://127.20.240.195:44127/ using document root <none> and password file <none>
I20260808 04:40:34.816740 28224 fs_manager.cc:359] Metadata directory not provided
I20260808 04:40:34.816799 28224 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:40:34.816969 28224 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 04:40:34.819119 28224 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164000593138-21443-0/minicluster-data/ts-2/data/instance:
uuid: "a19d6220e3f74533a788ce03b62f1944"
format_stamp: "Formatted at 2026-08-08 04:40:34 on dist-test-slave-vxj2"
server_key: "deaf53147962a24c387c185d3c5b1a40"
server_key_iv: "d32a29ba7a86c6cb215387fd2398b6b5"
server_key_version: "encryptionkey@0"
I20260808 04:40:34.819715 28224 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164000593138-21443-0/minicluster-data/ts-2/wal/instance:
uuid: "a19d6220e3f74533a788ce03b62f1944"
format_stamp: "Formatted at 2026-08-08 04:40:34 on dist-test-slave-vxj2"
server_key: "deaf53147962a24c387c185d3c5b1a40"
server_key_iv: "d32a29ba7a86c6cb215387fd2398b6b5"
server_key_version: "encryptionkey@0"
I20260808 04:40:34.823582 28224 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260808 04:40:34.825940 28240 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:34.827288 28224 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 04:40:34.827395 28224 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164000593138-21443-0/minicluster-data/ts-2/data,/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164000593138-21443-0/minicluster-data/ts-2/wal
uuid: "a19d6220e3f74533a788ce03b62f1944"
format_stamp: "Formatted at 2026-08-08 04:40:34 on dist-test-slave-vxj2"
server_key: "deaf53147962a24c387c185d3c5b1a40"
server_key_iv: "d32a29ba7a86c6cb215387fd2398b6b5"
server_key_version: "encryptionkey@0"
I20260808 04:40:34.827497 28224 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164000593138-21443-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164000593138-21443-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164000593138-21443-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:40:34.862918 28224 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:40:34.865988 28224 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:40:34.866150 28224 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:40:34.866721 28224 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 04:40:34.867525 28224 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 04:40:34.867573 28224 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:34.867614 28224 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 04:40:34.867628 28224 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:34.877462 28224 rpc_server.cc:307] RPC server started. Bound to: 127.20.240.195:45885
I20260808 04:40:34.877492 28360 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.240.195:45885 every 8 connection(s)
I20260808 04:40:34.878401 28224 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164000593138-21443-0/minicluster-data/ts-2/data/info.pb
I20260808 04:40:34.880023 21443 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu as pid 28224
I20260808 04:40:34.880168 21443 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164000593138-21443-0/minicluster-data/ts-2/wal/instance
I20260808 04:40:34.880511 21443 external_mini_cluster.cc:1428] Setting key f485793e53488866125632771671306a
Aug 08 04:40:34 dist-test-slave-vxj2 krb5kdc[27829](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164034, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.240.195@KRBTEST.COM for oryx/127.20.240.254@KRBTEST.COM
I20260808 04:40:34.893482 27917 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:34.880384 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.240.195:40641 (local address 127.20.240.254:33559)
0808 04:40:34.880555 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:34.880560 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:34.881639 (+ 1079us) server_negotiation.cc:407] Connection header received
0808 04:40:34.883547 (+ 1908us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:34.883549 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:34.883596 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:34.883666 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:34.884948 (+ 1282us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:34.885579 (+ 631us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:34.886879 (+ 1300us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:34.887123 (+ 244us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:34.887210 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:34.889879 (+ 2669us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:40:34.889883 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:40:34.889886 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:40:34.889933 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:40:34.891301 (+ 1368us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:34.891837 (+ 536us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:34.891840 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:34.891842 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:34.891935 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:34.892311 (+ 376us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:34.892314 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:34.892316 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:34.892517 (+ 201us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:40:34.892624 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:34.893175 (+ 551us) server_negotiation.cc:299] Negotiation successful
0808 04:40:34.893312 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260808 04:40:34.894527 28364 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:34.880861 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:33559 (local address 127.20.240.195:40641)
0808 04:40:34.881486 (+ 625us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:34.881549 (+ 63us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:34.883326 (+ 1777us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:34.883889 (+ 563us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:34.883897 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:34.884281 (+ 384us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:40:34.884793 (+ 512us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:34.884808 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:34.885700 (+ 892us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:34.885703 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:34.886736 (+ 1033us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:34.886747 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:34.887295 (+ 548us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:34.887299 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:34.887472 (+ 173us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:34.888072 (+ 600us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:40:34.888090 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:40:34.889697 (+ 1607us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:40:34.891428 (+ 1731us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:34.891434 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:34.891451 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:34.891725 (+ 274us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:34.892029 (+ 304us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:34.892033 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:34.892035 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:34.892211 (+ 176us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:34.892635 (+ 424us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:40:34.892643 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:40:34.892900 (+ 257us) client_negotiation.cc:769] Sending connection context
0808 04:40:34.893107 (+ 207us) client_negotiation.cc:240] Negotiation successful
0808 04:40:34.893491 (+ 384us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":359,"thread_start_us":193,"threads_started":1}
I20260808 04:40:34.895721 28362 heartbeater.cc:347] Connected to a master server at 127.20.240.254:33559
I20260808 04:40:34.895948 28362 heartbeater.cc:464] Registering TS with master...
I20260808 04:40:34.896428 28362 heartbeater.cc:511] Master 127.20.240.254:33559 requested a full tablet report, sending...
I20260808 04:40:34.897449 27877 ts_manager.cc:194] Registered new tserver with Master: a19d6220e3f74533a788ce03b62f1944 (127.20.240.195:45885)
I20260808 04:40:34.898051 27877 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.20.240.195@KRBTEST.COM'} at 127.20.240.195:40641
I20260808 04:40:34.907352 21443 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.20.240.253@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.20.240.253@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.20.240.253 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164000593138-21443-0/krb5kdc/oryx_127.20.240.253.keytab.
Entry for principal oryx/127.20.240.253 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164000593138-21443-0/krb5kdc/oryx_127.20.240.253.keytab.
I20260808 04:40:34.936631 21443 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
/tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164000593138-21443-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164000593138-21443-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164000593138-21443-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164000593138-21443-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.240.253:34575
--webserver_interface=127.20.240.253
--webserver_port=0
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164000593138-21443-0/krb5kdc/oryx_127.20.240.253.keytab
--principal=oryx/127.20.240.253
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.240.212:39295
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.240.254:33559,127.20.240.253:34575
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164000593138-21443-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164000593138-21443-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164000593138-21443-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 04:40:35.053506 28367 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:40:35.053809 28367 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:40:35.053853 28367 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:40:35.058005 28367 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 04:40:35.058089 28367 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:40:35.058109 28367 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:40:35.058128 28367 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 04:40:35.058144 28367 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 04:40:35.063769 28367 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.240.212:39295
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164000593138-21443-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164000593138-21443-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.20.240.254:33559,127.20.240.253:34575
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164000593138-21443-0/krb5kdc/oryx_127.20.240.253.keytab
--principal=oryx/127.20.240.253
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.240.253:34575
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164000593138-21443-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.20.240.253
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28367
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164000593138-21443-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 04:05:18 UTC on ccycloud.quasar-drfdgt.root.comops.site
build id 4574101
W20260808 04:40:35.064033 28367 master_options.cc:55] Only 2 masters are specified by master_addresses_flag ('127.20.240.254:33559,127.20.240.253:34575'), but minimum of 3 are required to tolerate failures of any one master. It is recommended to use at least 3 masters.
I20260808 04:40:35.064980 28367 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:40:35.066097 28367 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:40:35.074847 28375 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:40:35.074851 28372 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:40:35.074935 28373 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:40:35.075122 28367 server_base.cc:1034] running on GCE node
I20260808 04:40:35.075830 28367 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:40:35.077001 28367 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:40:35.078181 28367 hybrid_clock.cc:648] HybridClock initialized: now 1786164035078146 us; error 46 us; skew 500 ppm
Aug 08 04:40:35 dist-test-slave-vxj2 krb5kdc[27829](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164035, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.240.253@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:40:35.081239 28367 init.cc:377] Logged in from keytab as oryx/127.20.240.253@KRBTEST.COM (short username oryx)
I20260808 04:40:35.082345 28367 webserver.cc:460] Webserver started at http://127.20.240.253:46651/ using document root <none> and password file <none>
I20260808 04:40:35.082978 28367 fs_manager.cc:359] Metadata directory not provided
I20260808 04:40:35.083078 28367 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:40:35.083329 28367 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 04:40:35.085704 28367 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164000593138-21443-0/minicluster-data/master-1/data/instance:
uuid: "9e743421bb6848248124d784dd3fe6ee"
format_stamp: "Formatted at 2026-08-08 04:40:35 on dist-test-slave-vxj2"
server_key: "a193a96b4c32426b8bdee5e483a9674c"
server_key_iv: "6ec8d18547a2956404a50af017b0d0ac"
server_key_version: "encryptionkey@0"
I20260808 04:40:35.086371 28367 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164000593138-21443-0/minicluster-data/master-1/wal/instance:
uuid: "9e743421bb6848248124d784dd3fe6ee"
format_stamp: "Formatted at 2026-08-08 04:40:35 on dist-test-slave-vxj2"
server_key: "a193a96b4c32426b8bdee5e483a9674c"
server_key_iv: "6ec8d18547a2956404a50af017b0d0ac"
server_key_version: "encryptionkey@0"
I20260808 04:40:35.090622 28367 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260808 04:40:35.093396 28382 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:35.094769 28367 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 04:40:35.094949 28367 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164000593138-21443-0/minicluster-data/master-1/data,/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164000593138-21443-0/minicluster-data/master-1/wal
uuid: "9e743421bb6848248124d784dd3fe6ee"
format_stamp: "Formatted at 2026-08-08 04:40:35 on dist-test-slave-vxj2"
server_key: "a193a96b4c32426b8bdee5e483a9674c"
server_key_iv: "6ec8d18547a2956404a50af017b0d0ac"
server_key_version: "encryptionkey@0"
I20260808 04:40:35.095080 28367 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164000593138-21443-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164000593138-21443-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164000593138-21443-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:40:35.115343 28367 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:40:35.118702 28367 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:40:35.118938 28367 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:40:35.126945 28367 rpc_server.cc:307] RPC server started. Bound to: 127.20.240.253:34575
I20260808 04:40:35.127312 28438 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.240.253:34575 every 8 connection(s)
I20260808 04:40:35.127982 28367 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164000593138-21443-0/minicluster-data/master-1/data/info.pb
I20260808 04:40:35.131026 28439 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:40:35.134145 21443 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu as pid 28367
I20260808 04:40:35.135277 28439 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.240.254" port: 33559 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 04:40:35 dist-test-slave-vxj2 krb5kdc[27829](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164035, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.240.253@KRBTEST.COM for oryx/127.20.240.254@KRBTEST.COM
Aug 08 04:40:35 dist-test-slave-vxj2 krb5kdc[27829](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164033, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.20.240.253@KRBTEST.COM
I20260808 04:40:35.149124 27917 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:35.137246 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49372 (local address 127.20.240.254:33559)
0808 04:40:35.137384 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:35.137390 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:35.137687 (+ 297us) server_negotiation.cc:407] Connection header received
0808 04:40:35.137877 (+ 190us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:35.137882 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:35.137940 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:35.138008 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:35.139120 (+ 1112us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:35.139875 (+ 755us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:35.141429 (+ 1554us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:35.141743 (+ 314us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:35.141866 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:35.144723 (+ 2857us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:40:35.144727 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:40:35.144729 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:40:35.144757 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:40:35.146530 (+ 1773us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:35.147158 (+ 628us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:35.147164 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:35.147169 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:35.147263 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:35.147717 (+ 454us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:35.147721 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:35.147723 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:35.148043 (+ 320us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:40:35.148168 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:35.148766 (+ 598us) server_negotiation.cc:299] Negotiation successful
0808 04:40:35.148915 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260808 04:40:35.150007 28443 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:35.137131 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:33559 (local address 127.0.0.1:49372)
0808 04:40:35.137557 (+ 426us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:35.137596 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:35.137743 (+ 147us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:35.138221 (+ 478us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:35.138229 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:35.138718 (+ 489us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:40:35.138965 (+ 247us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:35.138975 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:35.140034 (+ 1059us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:35.140037 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:35.141303 (+ 1266us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:35.141313 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:35.141926 (+ 613us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:35.141930 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:35.142041 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:35.142641 (+ 600us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:40:35.142663 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:40:35.144538 (+ 1875us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:40:35.146661 (+ 2123us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:35.146668 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:35.146677 (+ 9us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:35.147056 (+ 379us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:35.147365 (+ 309us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:35.147368 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:35.147370 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:35.147555 (+ 185us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:35.148173 (+ 618us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:40:35.148178 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:40:35.148465 (+ 287us) client_negotiation.cc:769] Sending connection context
0808 04:40:35.148617 (+ 152us) client_negotiation.cc:240] Negotiation successful
0808 04:40:35.148945 (+ 328us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":284,"mutex_wait_us":1,"thread_start_us":140,"threads_started":1}
I20260808 04:40:35.150004 28442 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:35.135793 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53492 (local address 127.20.240.253:34575)
0808 04:40:35.136240 (+ 447us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:35.136256 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:35.136291 (+ 35us) server_negotiation.cc:407] Connection header received
0808 04:40:35.137063 (+ 772us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:35.137084 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:35.137532 (+ 448us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:35.137824 (+ 292us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:35.138743 (+ 919us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:35.140080 (+ 1337us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:35.141269 (+ 1189us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:35.141780 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:35.141924 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:35.145202 (+ 3278us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:40:35.145209 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:40:35.145224 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:40:35.145253 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:40:35.147133 (+ 1880us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:35.147725 (+ 592us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:35.147731 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:35.147733 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:35.147833 (+ 100us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:35.148114 (+ 281us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:35.148119 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:35.148122 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:35.148725 (+ 603us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:40:35.148945 (+ 220us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:35.149519 (+ 574us) server_negotiation.cc:299] Negotiation successful
0808 04:40:35.149646 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":33,"server-negotiator.queue_time_us":297,"thread_start_us":154,"threads_started":1}
I20260808 04:40:35.151765 28439 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.240.253" port: 34575 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 04:40:35 dist-test-slave-vxj2 krb5kdc[27829](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164035, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.240.253@KRBTEST.COM for oryx/127.20.240.253@KRBTEST.COM
I20260808 04:40:35.159726 28443 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:35.152319 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.253:34575 (local address 127.0.0.1:53506)
0808 04:40:35.152428 (+ 109us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:35.152443 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:35.152527 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:35.152776 (+ 249us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:35.152779 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:35.152932 (+ 153us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:40:35.153029 (+ 97us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:35.153034 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:35.153867 (+ 833us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:35.153870 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:35.154398 (+ 528us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:35.154405 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:35.154875 (+ 470us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:35.154878 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:35.154957 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:35.155407 (+ 450us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:40:35.155418 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:40:35.156671 (+ 1253us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:40:35.158413 (+ 1742us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:35.158416 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:35.158418 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:35.158602 (+ 184us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:35.158850 (+ 248us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:35.158852 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:35.158853 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:35.158942 (+ 89us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:35.159287 (+ 345us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:40:35.159290 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:40:35.159362 (+ 72us) client_negotiation.cc:769] Sending connection context
0808 04:40:35.159449 (+ 87us) client_negotiation.cc:240] Negotiation successful
0808 04:40:35.159546 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":32}
I20260808 04:40:35.159725 28442 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:35.152376 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53506 (local address 127.20.240.253:34575)
0808 04:40:35.152470 (+ 94us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:35.152474 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:35.152487 (+ 13us) server_negotiation.cc:407] Connection header received
0808 04:40:35.152608 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:35.152610 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:35.152644 (+ 34us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:35.152707 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:35.153134 (+ 427us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:35.153688 (+ 554us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:35.154502 (+ 814us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:35.154720 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:35.154798 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:35.156803 (+ 2005us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:40:35.156807 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:40:35.156810 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:40:35.156836 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:40:35.158313 (+ 1477us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:35.158691 (+ 378us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:35.158694 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:35.158695 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:35.158766 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:35.159027 (+ 261us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:35.159030 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:35.159031 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:35.159200 (+ 169us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:40:35.159276 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:35.159505 (+ 229us) server_negotiation.cc:299] Negotiation successful
0808 04:40:35.159593 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260808 04:40:35.163420 28439 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9e743421bb6848248124d784dd3fe6ee: Bootstrap starting.
I20260808 04:40:35.165874 28439 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9e743421bb6848248124d784dd3fe6ee: Neither blocks nor log segments found. Creating new log.
I20260808 04:40:35.166751 28439 log.cc:824] T 00000000000000000000000000000000 P 9e743421bb6848248124d784dd3fe6ee: Log is configured to *not* fsync() on all Append() calls
I20260808 04:40:35.168709 28439 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9e743421bb6848248124d784dd3fe6ee: No bootstrap required, opened a new log
I20260808 04:40:35.171870 28439 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9e743421bb6848248124d784dd3fe6ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a361414698e49a880ae63c23c2991be" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 33559 } } peers { permanent_uuid: "9e743421bb6848248124d784dd3fe6ee" member_type: VOTER last_known_addr { host: "127.20.240.253" port: 34575 } }
I20260808 04:40:35.172104 28439 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9e743421bb6848248124d784dd3fe6ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:40:35.172171 28439 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9e743421bb6848248124d784dd3fe6ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e743421bb6848248124d784dd3fe6ee, State: Initialized, Role: FOLLOWER
I20260808 04:40:35.172632 28439 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9e743421bb6848248124d784dd3fe6ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a361414698e49a880ae63c23c2991be" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 33559 } } peers { permanent_uuid: "9e743421bb6848248124d784dd3fe6ee" member_type: VOTER last_known_addr { host: "127.20.240.253" port: 34575 } }
I20260808 04:40:35.173143 28445 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9e743421bb6848248124d784dd3fe6ee [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a361414698e49a880ae63c23c2991be" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 33559 } } peers { permanent_uuid: "9e743421bb6848248124d784dd3fe6ee" member_type: VOTER last_known_addr { host: "127.20.240.253" port: 34575 } } }
I20260808 04:40:35.173354 28445 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9e743421bb6848248124d784dd3fe6ee [sys.catalog]: This master's current role is: FOLLOWER
I20260808 04:40:35.173995 28439 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9e743421bb6848248124d784dd3fe6ee [sys.catalog]: configured and running, proceeding with master startup.
W20260808 04:40:35.179567 28456 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 9e743421bb6848248124d784dd3fe6ee: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 04:40:35.179683 28456 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 04:40:35.182104 28367 master_runner.cc:428] Detected that this master 9e743421bb6848248124d784dd3fe6ee is joining an existing cluster
I20260808 04:40:35.182185 28367 master_runner.cc:432] Initiating AddMaster RPC to add 127.20.240.253:34575
I20260808 04:40:35.193219 28465 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:35.185146 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.253:34575 (local address 127.0.0.1:53522)
0808 04:40:35.185586 (+ 440us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:35.185600 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:35.185702 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:35.185966 (+ 264us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:35.185968 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:35.186180 (+ 212us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:40:35.186274 (+ 94us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:35.186279 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:35.187003 (+ 724us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:35.187007 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:35.187625 (+ 618us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:35.187632 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:35.188091 (+ 459us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:35.188094 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:35.188240 (+ 146us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:35.188790 (+ 550us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:40:35.188802 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:40:35.189141 (+ 339us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:40:35.191510 (+ 2369us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:35.191515 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:35.191518 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:35.191778 (+ 260us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:35.192080 (+ 302us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:35.192083 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:35.192085 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:35.192166 (+ 81us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:35.192606 (+ 440us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:40:35.192608 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:40:35.192673 (+ 65us) client_negotiation.cc:769] Sending connection context
0808 04:40:35.192787 (+ 114us) client_negotiation.cc:240] Negotiation successful
0808 04:40:35.192939 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":232,"mutex_wait_us":71,"thread_start_us":99,"threads_started":1}
I20260808 04:40:35.193730 27917 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:35.184751 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49376 (local address 127.20.240.254:33559)
0808 04:40:35.184921 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:35.184926 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:35.185210 (+ 284us) server_negotiation.cc:407] Connection header received
0808 04:40:35.185410 (+ 200us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:35.185413 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:35.185466 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:35.185521 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:35.186298 (+ 777us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:35.187142 (+ 844us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:35.188419 (+ 1277us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:35.188755 (+ 336us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:35.188846 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:35.190191 (+ 1345us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:40:35.190195 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:40:35.190199 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:40:35.190235 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:40:35.191887 (+ 1652us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:35.192329 (+ 442us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:35.192332 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:35.192334 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:35.192431 (+ 97us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:35.192795 (+ 364us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:35.192798 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:35.192800 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:35.193004 (+ 204us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:40:35.193111 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:35.193444 (+ 333us) server_negotiation.cc:299] Negotiation successful
0808 04:40:35.193567 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260808 04:40:35.193759 28442 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:35.185490 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53522 (local address 127.20.240.253:34575)
0808 04:40:35.185594 (+ 104us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:35.185600 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:35.185660 (+ 60us) server_negotiation.cc:407] Connection header received
0808 04:40:35.185800 (+ 140us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:35.185803 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:35.185838 (+ 35us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:35.185952 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:35.186388 (+ 436us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:35.186880 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:35.187738 (+ 858us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:35.187966 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:35.188077 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:35.189533 (+ 1456us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:40:35.189535 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:40:35.189537 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:40:35.189559 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:40:35.191345 (+ 1786us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:35.191896 (+ 551us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:35.191899 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:35.191901 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:35.191997 (+ 96us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:35.192262 (+ 265us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:35.192265 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:35.192267 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:35.192481 (+ 214us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:40:35.192568 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:35.193224 (+ 656us) server_negotiation.cc:299] Negotiation successful
0808 04:40:35.193660 (+ 436us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":3,"server-negotiator.queue_time_us":50}
I20260808 04:40:35.194773 28464 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:35.184617 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:33559 (local address 127.0.0.1:49376)
0808 04:40:35.185094 (+ 477us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:35.185110 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:35.185289 (+ 179us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:35.185680 (+ 391us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:35.185683 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:35.185986 (+ 303us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:40:35.186153 (+ 167us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:35.186161 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:35.187289 (+ 1128us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:35.187293 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:35.188278 (+ 985us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:35.188289 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:35.189003 (+ 714us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:35.189007 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:35.189097 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:35.189519 (+ 422us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:40:35.189534 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:40:35.189985 (+ 451us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:40:35.191984 (+ 1999us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:35.191987 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:35.191989 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:35.192203 (+ 214us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:35.192584 (+ 381us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:35.192587 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:35.192589 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:35.192685 (+ 96us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:35.193111 (+ 426us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:40:35.193114 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:40:35.193233 (+ 119us) client_negotiation.cc:769] Sending connection context
0808 04:40:35.193939 (+ 706us) client_negotiation.cc:240] Negotiation successful
0808 04:40:35.194602 (+ 663us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":390,"mutex_wait_us":50,"thread_start_us":120,"threads_started":1}
Aug 08 04:40:35 dist-test-slave-vxj2 krb5kdc[27829](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164034, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.240.254@KRBTEST.COM for oryx/127.20.240.253@KRBTEST.COM
I20260808 04:40:35.209046 28466 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:35.199350 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.253:34575 (local address 127.0.0.1:53528)
0808 04:40:35.199708 (+ 358us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:35.199752 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:35.199935 (+ 183us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:35.200237 (+ 302us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:35.200243 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:35.200606 (+ 363us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:40:35.200715 (+ 109us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:35.200721 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:35.201499 (+ 778us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:35.201502 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:35.202139 (+ 637us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:35.202147 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:35.202589 (+ 442us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:35.202593 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:35.202711 (+ 118us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:35.203496 (+ 785us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:40:35.203511 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:40:35.204979 (+ 1468us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:40:35.207224 (+ 2245us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:35.207236 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:35.207244 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:35.207590 (+ 346us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:35.207889 (+ 299us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:35.207892 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:35.207894 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:35.207985 (+ 91us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:35.208385 (+ 400us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:40:35.208395 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:40:35.208529 (+ 134us) client_negotiation.cc:769] Sending connection context
0808 04:40:35.208679 (+ 150us) client_negotiation.cc:240] Negotiation successful
0808 04:40:35.208887 (+ 208us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":202,"thread_start_us":100,"threads_started":1}
I20260808 04:40:35.209041 28442 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:35.199371 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53528 (local address 127.20.240.253:34575)
0808 04:40:35.199525 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:35.199529 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:35.199830 (+ 301us) server_negotiation.cc:407] Connection header received
0808 04:40:35.200060 (+ 230us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:35.200063 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:35.200115 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:35.200201 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:35.200832 (+ 631us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:35.201384 (+ 552us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:35.202261 (+ 877us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:35.202476 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:35.202584 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:35.205115 (+ 2531us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:40:35.205121 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:40:35.205128 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:40:35.205195 (+ 67us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:40:35.207075 (+ 1880us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:35.207714 (+ 639us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:35.207717 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:35.207718 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:35.207786 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:35.208081 (+ 295us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:35.208085 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:35.208087 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:35.208273 (+ 186us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:40:35.208382 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:35.208733 (+ 351us) server_negotiation.cc:299] Negotiation successful
0808 04:40:35.208857 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260808 04:40:35.210847 27877 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.20.240.253:34575: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "9e743421bb6848248124d784dd3fe6ee"
member_type: NON_VOTER
last_known_addr {
host: "127.20.240.253"
port: 34575
}
attrs {
promote: true
}
}
dest_uuid: "2a361414698e49a880ae63c23c2991be"
cas_config_opid_index: -1
I20260808 04:40:35.211591 27877 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2a361414698e49a880ae63c23c2991be [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "2a361414698e49a880ae63c23c2991be" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 33559 } } peers { permanent_uuid: "9e743421bb6848248124d784dd3fe6ee" member_type: NON_VOTER last_known_addr { host: "127.20.240.253" port: 34575 } attrs { promote: true } }
I20260808 04:40:35.213667 28469 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 2a361414698e49a880ae63c23c2991be [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index -1 to 5, NON_VOTER 9e743421bb6848248124d784dd3fe6ee (127.20.240.253) added. New config: { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "2a361414698e49a880ae63c23c2991be" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 33559 } } peers { permanent_uuid: "9e743421bb6848248124d784dd3fe6ee" member_type: NON_VOTER last_known_addr { host: "127.20.240.253" port: 34575 } attrs { promote: true } } }
I20260808 04:40:35.214341 28412 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9e743421bb6848248124d784dd3fe6ee [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:40:35.215265 28469 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.20.240.253:34575
I20260808 04:40:35.215659 28469 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2a361414698e49a880ae63c23c2991be [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "2a361414698e49a880ae63c23c2991be" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "2a361414698e49a880ae63c23c2991be" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 33559 } } peers { permanent_uuid: "9e743421bb6848248124d784dd3fe6ee" member_type: NON_VOTER last_known_addr { host: "127.20.240.253" port: 34575 } attrs { promote: true } } }
I20260808 04:40:35.215773 28469 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2a361414698e49a880ae63c23c2991be [sys.catalog]: This master's current role is: LEADER
I20260808 04:40:35.215767 28412 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 9e743421bb6848248124d784dd3fe6ee [term 1 FOLLOWER]: Refusing update from remote peer 2a361414698e49a880ae63c23c2991be: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260808 04:40:35.216177 28367 master.cc:537] Master@127.20.240.253:34575 shutting down...
I20260808 04:40:35.216661 28469 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 2a361414698e49a880ae63c23c2991be [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e743421bb6848248124d784dd3fe6ee" member_type: NON_VOTER last_known_addr { host: "127.20.240.253" port: 34575 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 0, Time since last communication: 0.000s
WARNING: no policy specified for oryx/127.20.240.252@KRBTEST.COM; defaulting to no policy
W20260808 04:40:35.219862 27862 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.20.240.252@KRBTEST.COM" created.
I20260808 04:40:35.220968 28367 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 9e743421bb6848248124d784dd3fe6ee [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 04:40:35.221392 28367 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 9e743421bb6848248124d784dd3fe6ee [term 1 FOLLOWER]: Raft consensus is shut down!
W20260808 04:40:35.221485 27862 consensus_peers.cc:487] T 00000000000000000000000000000000 P 2a361414698e49a880ae63c23c2991be -> Peer 9e743421bb6848248124d784dd3fe6ee (127.20.240.253:34575): Couldn't send request to peer 9e743421bb6848248124d784dd3fe6ee. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260808 04:40:35.221565 28367 tablet_replica.cc:330] T 00000000000000000000000000000000 P 9e743421bb6848248124d784dd3fe6ee: stopping tablet replica
I20260808 04:40:35.237609 28367 master.cc:552] Master@127.20.240.253:34575 shutdown complete.
I20260808 04:40:35.237670 28367 master_runner.cc:305] Clearing existing system tablet
I20260808 04:40:35.237963 28367 fs_manager.cc:359] Metadata directory not provided
I20260808 04:40:35.238018 28367 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.20.240.252 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164000593138-21443-0/krb5kdc/oryx_127.20.240.252.keytab.
Entry for principal oryx/127.20.240.252 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164000593138-21443-0/krb5kdc/oryx_127.20.240.252.keytab.
I20260808 04:40:35.239861 28367 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 04:40:35.240658 21443 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
/tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164000593138-21443-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164000593138-21443-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164000593138-21443-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164000593138-21443-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.240.252:39583
--webserver_interface=127.20.240.252
--webserver_port=0
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164000593138-21443-0/krb5kdc/oryx_127.20.240.252.keytab
--principal=oryx/127.20.240.252
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.240.212:39295
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.240.254:33559,127.20.240.253:34575,127.20.240.252:39583
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164000593138-21443-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164000593138-21443-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164000593138-21443-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 04:40:35.240763 28475 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:35.240994 28367 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164000593138-21443-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:40:35.241106 28367 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 04:40:35.241132 28367 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164000593138-21443-0/minicluster-data/master-1/data,/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164000593138-21443-0/minicluster-data/master-1/wal
uuid: "9e743421bb6848248124d784dd3fe6ee"
format_stamp: "Formatted at 2026-08-08 04:40:35 on dist-test-slave-vxj2"
server_key: "a193a96b4c32426b8bdee5e483a9674c"
server_key_iv: "6ec8d18547a2956404a50af017b0d0ac"
server_key_version: "encryptionkey@0"
I20260808 04:40:35.243543 28367 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P 9e743421bb6848248124d784dd3fe6ee: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 04:40:35.246039 28367 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P 9e743421bb6848248124d784dd3fe6ee: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260808 04:40:35.246160 28367 log.cc:1196] T 00000000000000000000000000000000 P 9e743421bb6848248124d784dd3fe6ee: Deleting WAL directory at /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164000593138-21443-0/minicluster-data/master-1/wal/wals/00000000000000000000000000000000
I20260808 04:40:35.246424 28367 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P 9e743421bb6848248124d784dd3fe6ee: Deleting consensus metadata
I20260808 04:40:35.246642 28367 master_runner.cc:315] Copying system tablet from 127.20.240.254:33559
I20260808 04:40:35.248061 28367 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P 9e743421bb6848248124d784dd3fe6ee: tablet copy: Beginning tablet copy session from remote peer at address 127.20.240.254:33559
I20260808 04:40:35.256302 27917 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:35.248840 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49390 (local address 127.20.240.254:33559)
0808 04:40:35.248988 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:35.248993 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:35.249271 (+ 278us) server_negotiation.cc:407] Connection header received
0808 04:40:35.249411 (+ 140us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:35.249414 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:35.249469 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:35.249562 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:35.250027 (+ 465us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:35.250562 (+ 535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:35.251400 (+ 838us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:35.251630 (+ 230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:35.251745 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:35.252911 (+ 1166us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:40:35.252923 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:40:35.252925 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:40:35.252954 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:40:35.254482 (+ 1528us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:35.254942 (+ 460us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:35.254945 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:35.254947 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:35.255034 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:35.255327 (+ 293us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:35.255332 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:35.255334 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:35.255617 (+ 283us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:40:35.255728 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:35.256004 (+ 276us) server_negotiation.cc:299] Negotiation successful
0808 04:40:35.256126 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260808 04:40:35.256312 28482 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:35.248791 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:33559 (local address 127.0.0.1:49390)
0808 04:40:35.249122 (+ 331us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:35.249135 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:35.249305 (+ 170us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:35.249578 (+ 273us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:35.249581 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:35.249794 (+ 213us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:40:35.249901 (+ 107us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:35.249907 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:35.250680 (+ 773us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:35.250684 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:35.251277 (+ 593us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:35.251284 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:35.251749 (+ 465us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:35.251753 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:35.251847 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:35.252419 (+ 572us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:40:35.252432 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:40:35.252764 (+ 332us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:40:35.254605 (+ 1841us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:35.254610 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:35.254612 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:35.254829 (+ 217us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:35.255131 (+ 302us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:35.255135 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:35.255137 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:35.255234 (+ 97us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:35.255717 (+ 483us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:40:35.255720 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:40:35.255829 (+ 109us) client_negotiation.cc:769] Sending connection context
0808 04:40:35.255941 (+ 112us) client_negotiation.cc:240] Negotiation successful
0808 04:40:35.256110 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":276,"thread_start_us":108,"threads_started":1}
I20260808 04:40:35.257405 27898 tablet_copy_service.cc:140] P 2a361414698e49a880ae63c23c2991be: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer 9e743421bb6848248124d784dd3fe6ee ({username='oryx', principal='oryx/127.20.240.253@KRBTEST.COM'} at 127.0.0.1:49390)
I20260808 04:40:35.257611 27898 tablet_copy_service.cc:161] P 2a361414698e49a880ae63c23c2991be: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer 9e743421bb6848248124d784dd3fe6ee at {username='oryx', principal='oryx/127.20.240.253@KRBTEST.COM'} at 127.0.0.1:49390: session id = 9e743421bb6848248124d784dd3fe6ee-00000000000000000000000000000000
I20260808 04:40:35.259199 27898 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P 2a361414698e49a880ae63c23c2991be: Tablet Copy: opened 0 blocks and 1 log segments
I20260808 04:40:35.260968 28367 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260808 04:40:35.263068 28367 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P 9e743421bb6848248124d784dd3fe6ee: tablet copy: Starting download of 0 data blocks...
I20260808 04:40:35.263338 28367 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P 9e743421bb6848248124d784dd3fe6ee: tablet copy: Starting download of 1 WAL segments...
I20260808 04:40:35.265065 28367 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P 9e743421bb6848248124d784dd3fe6ee: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260808 04:40:35.266793 27898 tablet_copy_service.cc:342] P 2a361414698e49a880ae63c23c2991be: Request end of tablet copy session 9e743421bb6848248124d784dd3fe6ee-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.20.240.253@KRBTEST.COM'} at 127.0.0.1:49390
I20260808 04:40:35.266918 27898 tablet_copy_service.cc:433] P 2a361414698e49a880ae63c23c2991be: ending tablet copy session 9e743421bb6848248124d784dd3fe6ee-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer 9e743421bb6848248124d784dd3fe6ee
I20260808 04:40:35.274256 28367 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:40:35.276049 28486 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:40:35.276225 28483 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:40:35.276285 28484 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:40:35.276561 28367 server_base.cc:1034] running on GCE node
I20260808 04:40:35.276731 28367 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:40:35.277117 28367 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:40:35.278275 28367 hybrid_clock.cc:648] HybridClock initialized: now 1786164035278266 us; error 24 us; skew 500 ppm
Aug 08 04:40:35 dist-test-slave-vxj2 krb5kdc[27829](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164035, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.240.253@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:40:35.279874 28367 init.cc:377] Logged in from keytab as oryx/127.20.240.253@KRBTEST.COM (short username oryx)
I20260808 04:40:35.280356 28367 webserver.cc:460] Webserver started at http://127.20.240.253:37235/ using document root <none> and password file <none>
I20260808 04:40:35.280553 28367 fs_manager.cc:359] Metadata directory not provided
I20260808 04:40:35.280613 28367 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:40:35.281949 28367 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260808 04:40:35.283025 28493 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:35.283357 28367 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 04:40:35.283461 28367 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164000593138-21443-0/minicluster-data/master-1/data,/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164000593138-21443-0/minicluster-data/master-1/wal
uuid: "9e743421bb6848248124d784dd3fe6ee"
format_stamp: "Formatted at 2026-08-08 04:40:35 on dist-test-slave-vxj2"
server_key: "a193a96b4c32426b8bdee5e483a9674c"
server_key_iv: "6ec8d18547a2956404a50af017b0d0ac"
server_key_version: "encryptionkey@0"
I20260808 04:40:35.283566 28367 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164000593138-21443-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164000593138-21443-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164000593138-21443-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:40:35.288425 28367 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:40:35.290441 28367 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:40:35.295532 28367 rpc_server.cc:307] RPC server started. Bound to: 127.20.240.253:34575
I20260808 04:40:35.296149 28367 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164000593138-21443-0/minicluster-data/master-1/data/info.pb
I20260808 04:40:35.296582 28548 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.240.253:34575 every 8 connection(s)
I20260808 04:40:35.297948 28549 sys_catalog.cc:263] Verifying existing consensus state
I20260808 04:40:35.298771 28549 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9e743421bb6848248124d784dd3fe6ee: Bootstrap starting.
I20260808 04:40:35.307886 28549 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9e743421bb6848248124d784dd3fe6ee: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 04:40:35.308262 28549 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9e743421bb6848248124d784dd3fe6ee: Bootstrap complete.
I20260808 04:40:35.308813 28549 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9e743421bb6848248124d784dd3fe6ee [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "2a361414698e49a880ae63c23c2991be" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 33559 } } peers { permanent_uuid: "9e743421bb6848248124d784dd3fe6ee" member_type: NON_VOTER last_known_addr { host: "127.20.240.253" port: 34575 } attrs { promote: true } }
I20260808 04:40:35.308990 28549 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9e743421bb6848248124d784dd3fe6ee [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 9e743421bb6848248124d784dd3fe6ee, State: Initialized, Role: LEARNER
I20260808 04:40:35.309113 28549 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9e743421bb6848248124d784dd3fe6ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 1.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "2a361414698e49a880ae63c23c2991be" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 33559 } } peers { permanent_uuid: "9e743421bb6848248124d784dd3fe6ee" member_type: NON_VOTER last_known_addr { host: "127.20.240.253" port: 34575 } attrs { promote: true } }
I20260808 04:40:35.309538 28553 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9e743421bb6848248124d784dd3fe6ee [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "2a361414698e49a880ae63c23c2991be" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 33559 } } peers { permanent_uuid: "9e743421bb6848248124d784dd3fe6ee" member_type: NON_VOTER last_known_addr { host: "127.20.240.253" port: 34575 } attrs { promote: true } } }
I20260808 04:40:35.309703 28553 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9e743421bb6848248124d784dd3fe6ee [sys.catalog]: This master's current role is: LEARNER
I20260808 04:40:35.309706 28549 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9e743421bb6848248124d784dd3fe6ee [sys.catalog]: configured and running, proceeding with master startup.
I20260808 04:40:35.313506 28564 catalog_manager.cc:1259] Loaded cluster ID: b59e5a78215d4b33b7d72afd96aa3b8f
I20260808 04:40:35.313584 28564 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 9e743421bb6848248124d784dd3fe6ee: loading cluster ID for follower catalog manager: success
I20260808 04:40:35.315068 28564 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 9e743421bb6848248124d784dd3fe6ee: acquiring CA information for follower catalog manager: success
I20260808 04:40:35.316119 28564 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 9e743421bb6848248124d784dd3fe6ee: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20260808 04:40:35.397374 28476 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:40:35.397653 28476 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:40:35.397729 28476 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:40:35.401980 28476 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 04:40:35.402191 28476 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:40:35.402269 28476 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:40:35.402328 28476 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 04:40:35.402365 28476 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 04:40:35.408486 28476 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.240.212:39295
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164000593138-21443-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164000593138-21443-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.20.240.254:33559,127.20.240.253:34575,127.20.240.252:39583
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164000593138-21443-0/krb5kdc/oryx_127.20.240.252.keytab
--principal=oryx/127.20.240.252
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.240.252:39583
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164000593138-21443-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.20.240.252
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28476
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164000593138-21443-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 04:05:18 UTC on ccycloud.quasar-drfdgt.root.comops.site
build id 4574101
I20260808 04:40:35.409739 28476 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:40:35.410992 28476 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:40:35.419909 28572 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:40:35.419889 28570 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:40:35.419955 28569 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:40:35.420353 28476 server_base.cc:1034] running on GCE node
I20260808 04:40:35.421032 28476 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:40:35.422250 28476 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:40:35.423471 28476 hybrid_clock.cc:648] HybridClock initialized: now 1786164035423443 us; error 48 us; skew 500 ppm
Aug 08 04:40:35 dist-test-slave-vxj2 krb5kdc[27829](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164035, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.240.252@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:40:35.426563 28476 init.cc:377] Logged in from keytab as oryx/127.20.240.252@KRBTEST.COM (short username oryx)
I20260808 04:40:35.427529 28476 webserver.cc:460] Webserver started at http://127.20.240.252:35159/ using document root <none> and password file <none>
I20260808 04:40:35.428126 28476 fs_manager.cc:359] Metadata directory not provided
I20260808 04:40:35.428237 28476 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:40:35.428547 28476 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 04:40:35.430835 28476 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164000593138-21443-0/minicluster-data/master-2/data/instance:
uuid: "a6c01c87c3a84bc7a009d59c7f7ee4c6"
format_stamp: "Formatted at 2026-08-08 04:40:35 on dist-test-slave-vxj2"
server_key: "b3701c515dbb5d32ee69c7624f1aac2e"
server_key_iv: "cf6c80dd43a09b2fb12b84a55f18668e"
server_key_version: "encryptionkey@0"
I20260808 04:40:35.431598 28476 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164000593138-21443-0/minicluster-data/master-2/wal/instance:
uuid: "a6c01c87c3a84bc7a009d59c7f7ee4c6"
format_stamp: "Formatted at 2026-08-08 04:40:35 on dist-test-slave-vxj2"
server_key: "b3701c515dbb5d32ee69c7624f1aac2e"
server_key_iv: "cf6c80dd43a09b2fb12b84a55f18668e"
server_key_version: "encryptionkey@0"
I20260808 04:40:35.435493 28077 heartbeater.cc:503] Master 127.20.240.254:33559 was elected leader, sending a full tablet report...
I20260808 04:40:35.436112 28476 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260808 04:40:35.438931 28579 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:35.440241 28476 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260808 04:40:35.440382 28476 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164000593138-21443-0/minicluster-data/master-2/data,/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164000593138-21443-0/minicluster-data/master-2/wal
uuid: "a6c01c87c3a84bc7a009d59c7f7ee4c6"
format_stamp: "Formatted at 2026-08-08 04:40:35 on dist-test-slave-vxj2"
server_key: "b3701c515dbb5d32ee69c7624f1aac2e"
server_key_iv: "cf6c80dd43a09b2fb12b84a55f18668e"
server_key_version: "encryptionkey@0"
I20260808 04:40:35.440513 28476 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164000593138-21443-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164000593138-21443-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164000593138-21443-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:40:35.469211 28476 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:40:35.472530 28476 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:40:35.472738 28476 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:40:35.480095 28476 rpc_server.cc:307] RPC server started. Bound to: 127.20.240.252:39583
I20260808 04:40:35.480471 28633 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.240.252:39583 every 8 connection(s)
I20260808 04:40:35.481278 28476 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164000593138-21443-0/minicluster-data/master-2/data/info.pb
I20260808 04:40:35.484232 28634 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:40:35.488236 28634 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.240.254" port: 33559 } has no permanent_uuid. Determining permanent_uuid...
I20260808 04:40:35.489758 21443 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu as pid 28476
Aug 08 04:40:35 dist-test-slave-vxj2 krb5kdc[27829](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164035, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.240.252@KRBTEST.COM for oryx/127.20.240.254@KRBTEST.COM
Aug 08 04:40:35 dist-test-slave-vxj2 krb5kdc[27829](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164033, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.20.240.252@KRBTEST.COM
I20260808 04:40:35.504637 27917 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:35.490567 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49398 (local address 127.20.240.254:33559)
0808 04:40:35.490727 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:35.490733 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:35.491627 (+ 894us) server_negotiation.cc:407] Connection header received
0808 04:40:35.492542 (+ 915us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:35.492546 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:35.492600 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:35.492699 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:35.493932 (+ 1233us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:35.494860 (+ 928us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:35.496375 (+ 1515us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:35.496745 (+ 370us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:35.496881 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:35.500039 (+ 3158us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:40:35.500046 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:40:35.500052 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:40:35.500094 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:40:35.502065 (+ 1971us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:35.502637 (+ 572us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:35.502642 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:35.502644 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:35.502754 (+ 110us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:35.503240 (+ 486us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:35.503243 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:35.503244 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:35.503550 (+ 306us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:40:35.503682 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:35.504272 (+ 590us) server_negotiation.cc:299] Negotiation successful
0808 04:40:35.504418 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260808 04:40:35.505609 28636 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:35.490885 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:33559 (local address 127.0.0.1:49398)
0808 04:40:35.491427 (+ 542us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:35.491477 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:35.492304 (+ 827us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:35.492789 (+ 485us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:35.492795 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:35.493387 (+ 592us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:40:35.493775 (+ 388us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:35.493791 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:35.495018 (+ 1227us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:35.495021 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:35.496202 (+ 1181us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:35.496214 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:35.497061 (+ 847us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:35.497064 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:35.497259 (+ 195us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:35.498092 (+ 833us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:40:35.498115 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:40:35.499852 (+ 1737us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:40:35.502183 (+ 2331us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:35.502191 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:35.502199 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:35.502517 (+ 318us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:35.502855 (+ 338us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:35.502857 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:35.502858 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:35.503078 (+ 220us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:35.503667 (+ 589us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:40:35.503675 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:40:35.503991 (+ 316us) client_negotiation.cc:769] Sending connection context
0808 04:40:35.504151 (+ 160us) client_negotiation.cc:240] Negotiation successful
0808 04:40:35.504496 (+ 345us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":342,"thread_start_us":172,"threads_started":1}
I20260808 04:40:35.505611 28637 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:35.490886 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36972 (local address 127.20.240.252:39583)
0808 04:40:35.491438 (+ 552us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:35.491453 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:35.491486 (+ 33us) server_negotiation.cc:407] Connection header received
0808 04:40:35.492282 (+ 796us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:35.492302 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:35.492561 (+ 259us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:35.492758 (+ 197us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:35.493801 (+ 1043us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:35.495184 (+ 1383us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:35.496375 (+ 1191us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:35.497057 (+ 682us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:35.497256 (+ 199us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:35.500666 (+ 3410us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:40:35.500674 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:40:35.500688 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:40:35.500720 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:40:35.502913 (+ 2193us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:35.503409 (+ 496us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:35.503415 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:35.503417 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:35.503512 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:35.503856 (+ 344us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:35.503859 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:35.503861 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:35.504116 (+ 255us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:40:35.504383 (+ 267us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:35.504608 (+ 225us) server_negotiation.cc:299] Negotiation successful
0808 04:40:35.504771 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":427,"thread_start_us":182,"threads_started":1}
I20260808 04:40:35.507002 28634 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.240.253" port: 34575 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 04:40:35 dist-test-slave-vxj2 krb5kdc[27829](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164035, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.240.252@KRBTEST.COM for oryx/127.20.240.253@KRBTEST.COM
I20260808 04:40:35.515736 28636 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:35.507522 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.253:34575 (local address 127.0.0.1:53536)
0808 04:40:35.507642 (+ 120us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:35.507658 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:35.507729 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:35.508187 (+ 458us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:35.508190 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:35.508361 (+ 171us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:40:35.508459 (+ 98us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:35.508464 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:35.509441 (+ 977us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:35.509445 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:35.510060 (+ 615us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:35.510068 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:35.510597 (+ 529us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:35.510600 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:35.510704 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:35.511234 (+ 530us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:40:35.511245 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:40:35.512536 (+ 1291us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:40:35.514219 (+ 1683us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:35.514223 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:35.514225 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:35.514425 (+ 200us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:35.514711 (+ 286us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:35.514716 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:35.514718 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:35.514799 (+ 81us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:35.515191 (+ 392us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:40:35.515199 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:40:35.515298 (+ 99us) client_negotiation.cc:769] Sending connection context
0808 04:40:35.515422 (+ 124us) client_negotiation.cc:240] Negotiation successful
0808 04:40:35.515560 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":51}
I20260808 04:40:35.515767 28638 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:35.507680 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53536 (local address 127.20.240.253:34575)
0808 04:40:35.507979 (+ 299us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:35.507983 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:35.507994 (+ 11us) server_negotiation.cc:407] Connection header received
0808 04:40:35.508030 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:35.508032 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:35.508070 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:35.508172 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:35.508579 (+ 407us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:35.509329 (+ 750us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:35.510178 (+ 849us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:35.510479 (+ 301us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:35.510634 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:35.512675 (+ 2041us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:40:35.512679 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:40:35.512681 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:40:35.512707 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:40:35.514099 (+ 1392us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:35.514530 (+ 431us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:35.514533 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:35.514535 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:35.514617 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:35.514892 (+ 275us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:35.514903 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:35.514905 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:35.515092 (+ 187us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:40:35.515208 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:35.515479 (+ 271us) server_negotiation.cc:299] Negotiation successful
0808 04:40:35.515607 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":230,"thread_start_us":113,"threads_started":1}
I20260808 04:40:35.516557 28634 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.240.252" port: 39583 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 04:40:35 dist-test-slave-vxj2 krb5kdc[27829](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164035, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.240.252@KRBTEST.COM for oryx/127.20.240.252@KRBTEST.COM
I20260808 04:40:35.524047 28637 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:35.517070 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36986 (local address 127.20.240.252:39583)
0808 04:40:35.517181 (+ 111us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:35.517186 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:35.517226 (+ 40us) server_negotiation.cc:407] Connection header received
0808 04:40:35.517361 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:35.517364 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:35.517406 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:35.517489 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:35.517823 (+ 334us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:35.518310 (+ 487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:35.519028 (+ 718us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:35.519249 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:35.519356 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:35.521367 (+ 2011us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:40:35.521370 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:40:35.521371 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:40:35.521391 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:40:35.522567 (+ 1176us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:35.522952 (+ 385us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:35.522954 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:35.522955 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:35.523026 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:35.523260 (+ 234us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:35.523262 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:35.523263 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:35.523417 (+ 154us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:40:35.523492 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:35.523796 (+ 304us) server_negotiation.cc:299] Negotiation successful
0808 04:40:35.523911 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":18,"server-negotiator.queue_time_us":42}
I20260808 04:40:35.524052 28636 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:35.516993 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.252:39583 (local address 127.0.0.1:36986)
0808 04:40:35.517151 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:35.517184 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:35.517265 (+ 81us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:35.517499 (+ 234us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:35.517502 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:35.517661 (+ 159us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:40:35.517720 (+ 59us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:35.517724 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:35.518423 (+ 699us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:35.518426 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:35.518914 (+ 488us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:35.518922 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:35.519353 (+ 431us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:35.519356 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:35.519527 (+ 171us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:35.519995 (+ 468us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:40:35.520009 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:40:35.521253 (+ 1244us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:40:35.522663 (+ 1410us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:35.522665 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:35.522667 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:35.522862 (+ 195us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:35.523107 (+ 245us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:35.523109 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:35.523110 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:35.523184 (+ 74us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:35.523566 (+ 382us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:40:35.523569 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:40:35.523649 (+ 80us) client_negotiation.cc:769] Sending connection context
0808 04:40:35.523745 (+ 96us) client_negotiation.cc:240] Negotiation successful
0808 04:40:35.523854 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":51,"mutex_wait_us":86}
I20260808 04:40:35.527868 28634 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a6c01c87c3a84bc7a009d59c7f7ee4c6: Bootstrap starting.
I20260808 04:40:35.530403 28634 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a6c01c87c3a84bc7a009d59c7f7ee4c6: Neither blocks nor log segments found. Creating new log.
I20260808 04:40:35.531199 28634 log.cc:824] T 00000000000000000000000000000000 P a6c01c87c3a84bc7a009d59c7f7ee4c6: Log is configured to *not* fsync() on all Append() calls
I20260808 04:40:35.533440 28634 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a6c01c87c3a84bc7a009d59c7f7ee4c6: No bootstrap required, opened a new log
I20260808 04:40:35.536371 28634 raft_consensus.cc:348] T 00000000000000000000000000000000 P a6c01c87c3a84bc7a009d59c7f7ee4c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a361414698e49a880ae63c23c2991be" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 33559 } } peers { permanent_uuid: "9e743421bb6848248124d784dd3fe6ee" member_type: VOTER last_known_addr { host: "127.20.240.253" port: 34575 } } peers { permanent_uuid: "a6c01c87c3a84bc7a009d59c7f7ee4c6" member_type: VOTER last_known_addr { host: "127.20.240.252" port: 39583 } }
I20260808 04:40:35.536587 28634 raft_consensus.cc:374] T 00000000000000000000000000000000 P a6c01c87c3a84bc7a009d59c7f7ee4c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:40:35.536628 28634 raft_consensus.cc:729] T 00000000000000000000000000000000 P a6c01c87c3a84bc7a009d59c7f7ee4c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a6c01c87c3a84bc7a009d59c7f7ee4c6, State: Initialized, Role: FOLLOWER
I20260808 04:40:35.537000 28634 consensus_queue.cc:260] T 00000000000000000000000000000000 P a6c01c87c3a84bc7a009d59c7f7ee4c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a361414698e49a880ae63c23c2991be" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 33559 } } peers { permanent_uuid: "9e743421bb6848248124d784dd3fe6ee" member_type: VOTER last_known_addr { host: "127.20.240.253" port: 34575 } } peers { permanent_uuid: "a6c01c87c3a84bc7a009d59c7f7ee4c6" member_type: VOTER last_known_addr { host: "127.20.240.252" port: 39583 } }
I20260808 04:40:35.537514 28640 sys_catalog.cc:455] T 00000000000000000000000000000000 P a6c01c87c3a84bc7a009d59c7f7ee4c6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a361414698e49a880ae63c23c2991be" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 33559 } } peers { permanent_uuid: "9e743421bb6848248124d784dd3fe6ee" member_type: VOTER last_known_addr { host: "127.20.240.253" port: 34575 } } peers { permanent_uuid: "a6c01c87c3a84bc7a009d59c7f7ee4c6" member_type: VOTER last_known_addr { host: "127.20.240.252" port: 39583 } } }
I20260808 04:40:35.537637 28640 sys_catalog.cc:458] T 00000000000000000000000000000000 P a6c01c87c3a84bc7a009d59c7f7ee4c6 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 04:40:35.538265 28634 sys_catalog.cc:564] T 00000000000000000000000000000000 P a6c01c87c3a84bc7a009d59c7f7ee4c6 [sys.catalog]: configured and running, proceeding with master startup.
W20260808 04:40:35.543354 28651 catalog_manager.cc:1558] T 00000000000000000000000000000000 P a6c01c87c3a84bc7a009d59c7f7ee4c6: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 04:40:35.543463 28651 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 04:40:35.547289 28476 master_runner.cc:428] Detected that this master a6c01c87c3a84bc7a009d59c7f7ee4c6 is joining an existing cluster
I20260808 04:40:35.547364 28476 master_runner.cc:432] Initiating AddMaster RPC to add 127.20.240.252:39583
I20260808 04:40:35.559502 21443 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu with pid 27941
I20260808 04:40:35.560762 28637 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:35.550981 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36990 (local address 127.20.240.252:39583)
0808 04:40:35.551073 (+ 92us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:35.551078 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:35.551522 (+ 444us) server_negotiation.cc:407] Connection header received
0808 04:40:35.551666 (+ 144us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:35.551668 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:35.551704 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:35.551759 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:35.552489 (+ 730us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:35.553030 (+ 541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:35.554554 (+ 1524us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:35.554904 (+ 350us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:35.555020 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:35.556433 (+ 1413us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:40:35.556437 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:40:35.556440 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:40:35.556465 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:40:35.558207 (+ 1742us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:35.558696 (+ 489us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:35.558703 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:35.558705 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:35.558787 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:35.559076 (+ 289us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:35.559079 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:35.559081 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:35.559356 (+ 275us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:40:35.559458 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:35.560511 (+ 1053us) server_negotiation.cc:299] Negotiation successful
0808 04:40:35.560624 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260808 04:40:35.561131 28659 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:35.550976 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.252:39583 (local address 127.0.0.1:36990)
0808 04:40:35.551448 (+ 472us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:35.551463 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:35.551572 (+ 109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:35.551906 (+ 334us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:35.551908 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:35.552228 (+ 320us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:40:35.552341 (+ 113us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:35.552348 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:35.553149 (+ 801us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:35.553179 (+ 30us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:35.554412 (+ 1233us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:35.554422 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:35.555059 (+ 637us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:35.555062 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:35.555135 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:35.555860 (+ 725us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:40:35.555870 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:40:35.556284 (+ 414us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:40:35.558329 (+ 2045us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:35.558333 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:35.558335 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:35.558594 (+ 259us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:35.558891 (+ 297us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:35.558896 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:35.558898 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:35.558982 (+ 84us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:35.559445 (+ 463us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:40:35.559448 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:40:35.559544 (+ 96us) client_negotiation.cc:769] Sending connection context
0808 04:40:35.560895 (+ 1351us) client_negotiation.cc:240] Negotiation successful
0808 04:40:35.561003 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":407,"mutex_wait_us":95,"thread_start_us":92,"threads_started":1}
I20260808 04:40:35.571171 21443 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
/tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164000593138-21443-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164000593138-21443-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164000593138-21443-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164000593138-21443-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.240.193:41911
--local_ip_for_outbound_sockets=127.20.240.193
--tserver_master_addrs=127.20.240.254:33559
--webserver_port=35149
--webserver_interface=127.20.240.193
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164000593138-21443-0/krb5kdc/oryx_127.20.240.193.keytab
--principal=oryx/127.20.240.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.240.212:39295
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.20.240.254:33559,127.20.240.253:34575
--tserver_master_addrs=127.20.240.254:33559,127.20.240.253:34575,127.20.240.252:39583 with env {KRB5CCNAME=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164000593138-21443-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164000593138-21443-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164000593138-21443-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 04:40:35.575385 28638 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:35.550670 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53552 (local address 127.20.240.253:34575)
0808 04:40:35.550804 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:35.550809 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:35.551441 (+ 632us) server_negotiation.cc:407] Connection header received
0808 04:40:35.551644 (+ 203us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:35.551650 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:35.551704 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:35.551775 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:35.565754 (+ 13979us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:35.567640 (+ 1886us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:35.568872 (+ 1232us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:35.569350 (+ 478us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:35.569479 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:35.571180 (+ 1701us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:40:35.571186 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:40:35.571191 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:40:35.571225 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:40:35.573178 (+ 1953us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:35.573732 (+ 554us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:35.573737 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:35.573740 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:35.573835 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:35.574173 (+ 338us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:35.574177 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:35.574178 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:35.574457 (+ 279us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:40:35.574537 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:35.574929 (+ 392us) server_negotiation.cc:299] Negotiation successful
0808 04:40:35.575094 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260808 04:40:35.575644 27917 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:35.550144 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49404 (local address 127.20.240.254:33559)
0808 04:40:35.550306 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:35.550312 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:35.551112 (+ 800us) server_negotiation.cc:407] Connection header received
0808 04:40:35.551360 (+ 248us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:35.551364 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:35.551424 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:35.551517 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:35.552240 (+ 723us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:35.553110 (+ 870us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:35.555150 (+ 2040us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:35.555489 (+ 339us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:35.555613 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:35.571217 (+ 15604us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:40:35.571221 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:40:35.571224 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:40:35.571259 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:40:35.573470 (+ 2211us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:35.573986 (+ 516us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:35.573990 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:35.573991 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:35.574084 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:35.574381 (+ 297us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:35.574385 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:35.574386 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:35.574603 (+ 217us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:40:35.574671 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:35.575350 (+ 679us) server_negotiation.cc:299] Negotiation successful
0808 04:40:35.575485 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260808 04:40:35.575867 28658 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:35.549993 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:33559 (local address 127.0.0.1:49404)
0808 04:40:35.550909 (+ 916us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:35.550928 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:35.551206 (+ 278us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:35.551662 (+ 456us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:35.551665 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:35.551946 (+ 281us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:40:35.552081 (+ 135us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:35.552089 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:35.553244 (+ 1155us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:35.553247 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:35.554410 (+ 1163us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:35.554422 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:35.555637 (+ 1215us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:35.555644 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:35.555731 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:35.570414 (+ 14683us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:40:35.570433 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:40:35.571026 (+ 593us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:40:35.573610 (+ 2584us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:35.573614 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:35.573616 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:35.573865 (+ 249us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:35.574192 (+ 327us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:35.574196 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:35.574198 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:35.574280 (+ 82us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:35.574742 (+ 462us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:40:35.574745 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:40:35.574847 (+ 102us) client_negotiation.cc:769] Sending connection context
0808 04:40:35.574941 (+ 94us) client_negotiation.cc:240] Negotiation successful
0808 04:40:35.575089 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":764,"mutex_wait_us":69,"thread_start_us":147,"threads_started":1}
I20260808 04:40:35.577450 28657 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:35.550550 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.253:34575 (local address 127.0.0.1:53552)
0808 04:40:35.551354 (+ 804us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:35.551370 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:35.551519 (+ 149us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:35.551919 (+ 400us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:35.551922 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:35.565386 (+ 13464us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:40:35.565561 (+ 175us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:35.565573 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:35.567797 (+ 2224us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:35.567800 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:35.568722 (+ 922us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:35.568732 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:35.569635 (+ 903us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:35.569641 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:35.569775 (+ 134us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:35.570343 (+ 568us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:40:35.570364 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:40:35.571010 (+ 646us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:40:35.573324 (+ 2314us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:35.573329 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:35.573333 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:35.573608 (+ 275us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:35.573954 (+ 346us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:35.573959 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:35.573963 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:35.574063 (+ 100us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:35.574615 (+ 552us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:40:35.574621 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:40:35.574736 (+ 115us) client_negotiation.cc:769] Sending connection context
0808 04:40:35.576757 (+ 2021us) client_negotiation.cc:240] Negotiation successful
0808 04:40:35.577110 (+ 353us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":725,"thread_start_us":133,"threads_started":1}
Aug 08 04:40:35 dist-test-slave-vxj2 krb5kdc[27829](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164034, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.240.254@KRBTEST.COM for oryx/127.20.240.252@KRBTEST.COM
I20260808 04:40:35.590868 28466 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:35.580354 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.252:39583 (local address 127.0.0.1:36994)
0808 04:40:35.580534 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:35.580553 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:35.580652 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:35.580991 (+ 339us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:35.580997 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:35.581273 (+ 276us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:40:35.581447 (+ 174us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:35.581456 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:35.582498 (+ 1042us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:35.582505 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:35.583532 (+ 1027us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:35.583547 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:35.584254 (+ 707us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:35.584260 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:35.584466 (+ 206us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:35.585070 (+ 604us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:40:35.585086 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:40:35.586871 (+ 1785us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:40:35.589079 (+ 2208us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:35.589083 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:35.589086 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:35.589392 (+ 306us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:35.589697 (+ 305us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:35.589700 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:35.589702 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:35.589804 (+ 102us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:35.590312 (+ 508us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:40:35.590316 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:40:35.590421 (+ 105us) client_negotiation.cc:769] Sending connection context
0808 04:40:35.590517 (+ 96us) client_negotiation.cc:240] Negotiation successful
0808 04:40:35.590682 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":67}
I20260808 04:40:35.591373 28637 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:35.580597 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36994 (local address 127.20.240.252:39583)
0808 04:40:35.580700 (+ 103us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:35.580705 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:35.580717 (+ 12us) server_negotiation.cc:407] Connection header received
0808 04:40:35.580792 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:35.580794 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:35.580860 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:35.580947 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:35.581583 (+ 636us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:35.582363 (+ 780us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:35.583687 (+ 1324us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:35.584112 (+ 425us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:35.584220 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:35.587126 (+ 2906us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:40:35.587130 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:40:35.587133 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:40:35.587164 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:40:35.588946 (+ 1782us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:35.589497 (+ 551us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:35.589501 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:35.589503 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:35.589594 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:35.589918 (+ 324us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:35.589921 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:35.589923 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:35.590161 (+ 238us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:40:35.590251 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:35.590657 (+ 406us) server_negotiation.cc:299] Negotiation successful
0808 04:40:35.590789 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260808 04:40:35.592778 27877 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.20.240.252:39583: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "a6c01c87c3a84bc7a009d59c7f7ee4c6"
member_type: NON_VOTER
last_known_addr {
host: "127.20.240.252"
port: 39583
}
attrs {
promote: true
}
}
dest_uuid: "2a361414698e49a880ae63c23c2991be"
cas_config_opid_index: 5
I20260808 04:40:35.593797 27877 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2a361414698e49a880ae63c23c2991be [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "2a361414698e49a880ae63c23c2991be" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 33559 } } peers { permanent_uuid: "9e743421bb6848248124d784dd3fe6ee" member_type: NON_VOTER last_known_addr { host: "127.20.240.253" port: 34575 } attrs { promote: true } } peers { permanent_uuid: "a6c01c87c3a84bc7a009d59c7f7ee4c6" member_type: NON_VOTER last_known_addr { host: "127.20.240.252" port: 39583 } attrs { promote: true } }
I20260808 04:40:35.594983 28469 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 2a361414698e49a880ae63c23c2991be [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER a6c01c87c3a84bc7a009d59c7f7ee4c6 (127.20.240.252) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "2a361414698e49a880ae63c23c2991be" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 33559 } } peers { permanent_uuid: "9e743421bb6848248124d784dd3fe6ee" member_type: NON_VOTER last_known_addr { host: "127.20.240.253" port: 34575 } attrs { promote: true } } peers { permanent_uuid: "a6c01c87c3a84bc7a009d59c7f7ee4c6" member_type: NON_VOTER last_known_addr { host: "127.20.240.252" port: 39583 } attrs { promote: true } } }
I20260808 04:40:35.595449 28608 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a6c01c87c3a84bc7a009d59c7f7ee4c6 [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:40:35.596470 28469 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.20.240.252:39583
I20260808 04:40:35.596644 28469 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2a361414698e49a880ae63c23c2991be [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "2a361414698e49a880ae63c23c2991be" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "2a361414698e49a880ae63c23c2991be" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 33559 } } peers { permanent_uuid: "9e743421bb6848248124d784dd3fe6ee" member_type: NON_VOTER last_known_addr { host: "127.20.240.253" port: 34575 } attrs { promote: true } } peers { permanent_uuid: "a6c01c87c3a84bc7a009d59c7f7ee4c6" member_type: NON_VOTER last_known_addr { host: "127.20.240.252" port: 39583 } attrs { promote: true } } }
I20260808 04:40:35.596731 28469 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2a361414698e49a880ae63c23c2991be [sys.catalog]: This master's current role is: LEADER
I20260808 04:40:35.596962 28608 raft_consensus.cc:1261] T 00000000000000000000000000000000 P a6c01c87c3a84bc7a009d59c7f7ee4c6 [term 1 FOLLOWER]: Refusing update from remote peer 2a361414698e49a880ae63c23c2991be: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260808 04:40:35.597698 28470 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 2a361414698e49a880ae63c23c2991be [LEADER]: Connected to new peer: Peer: permanent_uuid: "a6c01c87c3a84bc7a009d59c7f7ee4c6" member_type: NON_VOTER last_known_addr { host: "127.20.240.252" port: 39583 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 04:40:35.597801 28476 master.cc:537] Master@127.20.240.252:39583 shutting down...
I20260808 04:40:35.600266 28638 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:35.595268 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53568 (local address 127.20.240.253:34575)
0808 04:40:35.595455 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:35.595462 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:35.595620 (+ 158us) server_negotiation.cc:407] Connection header received
0808 04:40:35.595828 (+ 208us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:35.595832 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:35.595900 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:35.595999 (+ 99us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 04:40:35.596412 (+ 413us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:35.597229 (+ 817us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:35.598739 (+ 1510us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:35.599390 (+ 651us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:35.599497 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:35.599659 (+ 162us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:35.600059 (+ 400us) server_negotiation.cc:299] Negotiation successful
0808 04:40:35.600144 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":101}
I20260808 04:40:35.600652 28466 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:35.595019 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.253:34575 (local address 127.0.0.1:53568)
0808 04:40:35.595547 (+ 528us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:35.595563 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:35.595693 (+ 130us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:35.596169 (+ 476us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:35.596172 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:35.596188 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 04:40:35.596274 (+ 86us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:35.596279 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:35.597407 (+ 1128us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:35.597412 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:35.598586 (+ 1174us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:35.598601 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:35.599764 (+ 1163us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:35.599769 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:35.599873 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:35.599925 (+ 52us) client_negotiation.cc:769] Sending connection context
0808 04:40:35.600460 (+ 535us) client_negotiation.cc:240] Negotiation successful
0808 04:40:35.600546 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":458}
W20260808 04:40:35.601481 27862 consensus_peers.cc:487] T 00000000000000000000000000000000 P 2a361414698e49a880ae63c23c2991be -> Peer a6c01c87c3a84bc7a009d59c7f7ee4c6 (127.20.240.252:39583): Couldn't send request to peer a6c01c87c3a84bc7a009d59c7f7ee4c6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260808 04:40:35.601512 28521 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 9e743421bb6848248124d784dd3fe6ee [term 1 LEARNER]: Refusing update from remote peer 2a361414698e49a880ae63c23c2991be: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260808 04:40:35.602030 28470 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 2a361414698e49a880ae63c23c2991be [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e743421bb6848248124d784dd3fe6ee" member_type: NON_VOTER last_known_addr { host: "127.20.240.253" port: 34575 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260808 04:40:35.603943 28521 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 9e743421bb6848248124d784dd3fe6ee [term 1 LEARNER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER a6c01c87c3a84bc7a009d59c7f7ee4c6 (127.20.240.252) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "2a361414698e49a880ae63c23c2991be" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 33559 } } peers { permanent_uuid: "9e743421bb6848248124d784dd3fe6ee" member_type: NON_VOTER last_known_addr { host: "127.20.240.253" port: 34575 } attrs { promote: true } } peers { permanent_uuid: "a6c01c87c3a84bc7a009d59c7f7ee4c6" member_type: NON_VOTER last_known_addr { host: "127.20.240.252" port: 39583 } attrs { promote: true } } }
I20260808 04:40:35.605788 28553 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9e743421bb6848248124d784dd3fe6ee [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2a361414698e49a880ae63c23c2991be. Latest consensus state: current_term: 1 leader_uuid: "2a361414698e49a880ae63c23c2991be" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "2a361414698e49a880ae63c23c2991be" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 33559 } } peers { permanent_uuid: "9e743421bb6848248124d784dd3fe6ee" member_type: NON_VOTER last_known_addr { host: "127.20.240.253" port: 34575 } attrs { promote: true } } peers { permanent_uuid: "a6c01c87c3a84bc7a009d59c7f7ee4c6" member_type: NON_VOTER last_known_addr { host: "127.20.240.252" port: 39583 } attrs { promote: true } } }
I20260808 04:40:35.605916 28553 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9e743421bb6848248124d784dd3fe6ee [sys.catalog]: This master's current role is: LEARNER
I20260808 04:40:35.605996 28553 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9e743421bb6848248124d784dd3fe6ee [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "2a361414698e49a880ae63c23c2991be" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "2a361414698e49a880ae63c23c2991be" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 33559 } } peers { permanent_uuid: "9e743421bb6848248124d784dd3fe6ee" member_type: NON_VOTER last_known_addr { host: "127.20.240.253" port: 34575 } attrs { promote: true } } peers { permanent_uuid: "a6c01c87c3a84bc7a009d59c7f7ee4c6" member_type: NON_VOTER last_known_addr { host: "127.20.240.252" port: 39583 } attrs { promote: true } } }
I20260808 04:40:35.606091 28553 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9e743421bb6848248124d784dd3fe6ee [sys.catalog]: This master's current role is: LEARNER
I20260808 04:40:35.606544 28476 raft_consensus.cc:2229] T 00000000000000000000000000000000 P a6c01c87c3a84bc7a009d59c7f7ee4c6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 04:40:35.606830 28470 raft_consensus.cc:1050] T 00000000000000000000000000000000 P 2a361414698e49a880ae63c23c2991be: attempting to promote NON_VOTER 9e743421bb6848248124d784dd3fe6ee to VOTER
I20260808 04:40:35.607105 28476 raft_consensus.cc:2258] T 00000000000000000000000000000000 P a6c01c87c3a84bc7a009d59c7f7ee4c6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 04:40:35.607226 28476 tablet_replica.cc:330] T 00000000000000000000000000000000 P a6c01c87c3a84bc7a009d59c7f7ee4c6: stopping tablet replica
I20260808 04:40:35.607292 28470 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2a361414698e49a880ae63c23c2991be [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "2a361414698e49a880ae63c23c2991be" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 33559 } } peers { permanent_uuid: "9e743421bb6848248124d784dd3fe6ee" member_type: VOTER last_known_addr { host: "127.20.240.253" port: 34575 } attrs { promote: false } } peers { permanent_uuid: "a6c01c87c3a84bc7a009d59c7f7ee4c6" member_type: NON_VOTER last_known_addr { host: "127.20.240.252" port: 39583 } attrs { promote: true } }
I20260808 04:40:35.608793 28520 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 9e743421bb6848248124d784dd3fe6ee [term 1 LEARNER]: Refusing update from remote peer 2a361414698e49a880ae63c23c2991be: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
W20260808 04:40:35.609918 27862 consensus_peers.cc:487] T 00000000000000000000000000000000 P 2a361414698e49a880ae63c23c2991be -> Peer a6c01c87c3a84bc7a009d59c7f7ee4c6 (127.20.240.252:39583): Couldn't send request to peer a6c01c87c3a84bc7a009d59c7f7ee4c6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260808 04:40:35.610662 28663 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 2a361414698e49a880ae63c23c2991be [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e743421bb6848248124d784dd3fe6ee" member_type: VOTER last_known_addr { host: "127.20.240.253" port: 34575 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260808 04:40:35.613427 28476 master.cc:552] Master@127.20.240.252:39583 shutdown complete.
I20260808 04:40:35.613481 28476 master_runner.cc:305] Clearing existing system tablet
I20260808 04:40:35.613724 28476 fs_manager.cc:359] Metadata directory not provided
I20260808 04:40:35.613785 28476 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:40:35.615056 28476 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260808 04:40:35.615010 28469 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 2a361414698e49a880ae63c23c2991be [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, 9e743421bb6848248124d784dd3fe6ee (127.20.240.253) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "2a361414698e49a880ae63c23c2991be" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 33559 } } peers { permanent_uuid: "9e743421bb6848248124d784dd3fe6ee" member_type: VOTER last_known_addr { host: "127.20.240.253" port: 34575 } attrs { promote: false } } peers { permanent_uuid: "a6c01c87c3a84bc7a009d59c7f7ee4c6" member_type: NON_VOTER last_known_addr { host: "127.20.240.252" port: 39583 } attrs { promote: true } } }
I20260808 04:40:35.616539 28665 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:35.616663 28469 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2a361414698e49a880ae63c23c2991be [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "2a361414698e49a880ae63c23c2991be" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "2a361414698e49a880ae63c23c2991be" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 33559 } } peers { permanent_uuid: "9e743421bb6848248124d784dd3fe6ee" member_type: VOTER last_known_addr { host: "127.20.240.253" port: 34575 } attrs { promote: false } } peers { permanent_uuid: "a6c01c87c3a84bc7a009d59c7f7ee4c6" member_type: NON_VOTER last_known_addr { host: "127.20.240.252" port: 39583 } attrs { promote: true } } }
I20260808 04:40:35.616775 28469 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2a361414698e49a880ae63c23c2991be [sys.catalog]: This master's current role is: LEADER
I20260808 04:40:35.616753 28476 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164000593138-21443-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:40:35.616870 28476 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260808 04:40:35.616904 28476 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164000593138-21443-0/minicluster-data/master-2/data,/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164000593138-21443-0/minicluster-data/master-2/wal
uuid: "a6c01c87c3a84bc7a009d59c7f7ee4c6"
format_stamp: "Formatted at 2026-08-08 04:40:35 on dist-test-slave-vxj2"
server_key: "b3701c515dbb5d32ee69c7624f1aac2e"
server_key_iv: "cf6c80dd43a09b2fb12b84a55f18668e"
server_key_version: "encryptionkey@0"
I20260808 04:40:35.617446 28470 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2a361414698e49a880ae63c23c2991be [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "2a361414698e49a880ae63c23c2991be" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "2a361414698e49a880ae63c23c2991be" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 33559 } } peers { permanent_uuid: "9e743421bb6848248124d784dd3fe6ee" member_type: VOTER last_known_addr { host: "127.20.240.253" port: 34575 } attrs { promote: false } } peers { permanent_uuid: "a6c01c87c3a84bc7a009d59c7f7ee4c6" member_type: NON_VOTER last_known_addr { host: "127.20.240.252" port: 39583 } attrs { promote: true } } }
I20260808 04:40:35.617547 28470 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2a361414698e49a880ae63c23c2991be [sys.catalog]: This master's current role is: LEADER
I20260808 04:40:35.618259 28520 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 9e743421bb6848248124d784dd3fe6ee [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, 9e743421bb6848248124d784dd3fe6ee (127.20.240.253) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "2a361414698e49a880ae63c23c2991be" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 33559 } } peers { permanent_uuid: "9e743421bb6848248124d784dd3fe6ee" member_type: VOTER last_known_addr { host: "127.20.240.253" port: 34575 } attrs { promote: false } } peers { permanent_uuid: "a6c01c87c3a84bc7a009d59c7f7ee4c6" member_type: NON_VOTER last_known_addr { host: "127.20.240.252" port: 39583 } attrs { promote: true } } }
I20260808 04:40:35.618985 28476 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P a6c01c87c3a84bc7a009d59c7f7ee4c6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 04:40:35.620075 28553 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9e743421bb6848248124d784dd3fe6ee [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "2a361414698e49a880ae63c23c2991be" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "2a361414698e49a880ae63c23c2991be" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 33559 } } peers { permanent_uuid: "9e743421bb6848248124d784dd3fe6ee" member_type: VOTER last_known_addr { host: "127.20.240.253" port: 34575 } attrs { promote: false } } peers { permanent_uuid: "a6c01c87c3a84bc7a009d59c7f7ee4c6" member_type: NON_VOTER last_known_addr { host: "127.20.240.252" port: 39583 } attrs { promote: true } } }
I20260808 04:40:35.620193 28553 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9e743421bb6848248124d784dd3fe6ee [sys.catalog]: This master's current role is: FOLLOWER
I20260808 04:40:35.621968 28476 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P a6c01c87c3a84bc7a009d59c7f7ee4c6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260808 04:40:35.622110 28476 log.cc:1196] T 00000000000000000000000000000000 P a6c01c87c3a84bc7a009d59c7f7ee4c6: Deleting WAL directory at /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164000593138-21443-0/minicluster-data/master-2/wal/wals/00000000000000000000000000000000
I20260808 04:40:35.622431 28476 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P a6c01c87c3a84bc7a009d59c7f7ee4c6: Deleting consensus metadata
I20260808 04:40:35.622651 28476 master_runner.cc:315] Copying system tablet from 127.20.240.254:33559
I20260808 04:40:35.623888 28476 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P a6c01c87c3a84bc7a009d59c7f7ee4c6: tablet copy: Beginning tablet copy session from remote peer at address 127.20.240.254:33559
I20260808 04:40:35.633919 27917 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:35.624599 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49414 (local address 127.20.240.254:33559)
0808 04:40:35.624733 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:35.624738 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:35.624997 (+ 259us) server_negotiation.cc:407] Connection header received
0808 04:40:35.625118 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:35.625121 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:35.625200 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:35.625282 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:35.625902 (+ 620us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:35.626758 (+ 856us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:35.627958 (+ 1200us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:35.628294 (+ 336us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:35.628364 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:35.629928 (+ 1564us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:40:35.629932 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:40:35.629935 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:40:35.629962 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:40:35.631800 (+ 1838us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:35.632413 (+ 613us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:35.632417 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:35.632419 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:35.632509 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:35.632872 (+ 363us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:35.632875 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:35.632877 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:35.633114 (+ 237us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:40:35.633248 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:35.633593 (+ 345us) server_negotiation.cc:299] Negotiation successful
0808 04:40:35.633733 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260808 04:40:35.634728 28673 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:35.624586 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:33559 (local address 127.0.0.1:49414)
0808 04:40:35.624880 (+ 294us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:35.624895 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:35.625017 (+ 122us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:35.625423 (+ 406us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:35.625426 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:35.625650 (+ 224us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:40:35.625753 (+ 103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:35.625760 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:35.626910 (+ 1150us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:35.626914 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:35.627811 (+ 897us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:35.627832 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:35.628525 (+ 693us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:35.628528 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:35.628614 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:35.629281 (+ 667us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:40:35.629297 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:40:35.629750 (+ 453us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:40:35.631934 (+ 2184us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:35.631940 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:35.631943 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:35.632276 (+ 333us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:35.632623 (+ 347us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:35.632629 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:35.632633 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:35.632755 (+ 122us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:35.633294 (+ 539us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:40:35.633297 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:40:35.633403 (+ 106us) client_negotiation.cc:769] Sending connection context
0808 04:40:35.634345 (+ 942us) client_negotiation.cc:240] Negotiation successful
0808 04:40:35.634519 (+ 174us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":223,"thread_start_us":93,"threads_started":1}
I20260808 04:40:35.637527 27898 tablet_copy_service.cc:140] P 2a361414698e49a880ae63c23c2991be: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer a6c01c87c3a84bc7a009d59c7f7ee4c6 ({username='oryx', principal='oryx/127.20.240.252@KRBTEST.COM'} at 127.0.0.1:49414)
I20260808 04:40:35.637646 27898 tablet_copy_service.cc:161] P 2a361414698e49a880ae63c23c2991be: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer a6c01c87c3a84bc7a009d59c7f7ee4c6 at {username='oryx', principal='oryx/127.20.240.252@KRBTEST.COM'} at 127.0.0.1:49414: session id = a6c01c87c3a84bc7a009d59c7f7ee4c6-00000000000000000000000000000000
I20260808 04:40:35.638891 27898 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P 2a361414698e49a880ae63c23c2991be: Tablet Copy: opened 0 blocks and 1 log segments
I20260808 04:40:35.640457 28476 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260808 04:40:35.643069 28476 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P a6c01c87c3a84bc7a009d59c7f7ee4c6: tablet copy: Starting download of 0 data blocks...
I20260808 04:40:35.643353 28476 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P a6c01c87c3a84bc7a009d59c7f7ee4c6: tablet copy: Starting download of 1 WAL segments...
I20260808 04:40:35.644999 28476 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P a6c01c87c3a84bc7a009d59c7f7ee4c6: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260808 04:40:35.646883 27898 tablet_copy_service.cc:342] P 2a361414698e49a880ae63c23c2991be: Request end of tablet copy session a6c01c87c3a84bc7a009d59c7f7ee4c6-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.20.240.252@KRBTEST.COM'} at 127.0.0.1:49414
I20260808 04:40:35.646970 27898 tablet_copy_service.cc:433] P 2a361414698e49a880ae63c23c2991be: ending tablet copy session a6c01c87c3a84bc7a009d59c7f7ee4c6-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer a6c01c87c3a84bc7a009d59c7f7ee4c6
I20260808 04:40:35.655314 28476 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:40:35.657240 28677 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:40:35.657343 28674 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:40:35.657456 28675 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:40:35.658197 28218 heartbeater.cc:503] Master 127.20.240.254:33559 was elected leader, sending a full tablet report...
I20260808 04:40:35.661345 28476 server_base.cc:1034] running on GCE node
I20260808 04:40:35.661535 28476 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:40:35.661863 28476 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:40:35.663015 28476 hybrid_clock.cc:648] HybridClock initialized: now 1786164035662992 us; error 40 us; skew 500 ppm
Aug 08 04:40:35 dist-test-slave-vxj2 krb5kdc[27829](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164035, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.240.252@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:40:35.664675 28476 init.cc:377] Logged in from keytab as oryx/127.20.240.252@KRBTEST.COM (short username oryx)
I20260808 04:40:35.665220 28476 webserver.cc:460] Webserver started at http://127.20.240.252:44491/ using document root <none> and password file <none>
I20260808 04:40:35.665438 28476 fs_manager.cc:359] Metadata directory not provided
I20260808 04:40:35.665485 28476 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:40:35.666970 28476 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260808 04:40:35.668048 28684 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:35.668358 28476 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260808 04:40:35.668439 28476 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164000593138-21443-0/minicluster-data/master-2/data,/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164000593138-21443-0/minicluster-data/master-2/wal
uuid: "a6c01c87c3a84bc7a009d59c7f7ee4c6"
format_stamp: "Formatted at 2026-08-08 04:40:35 on dist-test-slave-vxj2"
server_key: "b3701c515dbb5d32ee69c7624f1aac2e"
server_key_iv: "cf6c80dd43a09b2fb12b84a55f18668e"
server_key_version: "encryptionkey@0"
I20260808 04:40:35.668531 28476 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164000593138-21443-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164000593138-21443-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164000593138-21443-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:40:35.680699 28476 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:40:35.683264 28476 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:40:35.688750 28476 rpc_server.cc:307] RPC server started. Bound to: 127.20.240.252:39583
I20260808 04:40:35.688786 28738 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.240.252:39583 every 8 connection(s)
I20260808 04:40:35.689432 28476 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164000593138-21443-0/minicluster-data/master-2/data/info.pb
I20260808 04:40:35.691332 28739 sys_catalog.cc:263] Verifying existing consensus state
I20260808 04:40:35.692530 28739 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a6c01c87c3a84bc7a009d59c7f7ee4c6: Bootstrap starting.
I20260808 04:40:35.706187 28739 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a6c01c87c3a84bc7a009d59c7f7ee4c6: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 04:40:35.706651 28739 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a6c01c87c3a84bc7a009d59c7f7ee4c6: Bootstrap complete.
I20260808 04:40:35.707372 28739 raft_consensus.cc:348] T 00000000000000000000000000000000 P a6c01c87c3a84bc7a009d59c7f7ee4c6 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "2a361414698e49a880ae63c23c2991be" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 33559 } } peers { permanent_uuid: "9e743421bb6848248124d784dd3fe6ee" member_type: VOTER last_known_addr { host: "127.20.240.253" port: 34575 } attrs { promote: false } } peers { permanent_uuid: "a6c01c87c3a84bc7a009d59c7f7ee4c6" member_type: NON_VOTER last_known_addr { host: "127.20.240.252" port: 39583 } attrs { promote: true } }
I20260808 04:40:35.707564 28739 raft_consensus.cc:729] T 00000000000000000000000000000000 P a6c01c87c3a84bc7a009d59c7f7ee4c6 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: a6c01c87c3a84bc7a009d59c7f7ee4c6, State: Initialized, Role: LEARNER
I20260808 04:40:35.707700 28739 consensus_queue.cc:260] T 00000000000000000000000000000000 P a6c01c87c3a84bc7a009d59c7f7ee4c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "2a361414698e49a880ae63c23c2991be" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 33559 } } peers { permanent_uuid: "9e743421bb6848248124d784dd3fe6ee" member_type: VOTER last_known_addr { host: "127.20.240.253" port: 34575 } attrs { promote: false } } peers { permanent_uuid: "a6c01c87c3a84bc7a009d59c7f7ee4c6" member_type: NON_VOTER last_known_addr { host: "127.20.240.252" port: 39583 } attrs { promote: true } }
I20260808 04:40:35.708166 28742 sys_catalog.cc:455] T 00000000000000000000000000000000 P a6c01c87c3a84bc7a009d59c7f7ee4c6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "2a361414698e49a880ae63c23c2991be" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 33559 } } peers { permanent_uuid: "9e743421bb6848248124d784dd3fe6ee" member_type: VOTER last_known_addr { host: "127.20.240.253" port: 34575 } attrs { promote: false } } peers { permanent_uuid: "a6c01c87c3a84bc7a009d59c7f7ee4c6" member_type: NON_VOTER last_known_addr { host: "127.20.240.252" port: 39583 } attrs { promote: true } } }
I20260808 04:40:35.708297 28739 sys_catalog.cc:564] T 00000000000000000000000000000000 P a6c01c87c3a84bc7a009d59c7f7ee4c6 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 04:40:35.708424 28742 sys_catalog.cc:458] T 00000000000000000000000000000000 P a6c01c87c3a84bc7a009d59c7f7ee4c6 [sys.catalog]: This master's current role is: LEARNER
I20260808 04:40:35.712594 28755 catalog_manager.cc:1259] Loaded cluster ID: b59e5a78215d4b33b7d72afd96aa3b8f
I20260808 04:40:35.712790 28755 catalog_manager.cc:1552] T 00000000000000000000000000000000 P a6c01c87c3a84bc7a009d59c7f7ee4c6: loading cluster ID for follower catalog manager: success
I20260808 04:40:35.715364 28755 catalog_manager.cc:1574] T 00000000000000000000000000000000 P a6c01c87c3a84bc7a009d59c7f7ee4c6: acquiring CA information for follower catalog manager: success
I20260808 04:40:35.717000 28755 catalog_manager.cc:1602] T 00000000000000000000000000000000 P a6c01c87c3a84bc7a009d59c7f7ee4c6: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20260808 04:40:35.726123 28660 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:40:35.726424 28660 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:40:35.726536 28660 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:40:35.731010 28660 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:40:35.731112 28660 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:40:35.731210 28660 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.240.193
I20260808 04:40:35.737035 28660 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.240.212:39295
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164000593138-21443-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164000593138-21443-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164000593138-21443-0/krb5kdc/oryx_127.20.240.193.keytab
--principal=oryx/127.20.240.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.240.193:41911
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164000593138-21443-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.240.193
--webserver_port=35149
--tserver_master_addrs=127.20.240.254:33559,127.20.240.253:34575,127.20.240.252:39583
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28660
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.240.193
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164000593138-21443-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 04:05:18 UTC on ccycloud.quasar-drfdgt.root.comops.site
build id 4574101
I20260808 04:40:35.738488 28660 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:40:35.739861 28660 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:40:35.750057 28761 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:40:35.750007 28763 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:40:35.750034 28760 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:40:35.750484 28660 server_base.cc:1034] running on GCE node
I20260808 04:40:35.750873 28660 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:40:35.751526 28660 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:40:35.752764 28660 hybrid_clock.cc:648] HybridClock initialized: now 1786164035752754 us; error 30 us; skew 500 ppm
Aug 08 04:40:35 dist-test-slave-vxj2 krb5kdc[27829](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164035, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.240.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:40:35.755914 28660 init.cc:377] Logged in from keytab as oryx/127.20.240.193@KRBTEST.COM (short username oryx)
I20260808 04:40:35.756970 28660 webserver.cc:460] Webserver started at http://127.20.240.193:35149/ using document root <none> and password file <none>
I20260808 04:40:35.757627 28660 fs_manager.cc:359] Metadata directory not provided
I20260808 04:40:35.757711 28660 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:40:35.761744 28660 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260808 04:40:35.764027 28770 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:35.765465 28660 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 04:40:35.765569 28660 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164000593138-21443-0/minicluster-data/ts-0/data,/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164000593138-21443-0/minicluster-data/ts-0/wal
uuid: "13451d5e45d9432c9a40de3584233526"
format_stamp: "Formatted at 2026-08-08 04:40:34 on dist-test-slave-vxj2"
server_key: "fd7b2fb11f0fb3c6eed81ba1b2a7a7cf"
server_key_iv: "97d5970936ed7610db16e87b529a45d2"
server_key_version: "encryptionkey@0"
I20260808 04:40:35.766148 28660 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164000593138-21443-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164000593138-21443-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164000593138-21443-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:40:35.792404 28660 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:40:35.795630 28660 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:40:35.795799 28660 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:40:35.796365 28660 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 04:40:35.797276 28660 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 04:40:35.797333 28660 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:35.797374 28660 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 04:40:35.797389 28660 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:35.807394 28660 rpc_server.cc:307] RPC server started. Bound to: 127.20.240.193:41911
I20260808 04:40:35.807413 28890 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.240.193:41911 every 8 connection(s)
I20260808 04:40:35.808465 28660 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164000593138-21443-0/minicluster-data/ts-0/data/info.pb
I20260808 04:40:35.813774 21443 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu as pid 28660
I20260808 04:40:35.814011 21443 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu with pid 28082
Aug 08 04:40:35 dist-test-slave-vxj2 krb5kdc[27829](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164035, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.240.193@KRBTEST.COM for oryx/127.20.240.252@KRBTEST.COM
Aug 08 04:40:35 dist-test-slave-vxj2 krb5kdc[27829](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164035, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.240.193@KRBTEST.COM for oryx/127.20.240.253@KRBTEST.COM
Aug 08 04:40:35 dist-test-slave-vxj2 krb5kdc[27829](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164035, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.240.193@KRBTEST.COM for oryx/127.20.240.254@KRBTEST.COM
I20260808 04:40:35.825466 21443 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
/tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164000593138-21443-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164000593138-21443-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164000593138-21443-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164000593138-21443-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.240.194:44761
--local_ip_for_outbound_sockets=127.20.240.194
--tserver_master_addrs=127.20.240.254:33559
--webserver_port=34987
--webserver_interface=127.20.240.194
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164000593138-21443-0/krb5kdc/oryx_127.20.240.194.keytab
--principal=oryx/127.20.240.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.240.212:39295
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.20.240.254:33559,127.20.240.253:34575
--tserver_master_addrs=127.20.240.254:33559,127.20.240.253:34575,127.20.240.252:39583 with env {KRB5CCNAME=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164000593138-21443-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164000593138-21443-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164000593138-21443-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 04:40:35.829216 28638 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:35.812974 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.240.193:52157 (local address 127.20.240.253:34575)
0808 04:40:35.813142 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:35.813170 (+ 28us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:35.813267 (+ 97us) server_negotiation.cc:407] Connection header received
0808 04:40:35.813902 (+ 635us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:35.813907 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:35.813971 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:35.814048 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:35.817085 (+ 3037us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:35.818021 (+ 936us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:35.820228 (+ 2207us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:35.820692 (+ 464us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:35.820807 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:35.824937 (+ 4130us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:40:35.824941 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:40:35.824945 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:40:35.824977 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:40:35.826752 (+ 1775us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:35.827393 (+ 641us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:35.827397 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:35.827399 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:35.827487 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:35.827851 (+ 364us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:35.827854 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:35.827857 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:35.828067 (+ 210us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:40:35.828177 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:35.828858 (+ 681us) server_negotiation.cc:299] Negotiation successful
0808 04:40:35.829003 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260808 04:40:35.830240 28900 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:35.813316 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.240.193:56393 (local address 127.20.240.252:39583)
0808 04:40:35.815041 (+ 1725us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:35.815056 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:35.815072 (+ 16us) server_negotiation.cc:407] Connection header received
0808 04:40:35.815118 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:35.815123 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:35.815177 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:35.815737 (+ 560us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:35.817087 (+ 1350us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:35.818207 (+ 1120us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:35.820201 (+ 1994us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:35.820617 (+ 416us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:35.822375 (+ 1758us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:35.824491 (+ 2116us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:40:35.824498 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:40:35.824501 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:40:35.824533 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:40:35.827031 (+ 2498us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:35.828418 (+ 1387us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:35.828421 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:35.828423 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:35.828519 (+ 96us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:35.828853 (+ 334us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:35.828856 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:35.828858 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:35.829089 (+ 231us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:40:35.829840 (+ 751us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:35.829935 (+ 95us) server_negotiation.cc:299] Negotiation successful
0808 04:40:35.830073 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1623,"thread_start_us":86,"threads_started":1}
I20260808 04:40:35.830415 27917 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:35.810579 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.240.193:58887 (local address 127.20.240.254:33559)
0808 04:40:35.810744 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:35.810747 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:35.812510 (+ 1763us) server_negotiation.cc:407] Connection header received
0808 04:40:35.813831 (+ 1321us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:35.813834 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:35.813947 (+ 113us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:35.814015 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:35.817095 (+ 3080us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:35.818004 (+ 909us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:35.820205 (+ 2201us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:35.820545 (+ 340us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:35.820626 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:35.826002 (+ 5376us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:40:35.826006 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:40:35.826009 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:40:35.826046 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:40:35.827882 (+ 1836us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:35.828806 (+ 924us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:35.828810 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:35.828812 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:35.828914 (+ 102us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:35.829274 (+ 360us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:35.829280 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:35.829285 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:35.829553 (+ 268us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:40:35.829634 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:35.830040 (+ 406us) server_negotiation.cc:299] Negotiation successful
0808 04:40:35.830194 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260808 04:40:35.831102 28899 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:35.813321 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.252:39583 (local address 127.20.240.193:56393)
0808 04:40:35.813566 (+ 245us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:35.813580 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:35.813663 (+ 83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:35.815321 (+ 1658us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:35.815324 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:35.815982 (+ 658us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:40:35.816908 (+ 926us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:35.816929 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:35.818326 (+ 1397us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:35.818330 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:35.820078 (+ 1748us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:35.820084 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:35.820797 (+ 713us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:35.820801 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:35.821106 (+ 305us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:35.822151 (+ 1045us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:40:35.822170 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:40:35.824200 (+ 2030us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:40:35.828025 (+ 3825us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:35.828030 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:35.828032 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:35.828293 (+ 261us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:35.828640 (+ 347us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:35.828643 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:35.828645 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:35.828731 (+ 86us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:35.829246 (+ 515us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:40:35.829250 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:40:35.829606 (+ 356us) client_negotiation.cc:769] Sending connection context
0808 04:40:35.829691 (+ 85us) client_negotiation.cc:240] Negotiation successful
0808 04:40:35.829919 (+ 228us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":179,"mutex_wait_us":563,"spinlock_wait_cycles":10240,"thread_start_us":91,"threads_started":1}
I20260808 04:40:35.831777 28898 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:35.812822 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.253:34575 (local address 127.20.240.193:52157)
0808 04:40:35.813147 (+ 325us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:35.813192 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:35.813576 (+ 384us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:35.815229 (+ 1653us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:35.815244 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:35.816044 (+ 800us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:40:35.816916 (+ 872us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:35.816931 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:35.818188 (+ 1257us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:35.818195 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:35.820076 (+ 1881us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:35.820090 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:35.820970 (+ 880us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:35.820976 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:35.821217 (+ 241us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:35.821910 (+ 693us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:40:35.821936 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:40:35.824755 (+ 2819us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:40:35.826903 (+ 2148us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:35.826910 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:35.826931 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:35.827278 (+ 347us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:35.827579 (+ 301us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:35.827583 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:35.827585 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:35.827735 (+ 150us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:35.828177 (+ 442us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:40:35.828186 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:40:35.828527 (+ 341us) client_negotiation.cc:769] Sending connection context
0808 04:40:35.829489 (+ 962us) client_negotiation.cc:240] Negotiation successful
0808 04:40:35.831586 (+ 2097us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":249,"mutex_wait_us":346,"spinlock_wait_cycles":24192,"thread_start_us":125,"threads_started":1}
I20260808 04:40:35.831864 28895 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:35.811141 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:33559 (local address 127.20.240.193:58887)
0808 04:40:35.812321 (+ 1180us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:35.812371 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:35.813569 (+ 1198us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:35.815321 (+ 1752us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:35.815324 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:35.815982 (+ 658us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:40:35.816908 (+ 926us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:35.816929 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:35.818182 (+ 1253us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:35.818185 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:35.820044 (+ 1859us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:35.820059 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:35.820797 (+ 738us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:35.820801 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:35.821135 (+ 334us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:35.822039 (+ 904us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:40:35.822056 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:40:35.825087 (+ 3031us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:40:35.828428 (+ 3341us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:35.828431 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:35.828433 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:35.828683 (+ 250us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:35.829034 (+ 351us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:35.829040 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:35.829045 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:35.829135 (+ 90us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:35.829713 (+ 578us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:40:35.829718 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:40:35.829826 (+ 108us) client_negotiation.cc:769] Sending connection context
0808 04:40:35.830649 (+ 823us) client_negotiation.cc:240] Negotiation successful
0808 04:40:35.830826 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":909,"mutex_wait_us":703,"spinlock_wait_cycles":2432,"thread_start_us":753,"threads_started":1}
I20260808 04:40:35.832928 28891 heartbeater.cc:347] Connected to a master server at 127.20.240.252:39583
I20260808 04:40:35.833038 28892 heartbeater.cc:347] Connected to a master server at 127.20.240.254:33559
I20260808 04:40:35.833210 28891 heartbeater.cc:464] Registering TS with master...
I20260808 04:40:35.833233 28893 heartbeater.cc:347] Connected to a master server at 127.20.240.253:34575
I20260808 04:40:35.833210 28892 heartbeater.cc:464] Registering TS with master...
I20260808 04:40:35.833359 28893 heartbeater.cc:464] Registering TS with master...
I20260808 04:40:35.833930 28892 heartbeater.cc:511] Master 127.20.240.254:33559 requested a full tablet report, sending...
I20260808 04:40:35.833927 28893 heartbeater.cc:511] Master 127.20.240.253:34575 requested a full tablet report, sending...
I20260808 04:40:35.833927 28891 heartbeater.cc:511] Master 127.20.240.252:39583 requested a full tablet report, sending...
I20260808 04:40:35.835515 27877 ts_manager.cc:194] Re-registered known tserver with Master: 13451d5e45d9432c9a40de3584233526 (127.20.240.193:41911)
I20260808 04:40:35.835856 28511 ts_manager.cc:194] Registered new tserver with Master: 13451d5e45d9432c9a40de3584233526 (127.20.240.193:41911)
I20260808 04:40:35.835856 28695 ts_manager.cc:194] Registered new tserver with Master: 13451d5e45d9432c9a40de3584233526 (127.20.240.193:41911)
I20260808 04:40:35.836439 27877 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.20.240.193@KRBTEST.COM'} at 127.20.240.193:58887
I20260808 04:40:35.900122 28362 heartbeater.cc:503] Master 127.20.240.254:33559 was elected leader, sending a full tablet report...
W20260808 04:40:35.944761 28901 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:40:35.945026 28901 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:40:35.945073 28901 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:40:35.949083 28901 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:40:35.949167 28901 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:40:35.949227 28901 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.240.194
I20260808 04:40:35.954481 28901 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.240.212:39295
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164000593138-21443-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164000593138-21443-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164000593138-21443-0/krb5kdc/oryx_127.20.240.194.keytab
--principal=oryx/127.20.240.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.240.194:44761
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164000593138-21443-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.240.194
--webserver_port=34987
--tserver_master_addrs=127.20.240.254:33559,127.20.240.253:34575,127.20.240.252:39583
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28901
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.240.194
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164000593138-21443-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 04:05:18 UTC on ccycloud.quasar-drfdgt.root.comops.site
build id 4574101
I20260808 04:40:35.955530 28901 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:40:35.956532 28901 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:40:35.966428 28907 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:40:35.966434 28910 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:40:35.966511 28908 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:40:35.966725 28901 server_base.cc:1034] running on GCE node
I20260808 04:40:35.967203 28901 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:40:35.967865 28901 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:40:35.969031 28901 hybrid_clock.cc:648] HybridClock initialized: now 1786164035969012 us; error 49 us; skew 500 ppm
Aug 08 04:40:35 dist-test-slave-vxj2 krb5kdc[27829](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164035, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.240.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:40:35.972317 28901 init.cc:377] Logged in from keytab as oryx/127.20.240.194@KRBTEST.COM (short username oryx)
I20260808 04:40:35.973376 28901 webserver.cc:460] Webserver started at http://127.20.240.194:34987/ using document root <none> and password file <none>
I20260808 04:40:35.974006 28901 fs_manager.cc:359] Metadata directory not provided
I20260808 04:40:35.974126 28901 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:40:35.978307 28901 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.001s sys 0.003s
I20260808 04:40:35.980509 28918 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:35.981941 28901 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260808 04:40:35.982089 28901 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164000593138-21443-0/minicluster-data/ts-1/data,/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164000593138-21443-0/minicluster-data/ts-1/wal
uuid: "6135fa034b434540bf65da8cedaf4de2"
format_stamp: "Formatted at 2026-08-08 04:40:34 on dist-test-slave-vxj2"
server_key: "05db60b0554c06893040f455c3b8ccaf"
server_key_iv: "f0af44339c50f4e91799aa245fd0b526"
server_key_version: "encryptionkey@0"
I20260808 04:40:35.982666 28901 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164000593138-21443-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164000593138-21443-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164000593138-21443-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:40:35.996454 28901 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:40:36.000000 28901 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:40:36.000228 28901 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:40:36.000867 28901 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 04:40:36.001842 28901 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 04:40:36.001924 28901 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:36.002017 28901 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 04:40:36.002069 28901 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:36.012647 28901 rpc_server.cc:307] RPC server started. Bound to: 127.20.240.194:44761
I20260808 04:40:36.012672 29033 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.240.194:44761 every 8 connection(s)
I20260808 04:40:36.013857 28901 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164000593138-21443-0/minicluster-data/ts-1/data/info.pb
I20260808 04:40:36.023846 21443 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu as pid 28901
I20260808 04:40:36.024062 21443 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu with pid 28224
Aug 08 04:40:36 dist-test-slave-vxj2 krb5kdc[27829](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164035, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.240.194@KRBTEST.COM for oryx/127.20.240.252@KRBTEST.COM
Aug 08 04:40:36 dist-test-slave-vxj2 krb5kdc[27829](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164035, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.240.194@KRBTEST.COM for oryx/127.20.240.254@KRBTEST.COM
Aug 08 04:40:36 dist-test-slave-vxj2 krb5kdc[27829](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164035, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.240.194@KRBTEST.COM for oryx/127.20.240.253@KRBTEST.COM
I20260808 04:40:36.033470 28900 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:36.018161 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.240.194:32799 (local address 127.20.240.252:39583)
0808 04:40:36.018299 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:36.018306 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:36.018323 (+ 17us) server_negotiation.cc:407] Connection header received
0808 04:40:36.018601 (+ 278us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:36.018604 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:36.018662 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:36.018718 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:36.020494 (+ 1776us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:36.021374 (+ 880us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:36.022809 (+ 1435us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:36.023177 (+ 368us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:36.023260 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:36.028004 (+ 4744us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:40:36.028008 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:40:36.028011 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:40:36.028045 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:40:36.030450 (+ 2405us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:36.031308 (+ 858us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:36.031311 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:36.031313 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:36.031414 (+ 101us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:36.031912 (+ 498us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:36.031916 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:36.031917 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:36.032161 (+ 244us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:40:36.032238 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:36.033108 (+ 870us) server_negotiation.cc:299] Negotiation successful
0808 04:40:36.033289 (+ 181us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260808 04:40:36.033470 27917 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:36.015715 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.240.194:35807 (local address 127.20.240.254:33559)
0808 04:40:36.015889 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:36.015895 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:36.017266 (+ 1371us) server_negotiation.cc:407] Connection header received
0808 04:40:36.018601 (+ 1335us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:36.018604 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:36.018662 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:36.018718 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:36.020494 (+ 1776us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:36.021374 (+ 880us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:36.022824 (+ 1450us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:36.023191 (+ 367us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:36.023264 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:36.028447 (+ 5183us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:40:36.028452 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:40:36.028456 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:40:36.028494 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:40:36.030400 (+ 1906us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:36.031317 (+ 917us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:36.031322 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:36.031323 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:36.031414 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:36.031912 (+ 498us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:36.031916 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:36.031917 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:36.032161 (+ 244us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:40:36.032238 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:36.033108 (+ 870us) server_negotiation.cc:299] Negotiation successful
0808 04:40:36.033295 (+ 187us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260808 04:40:36.035379 29039 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:36.016121 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:33559 (local address 127.20.240.194:35807)
0808 04:40:36.017079 (+ 958us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:36.017124 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:36.018332 (+ 1208us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:36.018913 (+ 581us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:36.018922 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:36.019538 (+ 616us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:40:36.020333 (+ 795us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:36.020343 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:36.021528 (+ 1185us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:36.021531 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:36.022660 (+ 1129us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:36.022671 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:36.023452 (+ 781us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:36.023455 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:36.023679 (+ 224us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:36.025207 (+ 1528us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:40:36.025237 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:40:36.028223 (+ 2986us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:40:36.030570 (+ 2347us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:36.030579 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:36.030603 (+ 24us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:36.031173 (+ 570us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:36.031538 (+ 365us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:36.031541 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:36.031544 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:36.031789 (+ 245us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:36.032335 (+ 546us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:40:36.032342 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:40:36.032783 (+ 441us) client_negotiation.cc:769] Sending connection context
0808 04:40:36.033725 (+ 942us) client_negotiation.cc:240] Negotiation successful
0808 04:40:36.034133 (+ 408us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":763,"mutex_wait_us":414,"spinlock_wait_cycles":48256,"thread_start_us":550,"threads_started":1}
I20260808 04:40:36.035377 29041 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:36.017902 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.252:39583 (local address 127.20.240.194:32799)
0808 04:40:36.018157 (+ 255us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:36.018169 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:36.018332 (+ 163us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:36.018913 (+ 581us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:36.018922 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:36.019538 (+ 616us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:40:36.020333 (+ 795us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:36.020343 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:36.021528 (+ 1185us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:36.021531 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:36.022663 (+ 1132us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:36.022671 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:36.023433 (+ 762us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:36.023439 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:36.023675 (+ 236us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:36.025207 (+ 1532us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:40:36.025242 (+ 35us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:40:36.027747 (+ 2505us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:40:36.030570 (+ 2823us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:36.030579 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:36.030603 (+ 24us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:36.031173 (+ 570us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:36.031538 (+ 365us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:36.031541 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:36.031544 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:36.031789 (+ 245us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:36.032335 (+ 546us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:40:36.032342 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:40:36.032784 (+ 442us) client_negotiation.cc:769] Sending connection context
0808 04:40:36.034077 (+ 1293us) client_negotiation.cc:240] Negotiation successful
0808 04:40:36.034195 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":197,"mutex_wait_us":465,"spinlock_wait_cycles":57728,"thread_start_us":102,"threads_started":1}
I20260808 04:40:36.036846 29035 heartbeater.cc:347] Connected to a master server at 127.20.240.254:33559
I20260808 04:40:36.037130 29035 heartbeater.cc:464] Registering TS with master...
I20260808 04:40:36.037431 29034 heartbeater.cc:347] Connected to a master server at 127.20.240.252:39583
I20260808 04:40:36.037518 29034 heartbeater.cc:464] Registering TS with master...
I20260808 04:40:36.037796 29035 heartbeater.cc:511] Master 127.20.240.254:33559 requested a full tablet report, sending...
I20260808 04:40:36.037796 29034 heartbeater.cc:511] Master 127.20.240.252:39583 requested a full tablet report, sending...
I20260808 04:40:36.038777 29040 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:36.017553 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.253:34575 (local address 127.20.240.194:60297)
0808 04:40:36.017832 (+ 279us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:36.017847 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:36.018330 (+ 483us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:36.018911 (+ 581us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:36.018921 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:36.019538 (+ 617us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:40:36.020319 (+ 781us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:36.020334 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:36.021372 (+ 1038us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:36.021376 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:36.022298 (+ 922us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:36.022307 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:36.022836 (+ 529us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:36.022839 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:36.023026 (+ 187us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:36.031027 (+ 8001us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:40:36.031052 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:40:36.033945 (+ 2893us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:40:36.036651 (+ 2706us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:36.036654 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:36.036657 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:36.037023 (+ 366us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:36.037463 (+ 440us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:36.037466 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:36.037468 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:36.037653 (+ 185us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:36.038202 (+ 549us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:40:36.038205 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:40:36.038308 (+ 103us) client_negotiation.cc:769] Sending connection context
0808 04:40:36.038427 (+ 119us) client_negotiation.cc:240] Negotiation successful
0808 04:40:36.038589 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":197,"mutex_wait_us":156,"thread_start_us":97,"threads_started":1}
I20260808 04:40:36.039088 27877 ts_manager.cc:194] Re-registered known tserver with Master: 6135fa034b434540bf65da8cedaf4de2 (127.20.240.194:44761)
I20260808 04:40:36.039242 28638 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:36.017800 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.240.194:60297 (local address 127.20.240.253:34575)
0808 04:40:36.017925 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:36.017930 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:36.017945 (+ 15us) server_negotiation.cc:407] Connection header received
0808 04:40:36.018559 (+ 614us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:36.018563 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:36.018624 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:36.018726 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:36.020496 (+ 1770us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:36.021209 (+ 713us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:36.022430 (+ 1221us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:36.022673 (+ 243us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:36.022790 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:36.034181 (+ 11391us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:40:36.034188 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:40:36.034195 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:40:36.034240 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:40:36.036508 (+ 2268us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:36.037176 (+ 668us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:36.037180 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:36.037182 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:36.037346 (+ 164us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:36.037789 (+ 443us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:36.037793 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:36.037795 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:36.038084 (+ 289us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:40:36.038213 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:36.038967 (+ 754us) server_negotiation.cc:299] Negotiation successful
0808 04:40:36.039097 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260808 04:40:36.039736 27877 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.20.240.194@KRBTEST.COM'} at 127.20.240.194:35807
I20260808 04:40:36.041043 28695 ts_manager.cc:194] Registered new tserver with Master: 6135fa034b434540bf65da8cedaf4de2 (127.20.240.194:44761)
I20260808 04:40:36.041383 29037 heartbeater.cc:347] Connected to a master server at 127.20.240.253:34575
I20260808 04:40:36.041501 29037 heartbeater.cc:464] Registering TS with master...
I20260808 04:40:36.041693 29037 heartbeater.cc:511] Master 127.20.240.253:34575 requested a full tablet report, sending...
I20260808 04:40:36.042495 28511 ts_manager.cc:194] Registered new tserver with Master: 6135fa034b434540bf65da8cedaf4de2 (127.20.240.194:44761)
I20260808 04:40:36.043459 21443 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
/tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164000593138-21443-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164000593138-21443-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164000593138-21443-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164000593138-21443-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.240.195:45885
--local_ip_for_outbound_sockets=127.20.240.195
--tserver_master_addrs=127.20.240.254:33559
--webserver_port=44127
--webserver_interface=127.20.240.195
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164000593138-21443-0/krb5kdc/oryx_127.20.240.195.keytab
--principal=oryx/127.20.240.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.240.212:39295
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.20.240.254:33559,127.20.240.253:34575
--tserver_master_addrs=127.20.240.254:33559,127.20.240.253:34575,127.20.240.252:39583 with env {KRB5CCNAME=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164000593138-21443-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164000593138-21443-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164000593138-21443-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 04:40:36.145292 28900 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:36.141114 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37000 (local address 127.20.240.252:39583)
0808 04:40:36.141288 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:36.141293 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:36.141442 (+ 149us) server_negotiation.cc:407] Connection header received
0808 04:40:36.141567 (+ 125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:36.141570 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:36.141641 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:36.141762 (+ 121us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 04:40:36.142093 (+ 331us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:36.142885 (+ 792us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:36.143971 (+ 1086us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:36.144643 (+ 672us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:36.144770 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:36.144935 (+ 165us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:36.145037 (+ 102us) server_negotiation.cc:299] Negotiation successful
0808 04:40:36.145117 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260808 04:40:36.145313 29043 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:36.140959 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.252:39583 (local address 127.0.0.1:37000)
0808 04:40:36.141349 (+ 390us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:36.141362 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:36.141467 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:36.141797 (+ 330us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:36.141803 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:36.141832 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 04:40:36.141958 (+ 126us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:36.141968 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:36.143025 (+ 1057us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:36.143028 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:36.143829 (+ 801us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:36.143839 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:36.144803 (+ 964us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:36.144806 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:36.144891 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:36.144915 (+ 24us) client_negotiation.cc:769] Sending connection context
0808 04:40:36.145019 (+ 104us) client_negotiation.cc:240] Negotiation successful
0808 04:40:36.145092 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":324,"thread_start_us":86,"threads_started":1}
I20260808 04:40:36.146196 28703 raft_consensus.cc:1203] T 00000000000000000000000000000000 P a6c01c87c3a84bc7a009d59c7f7ee4c6 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.6->[1.7-1.7] Dedup: 1.7->[]
I20260808 04:40:36.146737 28742 sys_catalog.cc:455] T 00000000000000000000000000000000 P a6c01c87c3a84bc7a009d59c7f7ee4c6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2a361414698e49a880ae63c23c2991be. Latest consensus state: current_term: 1 leader_uuid: "2a361414698e49a880ae63c23c2991be" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "2a361414698e49a880ae63c23c2991be" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 33559 } } peers { permanent_uuid: "9e743421bb6848248124d784dd3fe6ee" member_type: VOTER last_known_addr { host: "127.20.240.253" port: 34575 } attrs { promote: false } } peers { permanent_uuid: "a6c01c87c3a84bc7a009d59c7f7ee4c6" member_type: NON_VOTER last_known_addr { host: "127.20.240.252" port: 39583 } attrs { promote: true } } }
I20260808 04:40:36.146891 28742 sys_catalog.cc:458] T 00000000000000000000000000000000 P a6c01c87c3a84bc7a009d59c7f7ee4c6 [sys.catalog]: This master's current role is: LEARNER
W20260808 04:40:36.161396 29042 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:40:36.161697 29042 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:40:36.161746 29042 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:40:36.165875 29042 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:40:36.165951 29042 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:40:36.166013 29042 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.240.195
I20260808 04:40:36.171814 29042 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.240.212:39295
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164000593138-21443-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164000593138-21443-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164000593138-21443-0/krb5kdc/oryx_127.20.240.195.keytab
--principal=oryx/127.20.240.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.240.195:45885
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164000593138-21443-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.240.195
--webserver_port=44127
--tserver_master_addrs=127.20.240.254:33559,127.20.240.253:34575,127.20.240.252:39583
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29042
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.240.195
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164000593138-21443-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 04:05:18 UTC on ccycloud.quasar-drfdgt.root.comops.site
build id 4574101
I20260808 04:40:36.172974 29042 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:40:36.174204 29042 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:40:36.184491 29054 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:40:36.184491 29052 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:40:36.184988 29042 server_base.cc:1034] running on GCE node
W20260808 04:40:36.184545 29051 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:40:36.185549 29042 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:40:36.186519 29042 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:40:36.187693 29042 hybrid_clock.cc:648] HybridClock initialized: now 1786164036187680 us; error 26 us; skew 500 ppm
Aug 08 04:40:36 dist-test-slave-vxj2 krb5kdc[27829](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164036, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.240.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:40:36.190737 29042 init.cc:377] Logged in from keytab as oryx/127.20.240.195@KRBTEST.COM (short username oryx)
I20260808 04:40:36.191713 29042 webserver.cc:460] Webserver started at http://127.20.240.195:44127/ using document root <none> and password file <none>
I20260808 04:40:36.192322 29042 fs_manager.cc:359] Metadata directory not provided
I20260808 04:40:36.192441 29042 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:40:36.196660 29042 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.000s
I20260808 04:40:36.199033 29062 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:36.200443 29042 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260808 04:40:36.200608 29042 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164000593138-21443-0/minicluster-data/ts-2/data,/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164000593138-21443-0/minicluster-data/ts-2/wal
uuid: "a19d6220e3f74533a788ce03b62f1944"
format_stamp: "Formatted at 2026-08-08 04:40:34 on dist-test-slave-vxj2"
server_key: "deaf53147962a24c387c185d3c5b1a40"
server_key_iv: "d32a29ba7a86c6cb215387fd2398b6b5"
server_key_version: "encryptionkey@0"
I20260808 04:40:36.201349 29042 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164000593138-21443-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164000593138-21443-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164000593138-21443-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:40:36.224174 29042 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:40:36.227824 29042 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:40:36.228070 29042 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:40:36.228731 29042 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 04:40:36.229737 29042 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 04:40:36.229812 29042 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:36.229933 29042 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 04:40:36.229980 29042 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:36.239966 29042 rpc_server.cc:307] RPC server started. Bound to: 127.20.240.195:45885
I20260808 04:40:36.240017 29180 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.240.195:45885 every 8 connection(s)
I20260808 04:40:36.241143 29042 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164000593138-21443-0/minicluster-data/ts-2/data/info.pb
I20260808 04:40:36.250844 21443 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu as pid 29042
Aug 08 04:40:36 dist-test-slave-vxj2 krb5kdc[27829](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164036, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.240.195@KRBTEST.COM for oryx/127.20.240.253@KRBTEST.COM
Aug 08 04:40:36 dist-test-slave-vxj2 krb5kdc[27829](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164036, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.240.195@KRBTEST.COM for oryx/127.20.240.252@KRBTEST.COM
Aug 08 04:40:36 dist-test-slave-vxj2 krb5kdc[27829](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164036, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.240.195@KRBTEST.COM for oryx/127.20.240.254@KRBTEST.COM
I20260808 04:40:36.259586 28900 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:36.245102 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.240.195:35859 (local address 127.20.240.252:39583)
0808 04:40:36.245285 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:36.245292 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:36.245380 (+ 88us) server_negotiation.cc:407] Connection header received
0808 04:40:36.246253 (+ 873us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:36.246257 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:36.246319 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:36.246413 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:36.247822 (+ 1409us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:36.248638 (+ 816us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:36.250127 (+ 1489us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:36.250389 (+ 262us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:36.250491 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:36.254761 (+ 4270us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:40:36.254766 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:40:36.254769 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:40:36.254801 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:40:36.256833 (+ 2032us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:36.257595 (+ 762us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:36.257599 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:36.257601 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:36.257694 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:36.258152 (+ 458us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:36.258156 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:36.258158 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:36.258402 (+ 244us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:40:36.258510 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:36.259247 (+ 737us) server_negotiation.cc:299] Negotiation successful
0808 04:40:36.259412 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":92}
I20260808 04:40:36.259677 28638 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:36.243177 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.240.195:47489 (local address 127.20.240.253:34575)
0808 04:40:36.243364 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:36.243369 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:36.244705 (+ 1336us) server_negotiation.cc:407] Connection header received
0808 04:40:36.246134 (+ 1429us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:36.246138 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:36.246243 (+ 105us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:36.246359 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:36.247817 (+ 1458us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:36.248413 (+ 596us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:36.250434 (+ 2021us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:36.250731 (+ 297us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:36.250848 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:36.254944 (+ 4096us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:40:36.254947 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:40:36.254950 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:40:36.254978 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:40:36.257688 (+ 2710us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:36.258257 (+ 569us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:36.258260 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:36.258261 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:36.258366 (+ 105us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:36.258715 (+ 349us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:36.258719 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:36.258720 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:36.258940 (+ 220us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:40:36.259015 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:36.259412 (+ 397us) server_negotiation.cc:299] Negotiation successful
0808 04:40:36.259527 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":92}
I20260808 04:40:36.260809 29187 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:36.244959 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.252:39583 (local address 127.20.240.195:35859)
0808 04:40:36.245287 (+ 328us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:36.245303 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:36.245912 (+ 609us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:36.246567 (+ 655us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:36.246577 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:36.247078 (+ 501us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:40:36.247669 (+ 591us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:36.247676 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:36.248753 (+ 1077us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:36.248756 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:36.249983 (+ 1227us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:36.249992 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:36.250575 (+ 583us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:36.250581 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:36.250818 (+ 237us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:36.251510 (+ 692us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:40:36.251536 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:40:36.254520 (+ 2984us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:40:36.256960 (+ 2440us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:36.256969 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:36.256993 (+ 24us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:36.257469 (+ 476us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:36.257808 (+ 339us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:36.257812 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:36.257814 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:36.258030 (+ 216us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:36.258579 (+ 549us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:40:36.258587 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:40:36.258957 (+ 370us) client_negotiation.cc:769] Sending connection context
0808 04:40:36.259181 (+ 224us) client_negotiation.cc:240] Negotiation successful
0808 04:40:36.259564 (+ 383us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":253,"mutex_wait_us":217,"spinlock_wait_cycles":11392,"thread_start_us":105,"threads_started":1}
I20260808 04:40:36.261055 29186 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:36.243557 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.253:34575 (local address 127.20.240.195:47489)
0808 04:40:36.244521 (+ 964us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:36.244568 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:36.245883 (+ 1315us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:36.246567 (+ 684us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:36.246575 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:36.247075 (+ 500us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:40:36.247655 (+ 580us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:36.247670 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:36.248573 (+ 903us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:36.248577 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:36.250278 (+ 1701us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:36.250290 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:36.250862 (+ 572us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:36.250866 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:36.251014 (+ 148us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:36.251662 (+ 648us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:40:36.251676 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:40:36.254769 (+ 3093us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:40:36.257795 (+ 3026us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:36.257798 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:36.257799 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:36.258147 (+ 348us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:36.258483 (+ 336us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:36.258486 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:36.258488 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:36.258604 (+ 116us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:36.259078 (+ 474us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:40:36.259081 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:40:36.259209 (+ 128us) client_negotiation.cc:769] Sending connection context
0808 04:40:36.259801 (+ 592us) client_negotiation.cc:240] Negotiation successful
0808 04:40:36.259993 (+ 192us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":753,"mutex_wait_us":268,"spinlock_wait_cycles":8704,"thread_start_us":578,"threads_started":1}
I20260808 04:40:36.261101 27917 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:36.245550 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.240.195:50877 (local address 127.20.240.254:33559)
0808 04:40:36.245674 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:36.245678 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:36.245695 (+ 17us) server_negotiation.cc:407] Connection header received
0808 04:40:36.246164 (+ 469us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:36.246168 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:36.246234 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:36.246290 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:36.247830 (+ 1540us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:36.248638 (+ 808us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:36.251095 (+ 2457us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:36.251928 (+ 833us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:36.252045 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:36.254942 (+ 2897us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:40:36.254946 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:40:36.254949 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:40:36.254978 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:40:36.257622 (+ 2644us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:36.258253 (+ 631us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:36.258256 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:36.258258 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:36.258366 (+ 108us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:36.258715 (+ 349us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:36.258718 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:36.258720 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:36.258933 (+ 213us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:40:36.259010 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:36.260508 (+ 1498us) server_negotiation.cc:299] Negotiation successful
0808 04:40:36.260910 (+ 402us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260808 04:40:36.262224 29181 heartbeater.cc:347] Connected to a master server at 127.20.240.252:39583
I20260808 04:40:36.262313 29184 heartbeater.cc:347] Connected to a master server at 127.20.240.253:34575
I20260808 04:40:36.262482 29184 heartbeater.cc:464] Registering TS with master...
I20260808 04:40:36.262485 29181 heartbeater.cc:464] Registering TS with master...
I20260808 04:40:36.263161 29184 heartbeater.cc:511] Master 127.20.240.253:34575 requested a full tablet report, sending...
I20260808 04:40:36.263161 29181 heartbeater.cc:511] Master 127.20.240.252:39583 requested a full tablet report, sending...
I20260808 04:40:36.264060 29188 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:36.245401 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:33559 (local address 127.20.240.195:50877)
0808 04:40:36.245626 (+ 225us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:36.245638 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:36.245912 (+ 274us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:36.246568 (+ 656us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:36.246577 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:36.247078 (+ 501us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:40:36.247667 (+ 589us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:36.247676 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:36.248912 (+ 1236us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:36.248915 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:36.250278 (+ 1363us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:36.250290 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:36.252183 (+ 1893us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:36.252186 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:36.252302 (+ 116us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:36.252792 (+ 490us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:40:36.252813 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:40:36.254770 (+ 1957us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:40:36.257781 (+ 3011us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:36.257785 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:36.257787 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:36.258128 (+ 341us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:36.258483 (+ 355us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:36.258486 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:36.258488 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:36.258610 (+ 122us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:36.259078 (+ 468us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:40:36.259081 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:40:36.260293 (+ 1212us) client_negotiation.cc:769] Sending connection context
0808 04:40:36.262193 (+ 1900us) client_negotiation.cc:240] Negotiation successful
0808 04:40:36.263884 (+ 1691us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":155,"mutex_wait_us":1526,"spinlock_wait_cycles":43520,"thread_start_us":81,"threads_started":1}
I20260808 04:40:36.264662 28511 ts_manager.cc:194] Registered new tserver with Master: a19d6220e3f74533a788ce03b62f1944 (127.20.240.195:45885)
I20260808 04:40:36.264662 28695 ts_manager.cc:194] Registered new tserver with Master: a19d6220e3f74533a788ce03b62f1944 (127.20.240.195:45885)
I20260808 04:40:36.266254 29182 heartbeater.cc:347] Connected to a master server at 127.20.240.254:33559
I20260808 04:40:36.266359 29182 heartbeater.cc:464] Registering TS with master...
I20260808 04:40:36.266625 29182 heartbeater.cc:511] Master 127.20.240.254:33559 requested a full tablet report, sending...
I20260808 04:40:36.267387 27877 ts_manager.cc:194] Re-registered known tserver with Master: a19d6220e3f74533a788ce03b62f1944 (127.20.240.195:45885)
I20260808 04:40:36.268172 29196 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:36.253351 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49428 (local address 127.20.240.254:33559)
0808 04:40:36.255415 (+ 2064us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:36.255422 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:36.255438 (+ 16us) server_negotiation.cc:407] Connection header received
0808 04:40:36.255477 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:36.255480 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:36.255540 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:36.255634 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:36.257497 (+ 1863us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:36.258438 (+ 941us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:36.259702 (+ 1264us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:36.260084 (+ 382us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:36.260190 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:36.262055 (+ 1865us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:40:36.262060 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:40:36.262063 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:40:36.262090 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:40:36.264409 (+ 2319us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:36.265295 (+ 886us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:36.265300 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:36.265302 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:36.265415 (+ 113us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:36.265815 (+ 400us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:36.265819 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:36.265821 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:36.266073 (+ 252us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:40:36.266212 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:36.267829 (+ 1617us) server_negotiation.cc:299] Negotiation successful
0808 04:40:36.267952 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1971,"thread_start_us":85,"threads_started":1}
I20260808 04:40:36.268191 27877 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.20.240.195@KRBTEST.COM'} at 127.20.240.195:50877
I20260808 04:40:36.272076 29199 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:36.254226 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37002 (local address 127.20.240.252:39583)
0808 04:40:36.254876 (+ 650us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:36.254881 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:36.255400 (+ 519us) server_negotiation.cc:407] Connection header received
0808 04:40:36.255588 (+ 188us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:36.255594 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:36.255651 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:36.255715 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:36.261591 (+ 5876us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:36.262442 (+ 851us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:36.263990 (+ 1548us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:36.264446 (+ 456us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:36.264553 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:36.266619 (+ 2066us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:40:36.266622 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:40:36.266624 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:40:36.266647 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:40:36.269971 (+ 3324us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:36.270571 (+ 600us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:36.270578 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:36.270580 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:36.270681 (+ 101us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:36.271031 (+ 350us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:36.271034 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:36.271036 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:36.271281 (+ 245us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:40:36.271422 (+ 141us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:36.271754 (+ 332us) server_negotiation.cc:299] Negotiation successful
0808 04:40:36.271901 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":562,"thread_start_us":110,"threads_started":1}
I20260808 04:40:36.275205 29198 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:36.253826 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53572 (local address 127.20.240.253:34575)
0808 04:40:36.256165 (+ 2339us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:36.256173 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:36.256189 (+ 16us) server_negotiation.cc:407] Connection header received
0808 04:40:36.256243 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:36.256249 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:36.256311 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:36.256416 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:36.266649 (+ 10233us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:36.267532 (+ 883us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:36.268948 (+ 1416us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:36.269449 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:36.269558 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:36.271328 (+ 1770us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:40:36.271335 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:40:36.271341 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:40:36.271368 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:40:36.273366 (+ 1998us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:36.273849 (+ 483us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:36.273852 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:36.273854 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:36.273947 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:36.274251 (+ 304us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:36.274254 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:36.274256 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:36.274453 (+ 197us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:40:36.274603 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:36.274844 (+ 241us) server_negotiation.cc:299] Negotiation successful
0808 04:40:36.274997 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2244,"thread_start_us":66,"threads_started":1}
I20260808 04:40:36.271751 27876 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49428:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 04:40:36.276481 27876 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 04:40:36.279386 28667 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2a361414698e49a880ae63c23c2991be [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "2a361414698e49a880ae63c23c2991be" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "2a361414698e49a880ae63c23c2991be" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 33559 } } peers { permanent_uuid: "9e743421bb6848248124d784dd3fe6ee" member_type: VOTER last_known_addr { host: "127.20.240.253" port: 34575 } attrs { promote: false } } peers { permanent_uuid: "a6c01c87c3a84bc7a009d59c7f7ee4c6" member_type: NON_VOTER last_known_addr { host: "127.20.240.252" port: 39583 } attrs { promote: true } } }
I20260808 04:40:36.279548 28667 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2a361414698e49a880ae63c23c2991be [sys.catalog]: This master's current role is: LEADER
I20260808 04:40:36.284336 29202 raft_consensus.cc:1050] T 00000000000000000000000000000000 P 2a361414698e49a880ae63c23c2991be: attempting to promote NON_VOTER a6c01c87c3a84bc7a009d59c7f7ee4c6 to VOTER
I20260808 04:40:36.284677 29202 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2a361414698e49a880ae63c23c2991be [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "2a361414698e49a880ae63c23c2991be" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 33559 } } peers { permanent_uuid: "9e743421bb6848248124d784dd3fe6ee" member_type: VOTER last_known_addr { host: "127.20.240.253" port: 34575 } attrs { promote: false } } peers { permanent_uuid: "a6c01c87c3a84bc7a009d59c7f7ee4c6" member_type: VOTER last_known_addr { host: "127.20.240.252" port: 39583 } attrs { promote: false } }
I20260808 04:40:36.287256 28520 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 9e743421bb6848248124d784dd3fe6ee [term 1 FOLLOWER]: Refusing update from remote peer 2a361414698e49a880ae63c23c2991be: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20260808 04:40:36.287276 28711 raft_consensus.cc:1261] T 00000000000000000000000000000000 P a6c01c87c3a84bc7a009d59c7f7ee4c6 [term 1 LEARNER]: Refusing update from remote peer 2a361414698e49a880ae63c23c2991be: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20260808 04:40:36.287894 29203 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 2a361414698e49a880ae63c23c2991be [LEADER]: Connected to new peer: Peer: permanent_uuid: "a6c01c87c3a84bc7a009d59c7f7ee4c6" member_type: VOTER last_known_addr { host: "127.20.240.252" port: 39583 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260808 04:40:36.288210 29203 consensus_queue.cc:1037] T 00000000000000000000000000000000 P 2a361414698e49a880ae63c23c2991be [LEADER]: Got LMP mismatch error from peer: Peer: permanent_uuid: "9e743421bb6848248124d784dd3fe6ee" member_type: VOTER last_known_addr { host: "127.20.240.253" port: 34575 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 1.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260808 04:40:36.290242 29203 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 2a361414698e49a880ae63c23c2991be [term 1 LEADER]: Committing config change with OpId 1.9: config changed from index 7 to 9, a6c01c87c3a84bc7a009d59c7f7ee4c6 (127.20.240.252) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "2a361414698e49a880ae63c23c2991be" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 33559 } } peers { permanent_uuid: "9e743421bb6848248124d784dd3fe6ee" member_type: VOTER last_known_addr { host: "127.20.240.253" port: 34575 } attrs { promote: false } } peers { permanent_uuid: "a6c01c87c3a84bc7a009d59c7f7ee4c6" member_type: VOTER last_known_addr { host: "127.20.240.252" port: 39583 } attrs { promote: false } } }
I20260808 04:40:36.290861 28520 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 9e743421bb6848248124d784dd3fe6ee [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 7 to 9, a6c01c87c3a84bc7a009d59c7f7ee4c6 (127.20.240.252) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "2a361414698e49a880ae63c23c2991be" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 33559 } } peers { permanent_uuid: "9e743421bb6848248124d784dd3fe6ee" member_type: VOTER last_known_addr { host: "127.20.240.253" port: 34575 } attrs { promote: false } } peers { permanent_uuid: "a6c01c87c3a84bc7a009d59c7f7ee4c6" member_type: VOTER last_known_addr { host: "127.20.240.252" port: 39583 } attrs { promote: false } } }
I20260808 04:40:36.291530 28711 raft_consensus.cc:2932] T 00000000000000000000000000000000 P a6c01c87c3a84bc7a009d59c7f7ee4c6 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 7 to 9, a6c01c87c3a84bc7a009d59c7f7ee4c6 (127.20.240.252) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "2a361414698e49a880ae63c23c2991be" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 33559 } } peers { permanent_uuid: "9e743421bb6848248124d784dd3fe6ee" member_type: VOTER last_known_addr { host: "127.20.240.253" port: 34575 } attrs { promote: false } } peers { permanent_uuid: "a6c01c87c3a84bc7a009d59c7f7ee4c6" member_type: VOTER last_known_addr { host: "127.20.240.252" port: 39583 } attrs { promote: false } } }
I20260808 04:40:36.292016 29203 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2a361414698e49a880ae63c23c2991be [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "2a361414698e49a880ae63c23c2991be" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "2a361414698e49a880ae63c23c2991be" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 33559 } } peers { permanent_uuid: "9e743421bb6848248124d784dd3fe6ee" member_type: VOTER last_known_addr { host: "127.20.240.253" port: 34575 } attrs { promote: false } } peers { permanent_uuid: "a6c01c87c3a84bc7a009d59c7f7ee4c6" member_type: VOTER last_known_addr { host: "127.20.240.252" port: 39583 } attrs { promote: false } } }
I20260808 04:40:36.292130 29203 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2a361414698e49a880ae63c23c2991be [sys.catalog]: This master's current role is: LEADER
I20260808 04:40:36.292279 29203 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2a361414698e49a880ae63c23c2991be [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "2a361414698e49a880ae63c23c2991be" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "2a361414698e49a880ae63c23c2991be" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 33559 } } peers { permanent_uuid: "9e743421bb6848248124d784dd3fe6ee" member_type: VOTER last_known_addr { host: "127.20.240.253" port: 34575 } attrs { promote: false } } peers { permanent_uuid: "a6c01c87c3a84bc7a009d59c7f7ee4c6" member_type: VOTER last_known_addr { host: "127.20.240.252" port: 39583 } attrs { promote: false } } }
I20260808 04:40:36.292364 29203 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2a361414698e49a880ae63c23c2991be [sys.catalog]: This master's current role is: LEADER
I20260808 04:40:36.292503 29203 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2a361414698e49a880ae63c23c2991be [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "2a361414698e49a880ae63c23c2991be" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "2a361414698e49a880ae63c23c2991be" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 33559 } } peers { permanent_uuid: "9e743421bb6848248124d784dd3fe6ee" member_type: VOTER last_known_addr { host: "127.20.240.253" port: 34575 } attrs { promote: false } } peers { permanent_uuid: "a6c01c87c3a84bc7a009d59c7f7ee4c6" member_type: VOTER last_known_addr { host: "127.20.240.252" port: 39583 } attrs { promote: false } } }
I20260808 04:40:36.292594 29203 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2a361414698e49a880ae63c23c2991be [sys.catalog]: This master's current role is: LEADER
I20260808 04:40:36.292757 29212 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9e743421bb6848248124d784dd3fe6ee [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "2a361414698e49a880ae63c23c2991be" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "2a361414698e49a880ae63c23c2991be" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 33559 } } peers { permanent_uuid: "9e743421bb6848248124d784dd3fe6ee" member_type: VOTER last_known_addr { host: "127.20.240.253" port: 34575 } attrs { promote: false } } peers { permanent_uuid: "a6c01c87c3a84bc7a009d59c7f7ee4c6" member_type: VOTER last_known_addr { host: "127.20.240.252" port: 39583 } attrs { promote: false } } }
I20260808 04:40:36.292896 29212 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9e743421bb6848248124d784dd3fe6ee [sys.catalog]: This master's current role is: FOLLOWER
I20260808 04:40:36.294153 28742 sys_catalog.cc:455] T 00000000000000000000000000000000 P a6c01c87c3a84bc7a009d59c7f7ee4c6 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "2a361414698e49a880ae63c23c2991be" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "2a361414698e49a880ae63c23c2991be" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 33559 } } peers { permanent_uuid: "9e743421bb6848248124d784dd3fe6ee" member_type: VOTER last_known_addr { host: "127.20.240.253" port: 34575 } attrs { promote: false } } peers { permanent_uuid: "a6c01c87c3a84bc7a009d59c7f7ee4c6" member_type: VOTER last_known_addr { host: "127.20.240.252" port: 39583 } attrs { promote: false } } }
I20260808 04:40:36.294294 28742 sys_catalog.cc:458] T 00000000000000000000000000000000 P a6c01c87c3a84bc7a009d59c7f7ee4c6 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 04:40:36.301680 29214 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:36.295164 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.193:41911 (local address 127.0.0.1:36638)
0808 04:40:36.295820 (+ 656us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:36.295837 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:36.295943 (+ 106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:36.296736 (+ 793us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:36.296739 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:36.296756 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 04:40:36.296857 (+ 101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:36.296862 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:36.298530 (+ 1668us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:36.298534 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:36.299940 (+ 1406us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:36.299952 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:36.301242 (+ 1290us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:36.301246 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:36.301352 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:36.301385 (+ 33us) client_negotiation.cc:769] Sending connection context
0808 04:40:36.301437 (+ 52us) client_negotiation.cc:240] Negotiation successful
0808 04:40:36.301514 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":587,"thread_start_us":97,"threads_started":1}
I20260808 04:40:36.302532 29217 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:36.295740 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36638 (local address 127.20.240.193:41911)
0808 04:40:36.296197 (+ 457us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:36.296215 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:36.296241 (+ 26us) server_negotiation.cc:407] Connection header received
0808 04:40:36.296329 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:36.296336 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:36.296573 (+ 237us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:36.296769 (+ 196us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 04:40:36.297012 (+ 243us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:36.298382 (+ 1370us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:36.300121 (+ 1739us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:36.301036 (+ 915us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:36.302049 (+ 1013us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:36.302212 (+ 163us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:36.302270 (+ 58us) server_negotiation.cc:299] Negotiation successful
0808 04:40:36.302375 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":343,"thread_start_us":83,"threads_started":1}
I20260808 04:40:36.303442 29043 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:36.295087 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.194:44761 (local address 127.0.0.1:37326)
0808 04:40:36.295413 (+ 326us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:36.295425 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:36.295512 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:36.299166 (+ 3654us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:36.299169 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:36.299185 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 04:40:36.299256 (+ 71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:36.299261 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:36.300219 (+ 958us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:36.300225 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:36.301433 (+ 1208us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:36.301443 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:36.303027 (+ 1584us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:36.303031 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:36.303137 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:36.303159 (+ 22us) client_negotiation.cc:769] Sending connection context
0808 04:40:36.303224 (+ 65us) client_negotiation.cc:240] Negotiation successful
0808 04:40:36.303307 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":229,"mutex_wait_us":18,"spinlock_wait_cycles":16768,"thread_start_us":132,"threads_started":1}
I20260808 04:40:36.303586 29216 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:36.295698 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37326 (local address 127.20.240.194:44761)
0808 04:40:36.297668 (+ 1970us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:36.297681 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:36.297708 (+ 27us) server_negotiation.cc:407] Connection header received
0808 04:40:36.297787 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:36.297792 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:36.299031 (+ 1239us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:36.299200 (+ 169us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 04:40:36.299348 (+ 148us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:36.300099 (+ 751us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:36.301573 (+ 1474us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:36.302890 (+ 1317us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:36.303124 (+ 234us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:36.303277 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:36.303329 (+ 52us) server_negotiation.cc:299] Negotiation successful
0808 04:40:36.303433 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1857,"thread_start_us":107,"threads_started":1}
I20260808 04:40:36.306267 28966 tablet_service.cc:1467] Processing CreateTablet for tablet edf85063cf9a43ff95c51a3342d9ebd6 (DEFAULT_TABLE table=test-table [id=ec1b0e3a46154042b74642f048b6142a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 04:40:36.306188 28823 tablet_service.cc:1467] Processing CreateTablet for tablet edf85063cf9a43ff95c51a3342d9ebd6 (DEFAULT_TABLE table=test-table [id=ec1b0e3a46154042b74642f048b6142a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 04:40:36.307322 28966 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet edf85063cf9a43ff95c51a3342d9ebd6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:40:36.307344 28823 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet edf85063cf9a43ff95c51a3342d9ebd6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:40:36.313814 29213 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:36.294838 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.195:45885 (local address 127.0.0.1:54482)
0808 04:40:36.295393 (+ 555us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:36.295409 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:36.295512 (+ 103us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:36.298876 (+ 3364us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:36.298879 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:36.298908 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 04:40:36.299017 (+ 109us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:36.299027 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:36.302000 (+ 2973us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:36.302003 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:36.303716 (+ 1713us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:36.303727 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:36.313282 (+ 9555us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:36.313286 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:36.313422 (+ 136us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:36.313455 (+ 33us) client_negotiation.cc:769] Sending connection context
0808 04:40:36.313550 (+ 95us) client_negotiation.cc:240] Negotiation successful
0808 04:40:36.313648 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":470,"mutex_wait_us":1,"spinlock_wait_cycles":2560}
I20260808 04:40:36.313964 29215 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:36.295043 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54482 (local address 127.20.240.195:45885)
0808 04:40:36.298466 (+ 3423us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:36.298478 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:36.298500 (+ 22us) server_negotiation.cc:407] Connection header received
0808 04:40:36.298579 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:36.298583 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:36.298717 (+ 134us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:36.298905 (+ 188us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 04:40:36.300268 (+ 1363us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:36.301426 (+ 1158us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:36.304294 (+ 2868us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:36.305188 (+ 894us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:36.305315 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:36.305455 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:36.313652 (+ 8197us) server_negotiation.cc:299] Negotiation successful
0808 04:40:36.313801 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3298,"thread_start_us":214,"threads_started":1}
I20260808 04:40:36.315554 29218 tablet_bootstrap.cc:492] T edf85063cf9a43ff95c51a3342d9ebd6 P 6135fa034b434540bf65da8cedaf4de2: Bootstrap starting.
I20260808 04:40:36.317055 29219 tablet_bootstrap.cc:492] T edf85063cf9a43ff95c51a3342d9ebd6 P 13451d5e45d9432c9a40de3584233526: Bootstrap starting.
I20260808 04:40:36.317571 29112 tablet_service.cc:1467] Processing CreateTablet for tablet edf85063cf9a43ff95c51a3342d9ebd6 (DEFAULT_TABLE table=test-table [id=ec1b0e3a46154042b74642f048b6142a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 04:40:36.318379 29218 tablet_bootstrap.cc:654] T edf85063cf9a43ff95c51a3342d9ebd6 P 6135fa034b434540bf65da8cedaf4de2: Neither blocks nor log segments found. Creating new log.
I20260808 04:40:36.318861 29112 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet edf85063cf9a43ff95c51a3342d9ebd6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:40:36.319227 29218 log.cc:824] T edf85063cf9a43ff95c51a3342d9ebd6 P 6135fa034b434540bf65da8cedaf4de2: Log is configured to *not* fsync() on all Append() calls
I20260808 04:40:36.319387 29219 tablet_bootstrap.cc:654] T edf85063cf9a43ff95c51a3342d9ebd6 P 13451d5e45d9432c9a40de3584233526: Neither blocks nor log segments found. Creating new log.
I20260808 04:40:36.320312 29219 log.cc:824] T edf85063cf9a43ff95c51a3342d9ebd6 P 13451d5e45d9432c9a40de3584233526: Log is configured to *not* fsync() on all Append() calls
I20260808 04:40:36.321595 29218 tablet_bootstrap.cc:492] T edf85063cf9a43ff95c51a3342d9ebd6 P 6135fa034b434540bf65da8cedaf4de2: No bootstrap required, opened a new log
I20260808 04:40:36.321812 29218 ts_tablet_manager.cc:1397] T edf85063cf9a43ff95c51a3342d9ebd6 P 6135fa034b434540bf65da8cedaf4de2: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260808 04:40:36.322470 29219 tablet_bootstrap.cc:492] T edf85063cf9a43ff95c51a3342d9ebd6 P 13451d5e45d9432c9a40de3584233526: No bootstrap required, opened a new log
I20260808 04:40:36.322667 29219 ts_tablet_manager.cc:1397] T edf85063cf9a43ff95c51a3342d9ebd6 P 13451d5e45d9432c9a40de3584233526: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260808 04:40:36.325858 29218 raft_consensus.cc:348] T edf85063cf9a43ff95c51a3342d9ebd6 P 6135fa034b434540bf65da8cedaf4de2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13451d5e45d9432c9a40de3584233526" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 41911 } } peers { permanent_uuid: "a19d6220e3f74533a788ce03b62f1944" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 45885 } } peers { permanent_uuid: "6135fa034b434540bf65da8cedaf4de2" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 44761 } }
I20260808 04:40:36.326123 29218 raft_consensus.cc:374] T edf85063cf9a43ff95c51a3342d9ebd6 P 6135fa034b434540bf65da8cedaf4de2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:40:36.326179 29218 raft_consensus.cc:729] T edf85063cf9a43ff95c51a3342d9ebd6 P 6135fa034b434540bf65da8cedaf4de2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6135fa034b434540bf65da8cedaf4de2, State: Initialized, Role: FOLLOWER
I20260808 04:40:36.326679 29218 consensus_queue.cc:260] T edf85063cf9a43ff95c51a3342d9ebd6 P 6135fa034b434540bf65da8cedaf4de2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13451d5e45d9432c9a40de3584233526" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 41911 } } peers { permanent_uuid: "a19d6220e3f74533a788ce03b62f1944" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 45885 } } peers { permanent_uuid: "6135fa034b434540bf65da8cedaf4de2" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 44761 } }
I20260808 04:40:36.327407 29035 heartbeater.cc:503] Master 127.20.240.254:33559 was elected leader, sending a full tablet report...
I20260808 04:40:36.327754 29218 ts_tablet_manager.cc:1428] T edf85063cf9a43ff95c51a3342d9ebd6 P 6135fa034b434540bf65da8cedaf4de2: Time spent starting tablet: real 0.006s user 0.000s sys 0.005s
I20260808 04:40:36.327698 29219 raft_consensus.cc:348] T edf85063cf9a43ff95c51a3342d9ebd6 P 13451d5e45d9432c9a40de3584233526 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13451d5e45d9432c9a40de3584233526" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 41911 } } peers { permanent_uuid: "a19d6220e3f74533a788ce03b62f1944" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 45885 } } peers { permanent_uuid: "6135fa034b434540bf65da8cedaf4de2" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 44761 } }
I20260808 04:40:36.327984 29219 raft_consensus.cc:374] T edf85063cf9a43ff95c51a3342d9ebd6 P 13451d5e45d9432c9a40de3584233526 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:40:36.328037 29219 raft_consensus.cc:729] T edf85063cf9a43ff95c51a3342d9ebd6 P 13451d5e45d9432c9a40de3584233526 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 13451d5e45d9432c9a40de3584233526, State: Initialized, Role: FOLLOWER
I20260808 04:40:36.328544 29219 consensus_queue.cc:260] T edf85063cf9a43ff95c51a3342d9ebd6 P 13451d5e45d9432c9a40de3584233526 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13451d5e45d9432c9a40de3584233526" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 41911 } } peers { permanent_uuid: "a19d6220e3f74533a788ce03b62f1944" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 45885 } } peers { permanent_uuid: "6135fa034b434540bf65da8cedaf4de2" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 44761 } }
I20260808 04:40:36.330888 29219 ts_tablet_manager.cc:1428] T edf85063cf9a43ff95c51a3342d9ebd6 P 13451d5e45d9432c9a40de3584233526: Time spent starting tablet: real 0.008s user 0.008s sys 0.000s
I20260808 04:40:36.332653 28892 heartbeater.cc:503] Master 127.20.240.254:33559 was elected leader, sending a full tablet report...
I20260808 04:40:36.333261 29223 tablet_bootstrap.cc:492] T edf85063cf9a43ff95c51a3342d9ebd6 P a19d6220e3f74533a788ce03b62f1944: Bootstrap starting.
I20260808 04:40:36.335973 29223 tablet_bootstrap.cc:654] T edf85063cf9a43ff95c51a3342d9ebd6 P a19d6220e3f74533a788ce03b62f1944: Neither blocks nor log segments found. Creating new log.
I20260808 04:40:36.336809 29223 log.cc:824] T edf85063cf9a43ff95c51a3342d9ebd6 P a19d6220e3f74533a788ce03b62f1944: Log is configured to *not* fsync() on all Append() calls
I20260808 04:40:36.338893 29223 tablet_bootstrap.cc:492] T edf85063cf9a43ff95c51a3342d9ebd6 P a19d6220e3f74533a788ce03b62f1944: No bootstrap required, opened a new log
I20260808 04:40:36.339162 29223 ts_tablet_manager.cc:1397] T edf85063cf9a43ff95c51a3342d9ebd6 P a19d6220e3f74533a788ce03b62f1944: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260808 04:40:36.342792 29223 raft_consensus.cc:348] T edf85063cf9a43ff95c51a3342d9ebd6 P a19d6220e3f74533a788ce03b62f1944 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13451d5e45d9432c9a40de3584233526" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 41911 } } peers { permanent_uuid: "a19d6220e3f74533a788ce03b62f1944" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 45885 } } peers { permanent_uuid: "6135fa034b434540bf65da8cedaf4de2" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 44761 } }
I20260808 04:40:36.343082 29223 raft_consensus.cc:374] T edf85063cf9a43ff95c51a3342d9ebd6 P a19d6220e3f74533a788ce03b62f1944 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:40:36.343165 29223 raft_consensus.cc:729] T edf85063cf9a43ff95c51a3342d9ebd6 P a19d6220e3f74533a788ce03b62f1944 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a19d6220e3f74533a788ce03b62f1944, State: Initialized, Role: FOLLOWER
I20260808 04:40:36.343688 29223 consensus_queue.cc:260] T edf85063cf9a43ff95c51a3342d9ebd6 P a19d6220e3f74533a788ce03b62f1944 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13451d5e45d9432c9a40de3584233526" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 41911 } } peers { permanent_uuid: "a19d6220e3f74533a788ce03b62f1944" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 45885 } } peers { permanent_uuid: "6135fa034b434540bf65da8cedaf4de2" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 44761 } }
I20260808 04:40:36.344475 29182 heartbeater.cc:503] Master 127.20.240.254:33559 was elected leader, sending a full tablet report...
I20260808 04:40:36.344966 29223 ts_tablet_manager.cc:1428] T edf85063cf9a43ff95c51a3342d9ebd6 P a19d6220e3f74533a788ce03b62f1944: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20260808 04:40:36.444147 29224 raft_consensus.cc:482] T edf85063cf9a43ff95c51a3342d9ebd6 P 13451d5e45d9432c9a40de3584233526 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 04:40:36.444387 29224 raft_consensus.cc:504] T edf85063cf9a43ff95c51a3342d9ebd6 P 13451d5e45d9432c9a40de3584233526 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13451d5e45d9432c9a40de3584233526" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 41911 } } peers { permanent_uuid: "a19d6220e3f74533a788ce03b62f1944" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 45885 } } peers { permanent_uuid: "6135fa034b434540bf65da8cedaf4de2" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 44761 } }
I20260808 04:40:36.445576 29224 leader_election.cc:288] T edf85063cf9a43ff95c51a3342d9ebd6 P 13451d5e45d9432c9a40de3584233526 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a19d6220e3f74533a788ce03b62f1944 (127.20.240.195:45885), 6135fa034b434540bf65da8cedaf4de2 (127.20.240.194:44761)
I20260808 04:40:36.450953 29216 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:36.446640 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.240.193:51337 (local address 127.20.240.194:44761)
0808 04:40:36.446754 (+ 114us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:36.446759 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:36.446927 (+ 168us) server_negotiation.cc:407] Connection header received
0808 04:40:36.447005 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:36.447008 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:36.447063 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:36.447155 (+ 92us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 04:40:36.447498 (+ 343us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:36.448100 (+ 602us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:36.449925 (+ 1825us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:36.450344 (+ 419us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:36.450484 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:36.450542 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:36.450732 (+ 190us) server_negotiation.cc:299] Negotiation successful
0808 04:40:36.450807 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260808 04:40:36.450968 29228 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:36.446464 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.194:44761 (local address 127.20.240.193:51337)
0808 04:40:36.446805 (+ 341us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:36.446819 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:36.446926 (+ 107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:36.447187 (+ 261us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:36.447191 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:36.447207 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 04:40:36.447332 (+ 125us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:36.447339 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:36.448220 (+ 881us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:36.448223 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:36.449726 (+ 1503us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:36.449739 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:36.450479 (+ 740us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:36.450483 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:36.450580 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:36.450610 (+ 30us) client_negotiation.cc:769] Sending connection context
0808 04:40:36.450713 (+ 103us) client_negotiation.cc:240] Negotiation successful
0808 04:40:36.450801 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":270,"mutex_wait_us":116,"thread_start_us":87,"threads_started":1}
I20260808 04:40:36.451064 29215 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:36.446080 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.240.193:52007 (local address 127.20.240.195:45885)
0808 04:40:36.446243 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:36.446247 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:36.446599 (+ 352us) server_negotiation.cc:407] Connection header received
0808 04:40:36.447022 (+ 423us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:36.447026 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:36.447077 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:36.447139 (+ 62us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 04:40:36.447491 (+ 352us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:36.448050 (+ 559us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:36.449881 (+ 1831us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:36.450366 (+ 485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:36.450527 (+ 161us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:36.450584 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:36.450831 (+ 247us) server_negotiation.cc:299] Negotiation successful
0808 04:40:36.450917 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260808 04:40:36.451217 29227 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:36.445950 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.195:45885 (local address 127.20.240.193:52007)
0808 04:40:36.446491 (+ 541us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:36.446509 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:36.446802 (+ 293us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:36.447288 (+ 486us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:36.447290 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:36.447304 (+ 14us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 04:40:36.447364 (+ 60us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:36.447372 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:36.448204 (+ 832us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:36.448210 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:36.449726 (+ 1516us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:36.449739 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:36.450534 (+ 795us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:36.450538 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:36.450659 (+ 121us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:36.450692 (+ 33us) client_negotiation.cc:769] Sending connection context
0808 04:40:36.450809 (+ 117us) client_negotiation.cc:240] Negotiation successful
0808 04:40:36.450899 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":408,"mutex_wait_us":81,"thread_start_us":156,"threads_started":1}
I20260808 04:40:36.451993 28987 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "edf85063cf9a43ff95c51a3342d9ebd6" candidate_uuid: "13451d5e45d9432c9a40de3584233526" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6135fa034b434540bf65da8cedaf4de2" is_pre_election: true
I20260808 04:40:36.451999 29134 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "edf85063cf9a43ff95c51a3342d9ebd6" candidate_uuid: "13451d5e45d9432c9a40de3584233526" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a19d6220e3f74533a788ce03b62f1944" is_pre_election: true
I20260808 04:40:36.452381 29134 raft_consensus.cc:2454] T edf85063cf9a43ff95c51a3342d9ebd6 P a19d6220e3f74533a788ce03b62f1944 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 13451d5e45d9432c9a40de3584233526 in term 0.
I20260808 04:40:36.452381 28987 raft_consensus.cc:2454] T edf85063cf9a43ff95c51a3342d9ebd6 P 6135fa034b434540bf65da8cedaf4de2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 13451d5e45d9432c9a40de3584233526 in term 0.
I20260808 04:40:36.452975 28774 leader_election.cc:302] T edf85063cf9a43ff95c51a3342d9ebd6 P 13451d5e45d9432c9a40de3584233526 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 13451d5e45d9432c9a40de3584233526, a19d6220e3f74533a788ce03b62f1944; no voters:
I20260808 04:40:36.453316 29224 raft_consensus.cc:2781] T edf85063cf9a43ff95c51a3342d9ebd6 P 13451d5e45d9432c9a40de3584233526 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 04:40:36.453433 29224 raft_consensus.cc:482] T edf85063cf9a43ff95c51a3342d9ebd6 P 13451d5e45d9432c9a40de3584233526 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 04:40:36.453483 29224 raft_consensus.cc:3037] T edf85063cf9a43ff95c51a3342d9ebd6 P 13451d5e45d9432c9a40de3584233526 [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:40:36.454653 29224 raft_consensus.cc:504] T edf85063cf9a43ff95c51a3342d9ebd6 P 13451d5e45d9432c9a40de3584233526 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13451d5e45d9432c9a40de3584233526" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 41911 } } peers { permanent_uuid: "a19d6220e3f74533a788ce03b62f1944" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 45885 } } peers { permanent_uuid: "6135fa034b434540bf65da8cedaf4de2" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 44761 } }
I20260808 04:40:36.455142 29224 leader_election.cc:288] T edf85063cf9a43ff95c51a3342d9ebd6 P 13451d5e45d9432c9a40de3584233526 [CANDIDATE]: Term 1 election: Requested vote from peers a19d6220e3f74533a788ce03b62f1944 (127.20.240.195:45885), 6135fa034b434540bf65da8cedaf4de2 (127.20.240.194:44761)
I20260808 04:40:36.455955 28987 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "edf85063cf9a43ff95c51a3342d9ebd6" candidate_uuid: "13451d5e45d9432c9a40de3584233526" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6135fa034b434540bf65da8cedaf4de2"
I20260808 04:40:36.456126 28987 raft_consensus.cc:3037] T edf85063cf9a43ff95c51a3342d9ebd6 P 6135fa034b434540bf65da8cedaf4de2 [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:40:36.456259 29134 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "edf85063cf9a43ff95c51a3342d9ebd6" candidate_uuid: "13451d5e45d9432c9a40de3584233526" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a19d6220e3f74533a788ce03b62f1944"
I20260808 04:40:36.456411 29134 raft_consensus.cc:3037] T edf85063cf9a43ff95c51a3342d9ebd6 P a19d6220e3f74533a788ce03b62f1944 [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:40:36.457890 28987 raft_consensus.cc:2454] T edf85063cf9a43ff95c51a3342d9ebd6 P 6135fa034b434540bf65da8cedaf4de2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 13451d5e45d9432c9a40de3584233526 in term 1.
I20260808 04:40:36.458067 29134 raft_consensus.cc:2454] T edf85063cf9a43ff95c51a3342d9ebd6 P a19d6220e3f74533a788ce03b62f1944 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 13451d5e45d9432c9a40de3584233526 in term 1.
I20260808 04:40:36.458408 28774 leader_election.cc:302] T edf85063cf9a43ff95c51a3342d9ebd6 P 13451d5e45d9432c9a40de3584233526 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 13451d5e45d9432c9a40de3584233526, 6135fa034b434540bf65da8cedaf4de2; no voters:
I20260808 04:40:36.458669 29224 raft_consensus.cc:2781] T edf85063cf9a43ff95c51a3342d9ebd6 P 13451d5e45d9432c9a40de3584233526 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 04:40:36.458925 29224 raft_consensus.cc:686] T edf85063cf9a43ff95c51a3342d9ebd6 P 13451d5e45d9432c9a40de3584233526 [term 1 LEADER]: Becoming Leader. State: Replica: 13451d5e45d9432c9a40de3584233526, State: Running, Role: LEADER
I20260808 04:40:36.459340 29224 consensus_queue.cc:237] T edf85063cf9a43ff95c51a3342d9ebd6 P 13451d5e45d9432c9a40de3584233526 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13451d5e45d9432c9a40de3584233526" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 41911 } } peers { permanent_uuid: "a19d6220e3f74533a788ce03b62f1944" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 45885 } } peers { permanent_uuid: "6135fa034b434540bf65da8cedaf4de2" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 44761 } }
I20260808 04:40:36.463142 27877 catalog_manager.cc:5495] T edf85063cf9a43ff95c51a3342d9ebd6 P 13451d5e45d9432c9a40de3584233526 reported cstate change: term changed from 0 to 1, leader changed from <none> to 13451d5e45d9432c9a40de3584233526 (127.20.240.193). New cstate: current_term: 1 leader_uuid: "13451d5e45d9432c9a40de3584233526" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13451d5e45d9432c9a40de3584233526" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 41911 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a19d6220e3f74533a788ce03b62f1944" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 45885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6135fa034b434540bf65da8cedaf4de2" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 44761 } health_report { overall_health: UNKNOWN } } }
W20260808 04:40:36.493180 29185 tablet.cc:2369] T edf85063cf9a43ff95c51a3342d9ebd6 P a19d6220e3f74533a788ce03b62f1944: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 04:40:36.494073 29217 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:36.489911 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36654 (local address 127.20.240.193:41911)
0808 04:40:36.490073 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:36.490080 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:36.490099 (+ 19us) server_negotiation.cc:407] Connection header received
0808 04:40:36.490197 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:36.490200 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:36.490255 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:36.490375 (+ 120us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 04:40:36.490647 (+ 272us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:36.491167 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:36.492132 (+ 965us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:36.492463 (+ 331us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:36.492619 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:36.493024 (+ 405us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 04:40:36.493646 (+ 622us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 04:40:36.493758 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:36.493893 (+ 135us) server_negotiation.cc:299] Negotiation successful
0808 04:40:36.493956 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260808 04:40:36.500505 29134 raft_consensus.cc:1261] T edf85063cf9a43ff95c51a3342d9ebd6 P a19d6220e3f74533a788ce03b62f1944 [term 1 FOLLOWER]: Refusing update from remote peer 13451d5e45d9432c9a40de3584233526: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 04:40:36.500505 28987 raft_consensus.cc:1261] T edf85063cf9a43ff95c51a3342d9ebd6 P 6135fa034b434540bf65da8cedaf4de2 [term 1 FOLLOWER]: Refusing update from remote peer 13451d5e45d9432c9a40de3584233526: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 04:40:36.501401 29224 consensus_queue.cc:1035] T edf85063cf9a43ff95c51a3342d9ebd6 P 13451d5e45d9432c9a40de3584233526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6135fa034b434540bf65da8cedaf4de2" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 44761 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 04:40:36.501675 29229 consensus_queue.cc:1035] T edf85063cf9a43ff95c51a3342d9ebd6 P 13451d5e45d9432c9a40de3584233526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a19d6220e3f74533a788ce03b62f1944" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 45885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 04:40:36.522176 27877 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49428:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 04:40:36.522367 27877 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49428:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 04:40:36.526788 27877 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2a361414698e49a880ae63c23c2991be: Sending DeleteTablet for 3 replicas of tablet edf85063cf9a43ff95c51a3342d9ebd6
I20260808 04:40:36.527904 28823 tablet_service.cc:1514] Processing DeleteTablet for tablet edf85063cf9a43ff95c51a3342d9ebd6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 04:40:36 UTC) from {username='oryx', principal='oryx/127.20.240.254@KRBTEST.COM'} at 127.0.0.1:36638
I20260808 04:40:36.528005 29112 tablet_service.cc:1514] Processing DeleteTablet for tablet edf85063cf9a43ff95c51a3342d9ebd6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 04:40:36 UTC) from {username='oryx', principal='oryx/127.20.240.254@KRBTEST.COM'} at 127.0.0.1:54482
I20260808 04:40:36.528523 29243 tablet_replica.cc:330] T edf85063cf9a43ff95c51a3342d9ebd6 P 13451d5e45d9432c9a40de3584233526: stopping tablet replica
I20260808 04:40:36.528940 29243 raft_consensus.cc:2229] T edf85063cf9a43ff95c51a3342d9ebd6 P 13451d5e45d9432c9a40de3584233526 [term 1 LEADER]: Raft consensus shutting down.
I20260808 04:40:36.528901 28966 tablet_service.cc:1514] Processing DeleteTablet for tablet edf85063cf9a43ff95c51a3342d9ebd6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 04:40:36 UTC) from {username='oryx', principal='oryx/127.20.240.254@KRBTEST.COM'} at 127.0.0.1:37326
I20260808 04:40:36.529479 29243 raft_consensus.cc:2258] T edf85063cf9a43ff95c51a3342d9ebd6 P 13451d5e45d9432c9a40de3584233526 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 04:40:36.529856 29244 tablet_replica.cc:330] T edf85063cf9a43ff95c51a3342d9ebd6 P a19d6220e3f74533a788ce03b62f1944: stopping tablet replica
I20260808 04:40:36.530746 29244 raft_consensus.cc:2229] T edf85063cf9a43ff95c51a3342d9ebd6 P a19d6220e3f74533a788ce03b62f1944 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 04:40:36.531061 21443 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu with pid 27844
I20260808 04:40:36.533883 29243 ts_tablet_manager.cc:1905] T edf85063cf9a43ff95c51a3342d9ebd6 P 13451d5e45d9432c9a40de3584233526: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 04:40:36.533878 29244 raft_consensus.cc:2258] T edf85063cf9a43ff95c51a3342d9ebd6 P a19d6220e3f74533a788ce03b62f1944 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 04:40:36.535715 29244 ts_tablet_manager.cc:1905] T edf85063cf9a43ff95c51a3342d9ebd6 P a19d6220e3f74533a788ce03b62f1944: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 04:40:36.537292 29243 ts_tablet_manager.cc:1918] T edf85063cf9a43ff95c51a3342d9ebd6 P 13451d5e45d9432c9a40de3584233526: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 04:40:36.537498 29243 log.cc:1196] T edf85063cf9a43ff95c51a3342d9ebd6 P 13451d5e45d9432c9a40de3584233526: Deleting WAL directory at /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164000593138-21443-0/minicluster-data/ts-0/wal/wals/edf85063cf9a43ff95c51a3342d9ebd6
I20260808 04:40:36.537936 29243 ts_tablet_manager.cc:1939] T edf85063cf9a43ff95c51a3342d9ebd6 P 13451d5e45d9432c9a40de3584233526: Deleting consensus metadata
I20260808 04:40:36.538673 29244 ts_tablet_manager.cc:1918] T edf85063cf9a43ff95c51a3342d9ebd6 P a19d6220e3f74533a788ce03b62f1944: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 04:40:36.538785 29244 log.cc:1196] T edf85063cf9a43ff95c51a3342d9ebd6 P a19d6220e3f74533a788ce03b62f1944: Deleting WAL directory at /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164000593138-21443-0/minicluster-data/ts-2/wal/wals/edf85063cf9a43ff95c51a3342d9ebd6
I20260808 04:40:36.539136 29244 ts_tablet_manager.cc:1939] T edf85063cf9a43ff95c51a3342d9ebd6 P a19d6220e3f74533a788ce03b62f1944: Deleting consensus metadata
I20260808 04:40:36.540956 29245 tablet_replica.cc:330] T edf85063cf9a43ff95c51a3342d9ebd6 P 6135fa034b434540bf65da8cedaf4de2: stopping tablet replica
W20260808 04:40:36.541114 28772 connection.cc:535] server connection from 127.0.0.1:36638 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260808 04:40:36.541391 29245 raft_consensus.cc:2229] T edf85063cf9a43ff95c51a3342d9ebd6 P 6135fa034b434540bf65da8cedaf4de2 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260808 04:40:36.541621 29066 connection.cc:535] server connection from 127.0.0.1:54482 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260808 04:40:36.544189 29245 raft_consensus.cc:2258] T edf85063cf9a43ff95c51a3342d9ebd6 P 6135fa034b434540bf65da8cedaf4de2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 04:40:36.546263 29245 ts_tablet_manager.cc:1905] T edf85063cf9a43ff95c51a3342d9ebd6 P 6135fa034b434540bf65da8cedaf4de2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 04:40:36.549515 29245 ts_tablet_manager.cc:1918] T edf85063cf9a43ff95c51a3342d9ebd6 P 6135fa034b434540bf65da8cedaf4de2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 04:40:36.549646 29245 log.cc:1196] T edf85063cf9a43ff95c51a3342d9ebd6 P 6135fa034b434540bf65da8cedaf4de2: Deleting WAL directory at /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164000593138-21443-0/minicluster-data/ts-1/wal/wals/edf85063cf9a43ff95c51a3342d9ebd6
I20260808 04:40:36.550235 29245 ts_tablet_manager.cc:1939] T edf85063cf9a43ff95c51a3342d9ebd6 P 6135fa034b434540bf65da8cedaf4de2: Deleting consensus metadata
I20260808 04:40:36.551401 29198 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:36.530172 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53580 (local address 127.20.240.253:34575)
0808 04:40:36.530289 (+ 117us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:36.530294 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:36.540598 (+ 10304us) server_negotiation.cc:407] Connection header received
0808 04:40:36.540754 (+ 156us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:36.540756 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:36.540811 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:36.540955 (+ 144us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:36.542118 (+ 1163us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:36.542795 (+ 677us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:36.543671 (+ 876us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:36.543925 (+ 254us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:36.544054 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:36.546576 (+ 2522us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:40:36.546581 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:40:36.546585 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:40:36.546618 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:40:36.548676 (+ 2058us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:36.549344 (+ 668us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:36.549349 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:36.549351 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:36.549449 (+ 98us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:36.550174 (+ 725us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:36.550179 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:36.550181 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:36.550425 (+ 244us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:40:36.550566 (+ 141us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:36.551091 (+ 525us) server_negotiation.cc:299] Negotiation successful
0808 04:40:36.551232 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
W20260808 04:40:36.551621 28920 connection.cc:441] server connection from 127.0.0.1:37326 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37326 (request call id 1) could send its response
I20260808 04:40:36.559121 28638 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:36.547351 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53590 (local address 127.20.240.253:34575)
0808 04:40:36.547483 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:36.547487 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:36.548986 (+ 1499us) server_negotiation.cc:407] Connection header received
0808 04:40:36.549242 (+ 256us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:36.549246 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:36.549305 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:36.549367 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:36.550491 (+ 1124us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:36.551263 (+ 772us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:36.552359 (+ 1096us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:36.552686 (+ 327us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:36.552786 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:36.554632 (+ 1846us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:40:36.554636 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:40:36.554638 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:40:36.554664 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:40:36.556454 (+ 1790us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:36.556970 (+ 516us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:36.556975 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:36.556978 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:36.557555 (+ 577us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:36.557896 (+ 341us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:36.557902 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:36.557905 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:36.558175 (+ 270us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:40:36.558288 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:36.558703 (+ 415us) server_negotiation.cc:299] Negotiation successful
0808 04:40:36.558872 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260808 04:40:36.562860 29199 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:36.530490 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37012 (local address 127.20.240.252:39583)
0808 04:40:36.530595 (+ 105us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:36.530602 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:36.552888 (+ 22286us) server_negotiation.cc:407] Connection header received
0808 04:40:36.553070 (+ 182us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:36.553073 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:36.553125 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:36.553199 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:36.554571 (+ 1372us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:36.555379 (+ 808us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:36.556661 (+ 1282us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:36.557018 (+ 357us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:36.557090 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:36.558805 (+ 1715us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:40:36.558809 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:40:36.558812 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:40:36.558849 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:40:36.560944 (+ 2095us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:36.561441 (+ 497us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:36.561445 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:36.561447 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:36.561540 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:36.561830 (+ 290us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:36.561833 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:36.561835 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:36.562132 (+ 297us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:40:36.562274 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:36.562531 (+ 257us) server_negotiation.cc:299] Negotiation successful
0808 04:40:36.562664 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260808 04:40:36.563263 28900 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:36.548045 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37028 (local address 127.20.240.252:39583)
0808 04:40:36.548172 (+ 127us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:36.548176 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:36.552575 (+ 4399us) server_negotiation.cc:407] Connection header received
0808 04:40:36.552770 (+ 195us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:36.552773 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:36.552839 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:36.552931 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:36.554010 (+ 1079us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:36.554838 (+ 828us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:36.556137 (+ 1299us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:36.556501 (+ 364us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:36.556580 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:36.558516 (+ 1936us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:40:36.558523 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:40:36.558526 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:40:36.558555 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:40:36.561352 (+ 2797us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:36.561850 (+ 498us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:36.561854 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:36.561855 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:36.561982 (+ 127us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:36.562315 (+ 333us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:36.562318 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:36.562320 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:36.562528 (+ 208us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:40:36.562640 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:36.563021 (+ 381us) server_negotiation.cc:299] Negotiation successful
0808 04:40:36.563128 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260808 04:40:37.515687 29254 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:37.515101 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:33559 (local address 127.20.240.194:48985)
0808 04:40:37.515423 (+ 322us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:37.515532 (+ 109us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.240.254:33559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":202,"thread_start_us":81,"threads_started":1}
W20260808 04:40:37.516227 29035 heartbeater.cc:644] Failed to heartbeat to 127.20.240.254:33559 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.20.240.254:33559: connect: Connection refused (error 111)
I20260808 04:40:37.518043 29255 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:37.517586 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:33559 (local address 127.20.240.193:52531)
0808 04:40:37.517834 (+ 248us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:37.517933 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.240.254:33559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":176,"thread_start_us":99,"threads_started":1}
W20260808 04:40:37.518317 28892 heartbeater.cc:644] Failed to heartbeat to 127.20.240.254:33559 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.20.240.254:33559: connect: Connection refused (error 111)
I20260808 04:40:37.520330 29256 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:37.519878 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:33559 (local address 127.20.240.195:49615)
0808 04:40:37.520108 (+ 230us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:37.520210 (+ 102us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.240.254:33559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":162,"thread_start_us":96,"threads_started":1}
W20260808 04:40:37.520906 29182 heartbeater.cc:644] Failed to heartbeat to 127.20.240.254:33559 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.20.240.254:33559: connect: Connection refused (error 111)
I20260808 04:40:38.028541 29257 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9e743421bb6848248124d784dd3fe6ee [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2a361414698e49a880ae63c23c2991be)
I20260808 04:40:38.028544 29258 raft_consensus.cc:482] T 00000000000000000000000000000000 P a6c01c87c3a84bc7a009d59c7f7ee4c6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2a361414698e49a880ae63c23c2991be)
I20260808 04:40:38.028787 29258 raft_consensus.cc:504] T 00000000000000000000000000000000 P a6c01c87c3a84bc7a009d59c7f7ee4c6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "2a361414698e49a880ae63c23c2991be" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 33559 } } peers { permanent_uuid: "9e743421bb6848248124d784dd3fe6ee" member_type: VOTER last_known_addr { host: "127.20.240.253" port: 34575 } attrs { promote: false } } peers { permanent_uuid: "a6c01c87c3a84bc7a009d59c7f7ee4c6" member_type: VOTER last_known_addr { host: "127.20.240.252" port: 39583 } attrs { promote: false } }
I20260808 04:40:38.028834 29257 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9e743421bb6848248124d784dd3fe6ee [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "2a361414698e49a880ae63c23c2991be" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 33559 } } peers { permanent_uuid: "9e743421bb6848248124d784dd3fe6ee" member_type: VOTER last_known_addr { host: "127.20.240.253" port: 34575 } attrs { promote: false } } peers { permanent_uuid: "a6c01c87c3a84bc7a009d59c7f7ee4c6" member_type: VOTER last_known_addr { host: "127.20.240.252" port: 39583 } attrs { promote: false } }
I20260808 04:40:38.029908 29257 leader_election.cc:288] T 00000000000000000000000000000000 P 9e743421bb6848248124d784dd3fe6ee [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2a361414698e49a880ae63c23c2991be (127.20.240.254:33559), a6c01c87c3a84bc7a009d59c7f7ee4c6 (127.20.240.252:39583)
I20260808 04:40:38.029914 29258 leader_election.cc:288] T 00000000000000000000000000000000 P a6c01c87c3a84bc7a009d59c7f7ee4c6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2a361414698e49a880ae63c23c2991be (127.20.240.254:33559), 9e743421bb6848248124d784dd3fe6ee (127.20.240.253:34575)
I20260808 04:40:38.030861 29261 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:38.030077 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:33559 (local address 127.0.0.1:49888)
0808 04:40:38.030638 (+ 561us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:38.030732 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.240.254:33559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":478,"thread_start_us":81,"threads_started":1}
I20260808 04:40:38.031045 29259 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:38.030077 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:33559 (local address 127.0.0.1:49890)
0808 04:40:38.030861 (+ 784us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:38.030939 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.240.254:33559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":693,"thread_start_us":76,"threads_started":1}
W20260808 04:40:38.031169 28495 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.20.240.254:33559: connect: Connection refused (error 111)
W20260808 04:40:38.031210 28686 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.20.240.254:33559: connect: Connection refused (error 111)
I20260808 04:40:38.032250 29261 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:38.032019 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:33559 (local address 127.0.0.1:49908)
0808 04:40:38.032145 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:38.032188 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.240.254:33559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":71}
I20260808 04:40:38.032271 29259 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:38.032017 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:33559 (local address 127.0.0.1:49906)
0808 04:40:38.032150 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:38.032195 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.240.254:33559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":79}
W20260808 04:40:38.032389 28686 leader_election.cc:334] T 00000000000000000000000000000000 P a6c01c87c3a84bc7a009d59c7f7ee4c6 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 2a361414698e49a880ae63c23c2991be (127.20.240.254:33559): Network error: Client connection negotiation failed: client connection to 127.20.240.254:33559: connect: Connection refused (error 111)
W20260808 04:40:38.032454 28495 leader_election.cc:334] T 00000000000000000000000000000000 P 9e743421bb6848248124d784dd3fe6ee [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 2a361414698e49a880ae63c23c2991be (127.20.240.254:33559): Network error: Client connection negotiation failed: client connection to 127.20.240.254:33559: connect: Connection refused (error 111)
I20260808 04:40:38.035456 29263 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:38.030455 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.253:34575 (local address 127.0.0.1:53606)
0808 04:40:38.031011 (+ 556us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:38.031023 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:38.031131 (+ 108us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:38.031534 (+ 403us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:38.031537 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:38.031564 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 04:40:38.031662 (+ 98us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:38.031669 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:38.032805 (+ 1136us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:38.032809 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:38.034032 (+ 1223us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:38.034045 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:38.035006 (+ 961us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:38.035010 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:38.035115 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:38.035134 (+ 19us) client_negotiation.cc:769] Sending connection context
0808 04:40:38.035221 (+ 87us) client_negotiation.cc:240] Negotiation successful
0808 04:40:38.035295 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":492,"mutex_wait_us":1,"spinlock_wait_cycles":384,"thread_start_us":70,"threads_started":1}
I20260808 04:40:38.035490 29264 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:38.030650 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37038 (local address 127.20.240.252:39583)
0808 04:40:38.030967 (+ 317us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:38.030972 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:38.030985 (+ 13us) server_negotiation.cc:407] Connection header received
0808 04:40:38.031038 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:38.031041 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:38.031090 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:38.031512 (+ 422us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 04:40:38.031632 (+ 120us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:38.032408 (+ 776us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:38.034155 (+ 1747us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:38.034800 (+ 645us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:38.034924 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:38.034978 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:38.035264 (+ 286us) server_negotiation.cc:299] Negotiation successful
0808 04:40:38.035362 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":235,"spinlock_wait_cycles":1792,"thread_start_us":58,"threads_started":1}
I20260808 04:40:38.035490 29265 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:38.030645 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53606 (local address 127.20.240.253:34575)
0808 04:40:38.030897 (+ 252us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:38.030902 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:38.031217 (+ 315us) server_negotiation.cc:407] Connection header received
0808 04:40:38.031268 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:38.031271 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:38.031326 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:38.031414 (+ 88us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 04:40:38.031809 (+ 395us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:38.032669 (+ 860us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:38.034163 (+ 1494us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:38.034784 (+ 621us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:38.034963 (+ 179us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:38.035016 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:38.035250 (+ 234us) server_negotiation.cc:299] Negotiation successful
0808 04:40:38.035330 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":52,"server-negotiator.queue_time_us":191,"spinlock_wait_cycles":896,"thread_start_us":77,"threads_started":1}
I20260808 04:40:38.035496 29260 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:38.030407 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.252:39583 (local address 127.0.0.1:37038)
0808 04:40:38.030640 (+ 233us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:38.030655 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:38.030758 (+ 103us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:38.031219 (+ 461us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:38.031222 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:38.031244 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 04:40:38.031387 (+ 143us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:38.031400 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:38.032545 (+ 1145us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:38.032548 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:38.033991 (+ 1443us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:38.034003 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:38.035006 (+ 1003us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:38.035010 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:38.035109 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:38.035135 (+ 26us) client_negotiation.cc:769] Sending connection context
0808 04:40:38.035222 (+ 87us) client_negotiation.cc:240] Negotiation successful
0808 04:40:38.035295 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":195,"mutex_wait_us":32,"thread_start_us":92,"threads_started":1}
I20260808 04:40:38.036135 28520 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a6c01c87c3a84bc7a009d59c7f7ee4c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "9e743421bb6848248124d784dd3fe6ee" is_pre_election: true
I20260808 04:40:38.036229 28711 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "9e743421bb6848248124d784dd3fe6ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "a6c01c87c3a84bc7a009d59c7f7ee4c6" is_pre_election: true
I20260808 04:40:38.036398 28520 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 9e743421bb6848248124d784dd3fe6ee [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a6c01c87c3a84bc7a009d59c7f7ee4c6 in term 1.
I20260808 04:40:38.036470 28711 raft_consensus.cc:2454] T 00000000000000000000000000000000 P a6c01c87c3a84bc7a009d59c7f7ee4c6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e743421bb6848248124d784dd3fe6ee in term 1.
I20260808 04:40:38.036760 28686 leader_election.cc:302] T 00000000000000000000000000000000 P a6c01c87c3a84bc7a009d59c7f7ee4c6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e743421bb6848248124d784dd3fe6ee, a6c01c87c3a84bc7a009d59c7f7ee4c6; no voters: 2a361414698e49a880ae63c23c2991be
I20260808 04:40:38.036962 29258 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a6c01c87c3a84bc7a009d59c7f7ee4c6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260808 04:40:38.037019 29258 raft_consensus.cc:482] T 00000000000000000000000000000000 P a6c01c87c3a84bc7a009d59c7f7ee4c6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2a361414698e49a880ae63c23c2991be)
I20260808 04:40:38.037062 29258 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a6c01c87c3a84bc7a009d59c7f7ee4c6 [term 1 FOLLOWER]: Advancing to term 2
I20260808 04:40:38.037278 28495 leader_election.cc:302] T 00000000000000000000000000000000 P 9e743421bb6848248124d784dd3fe6ee [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e743421bb6848248124d784dd3fe6ee, a6c01c87c3a84bc7a009d59c7f7ee4c6; no voters: 2a361414698e49a880ae63c23c2991be
I20260808 04:40:38.037488 29257 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9e743421bb6848248124d784dd3fe6ee [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260808 04:40:38.037554 29257 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9e743421bb6848248124d784dd3fe6ee [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2a361414698e49a880ae63c23c2991be)
I20260808 04:40:38.037592 29257 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9e743421bb6848248124d784dd3fe6ee [term 1 FOLLOWER]: Advancing to term 2
I20260808 04:40:38.038546 29258 raft_consensus.cc:504] T 00000000000000000000000000000000 P a6c01c87c3a84bc7a009d59c7f7ee4c6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "2a361414698e49a880ae63c23c2991be" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 33559 } } peers { permanent_uuid: "9e743421bb6848248124d784dd3fe6ee" member_type: VOTER last_known_addr { host: "127.20.240.253" port: 34575 } attrs { promote: false } } peers { permanent_uuid: "a6c01c87c3a84bc7a009d59c7f7ee4c6" member_type: VOTER last_known_addr { host: "127.20.240.252" port: 39583 } attrs { promote: false } }
I20260808 04:40:38.038833 29257 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9e743421bb6848248124d784dd3fe6ee [term 2 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "2a361414698e49a880ae63c23c2991be" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 33559 } } peers { permanent_uuid: "9e743421bb6848248124d784dd3fe6ee" member_type: VOTER last_known_addr { host: "127.20.240.253" port: 34575 } attrs { promote: false } } peers { permanent_uuid: "a6c01c87c3a84bc7a009d59c7f7ee4c6" member_type: VOTER last_known_addr { host: "127.20.240.252" port: 39583 } attrs { promote: false } }
I20260808 04:40:38.038981 29258 leader_election.cc:288] T 00000000000000000000000000000000 P a6c01c87c3a84bc7a009d59c7f7ee4c6 [CANDIDATE]: Term 2 election: Requested vote from peers 2a361414698e49a880ae63c23c2991be (127.20.240.254:33559), 9e743421bb6848248124d784dd3fe6ee (127.20.240.253:34575)
I20260808 04:40:38.039217 29257 leader_election.cc:288] T 00000000000000000000000000000000 P 9e743421bb6848248124d784dd3fe6ee [CANDIDATE]: Term 2 election: Requested vote from peers 2a361414698e49a880ae63c23c2991be (127.20.240.254:33559), a6c01c87c3a84bc7a009d59c7f7ee4c6 (127.20.240.252:39583)
I20260808 04:40:38.039395 29263 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:38.039131 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:33559 (local address 127.0.0.1:49914)
0808 04:40:38.039261 (+ 130us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:38.039324 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.240.254:33559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
I20260808 04:40:38.039533 28520 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a6c01c87c3a84bc7a009d59c7f7ee4c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "9e743421bb6848248124d784dd3fe6ee"
I20260808 04:40:38.039695 28520 raft_consensus.cc:2379] T 00000000000000000000000000000000 P 9e743421bb6848248124d784dd3fe6ee [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate a6c01c87c3a84bc7a009d59c7f7ee4c6 in current term 2: Already voted for candidate 9e743421bb6848248124d784dd3fe6ee in this term.
I20260808 04:40:38.039706 29260 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:38.039327 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:33559 (local address 127.0.0.1:49918)
0808 04:40:38.039586 (+ 259us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:38.039640 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.240.254:33559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":192}
I20260808 04:40:38.040179 28711 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "9e743421bb6848248124d784dd3fe6ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "a6c01c87c3a84bc7a009d59c7f7ee4c6"
I20260808 04:40:38.040370 28711 raft_consensus.cc:2379] T 00000000000000000000000000000000 P a6c01c87c3a84bc7a009d59c7f7ee4c6 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e743421bb6848248124d784dd3fe6ee in current term 2: Already voted for candidate a6c01c87c3a84bc7a009d59c7f7ee4c6 in this term.
I20260808 04:40:38.040402 29260 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:38.040117 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:33559 (local address 127.0.0.1:49924)
0808 04:40:38.040230 (+ 113us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:38.040284 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.240.254:33559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
W20260808 04:40:38.040552 28495 leader_election.cc:334] T 00000000000000000000000000000000 P 9e743421bb6848248124d784dd3fe6ee [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 2a361414698e49a880ae63c23c2991be (127.20.240.254:33559): Network error: Client connection negotiation failed: client connection to 127.20.240.254:33559: connect: Connection refused (error 111)
I20260808 04:40:38.040689 29263 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:38.040484 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:33559 (local address 127.0.0.1:49926)
0808 04:40:38.040575 (+ 91us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:38.040625 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.240.254:33559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
I20260808 04:40:38.040792 28495 leader_election.cc:302] T 00000000000000000000000000000000 P 9e743421bb6848248124d784dd3fe6ee [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e743421bb6848248124d784dd3fe6ee; no voters: 2a361414698e49a880ae63c23c2991be, a6c01c87c3a84bc7a009d59c7f7ee4c6
W20260808 04:40:38.040831 28686 leader_election.cc:334] T 00000000000000000000000000000000 P a6c01c87c3a84bc7a009d59c7f7ee4c6 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 2a361414698e49a880ae63c23c2991be (127.20.240.254:33559): Network error: Client connection negotiation failed: client connection to 127.20.240.254:33559: connect: Connection refused (error 111)
I20260808 04:40:38.040894 28686 leader_election.cc:302] T 00000000000000000000000000000000 P a6c01c87c3a84bc7a009d59c7f7ee4c6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a6c01c87c3a84bc7a009d59c7f7ee4c6; no voters: 2a361414698e49a880ae63c23c2991be, 9e743421bb6848248124d784dd3fe6ee
I20260808 04:40:38.041015 29258 raft_consensus.cc:2726] T 00000000000000000000000000000000 P a6c01c87c3a84bc7a009d59c7f7ee4c6 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260808 04:40:38.041052 29257 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 9e743421bb6848248124d784dd3fe6ee [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260808 04:40:38.517743 29268 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:38.517249 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:33559 (local address 127.20.240.194:48707)
0808 04:40:38.517556 (+ 307us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:38.517628 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.240.254:33559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":218,"thread_start_us":129,"threads_started":1}
I20260808 04:40:38.519352 29269 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:38.518927 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:33559 (local address 127.20.240.193:40007)
0808 04:40:38.519163 (+ 236us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:38.519232 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.240.254:33559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":166,"thread_start_us":86,"threads_started":1}
I20260808 04:40:38.521854 29270 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:38.521443 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:33559 (local address 127.20.240.195:37201)
0808 04:40:38.521683 (+ 240us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:38.521751 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.240.254:33559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":174,"thread_start_us":109,"threads_started":1}
I20260808 04:40:39.519908 29271 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:39.519225 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:33559 (local address 127.20.240.194:50407)
0808 04:40:39.519530 (+ 305us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:39.519613 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.240.254:33559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":211,"thread_start_us":96,"threads_started":1}
I20260808 04:40:39.520715 29272 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:39.519991 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:33559 (local address 127.20.240.193:49689)
0808 04:40:39.520544 (+ 553us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:39.520612 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.240.254:33559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":470,"thread_start_us":76,"threads_started":1}
I20260808 04:40:39.523066 29273 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:39.522577 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:33559 (local address 127.20.240.195:33565)
0808 04:40:39.522868 (+ 291us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:39.522930 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.240.254:33559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":204,"thread_start_us":68,"threads_started":1}
I20260808 04:40:40.158921 29274 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9e743421bb6848248124d784dd3fe6ee [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 04:40:40.159077 29274 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9e743421bb6848248124d784dd3fe6ee [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "2a361414698e49a880ae63c23c2991be" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 33559 } } peers { permanent_uuid: "9e743421bb6848248124d784dd3fe6ee" member_type: VOTER last_known_addr { host: "127.20.240.253" port: 34575 } attrs { promote: false } } peers { permanent_uuid: "a6c01c87c3a84bc7a009d59c7f7ee4c6" member_type: VOTER last_known_addr { host: "127.20.240.252" port: 39583 } attrs { promote: false } }
I20260808 04:40:40.159497 29274 leader_election.cc:288] T 00000000000000000000000000000000 P 9e743421bb6848248124d784dd3fe6ee [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2a361414698e49a880ae63c23c2991be (127.20.240.254:33559), a6c01c87c3a84bc7a009d59c7f7ee4c6 (127.20.240.252:39583)
I20260808 04:40:40.160205 29275 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:40.159766 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:33559 (local address 127.0.0.1:50258)
0808 04:40:40.160024 (+ 258us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:40.160101 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.240.254:33559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":175,"thread_start_us":104,"threads_started":1}
I20260808 04:40:40.160454 28711 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "9e743421bb6848248124d784dd3fe6ee" candidate_term: 3 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "a6c01c87c3a84bc7a009d59c7f7ee4c6" is_pre_election: true
I20260808 04:40:40.160645 28711 raft_consensus.cc:2454] T 00000000000000000000000000000000 P a6c01c87c3a84bc7a009d59c7f7ee4c6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e743421bb6848248124d784dd3fe6ee in term 2.
I20260808 04:40:40.161070 28495 leader_election.cc:302] T 00000000000000000000000000000000 P 9e743421bb6848248124d784dd3fe6ee [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e743421bb6848248124d784dd3fe6ee, a6c01c87c3a84bc7a009d59c7f7ee4c6; no voters:
I20260808 04:40:40.161206 29275 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:40.160891 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:33559 (local address 127.0.0.1:50260)
0808 04:40:40.161007 (+ 116us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:40.161063 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.240.254:33559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
W20260808 04:40:40.161293 28495 leader_election.cc:334] T 00000000000000000000000000000000 P 9e743421bb6848248124d784dd3fe6ee [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 2a361414698e49a880ae63c23c2991be (127.20.240.254:33559): Network error: Client connection negotiation failed: client connection to 127.20.240.254:33559: connect: Connection refused (error 111)
I20260808 04:40:40.161352 29274 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9e743421bb6848248124d784dd3fe6ee [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260808 04:40:40.161446 29274 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9e743421bb6848248124d784dd3fe6ee [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 04:40:40.161512 29274 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9e743421bb6848248124d784dd3fe6ee [term 2 FOLLOWER]: Advancing to term 3
I20260808 04:40:40.162619 29274 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9e743421bb6848248124d784dd3fe6ee [term 3 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "2a361414698e49a880ae63c23c2991be" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 33559 } } peers { permanent_uuid: "9e743421bb6848248124d784dd3fe6ee" member_type: VOTER last_known_addr { host: "127.20.240.253" port: 34575 } attrs { promote: false } } peers { permanent_uuid: "a6c01c87c3a84bc7a009d59c7f7ee4c6" member_type: VOTER last_known_addr { host: "127.20.240.252" port: 39583 } attrs { promote: false } }
I20260808 04:40:40.162914 29274 leader_election.cc:288] T 00000000000000000000000000000000 P 9e743421bb6848248124d784dd3fe6ee [CANDIDATE]: Term 3 election: Requested vote from peers 2a361414698e49a880ae63c23c2991be (127.20.240.254:33559), a6c01c87c3a84bc7a009d59c7f7ee4c6 (127.20.240.252:39583)
I20260808 04:40:40.163380 29275 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:40.163130 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:33559 (local address 127.0.0.1:50272)
0808 04:40:40.163240 (+ 110us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:40.163300 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.240.254:33559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
I20260808 04:40:40.163630 28711 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "9e743421bb6848248124d784dd3fe6ee" candidate_term: 3 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "a6c01c87c3a84bc7a009d59c7f7ee4c6"
I20260808 04:40:40.163862 28711 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a6c01c87c3a84bc7a009d59c7f7ee4c6 [term 2 FOLLOWER]: Advancing to term 3
I20260808 04:40:40.164110 29275 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:40.163828 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:33559 (local address 127.0.0.1:50282)
0808 04:40:40.163967 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:40.164021 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.240.254:33559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
W20260808 04:40:40.164324 28495 leader_election.cc:334] T 00000000000000000000000000000000 P 9e743421bb6848248124d784dd3fe6ee [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 2a361414698e49a880ae63c23c2991be (127.20.240.254:33559): Network error: Client connection negotiation failed: client connection to 127.20.240.254:33559: connect: Connection refused (error 111)
I20260808 04:40:40.165372 28711 raft_consensus.cc:2454] T 00000000000000000000000000000000 P a6c01c87c3a84bc7a009d59c7f7ee4c6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e743421bb6848248124d784dd3fe6ee in term 3.
I20260808 04:40:40.165696 28495 leader_election.cc:302] T 00000000000000000000000000000000 P 9e743421bb6848248124d784dd3fe6ee [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e743421bb6848248124d784dd3fe6ee, a6c01c87c3a84bc7a009d59c7f7ee4c6; no voters: 2a361414698e49a880ae63c23c2991be
I20260808 04:40:40.165871 29274 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9e743421bb6848248124d784dd3fe6ee [term 3 FOLLOWER]: Leader election won for term 3
I20260808 04:40:40.166070 29274 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9e743421bb6848248124d784dd3fe6ee [term 3 LEADER]: Becoming Leader. State: Replica: 9e743421bb6848248124d784dd3fe6ee, State: Running, Role: LEADER
I20260808 04:40:40.166294 29274 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9e743421bb6848248124d784dd3fe6ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 1.12, Last appended by leader: 12, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "2a361414698e49a880ae63c23c2991be" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 33559 } } peers { permanent_uuid: "9e743421bb6848248124d784dd3fe6ee" member_type: VOTER last_known_addr { host: "127.20.240.253" port: 34575 } attrs { promote: false } } peers { permanent_uuid: "a6c01c87c3a84bc7a009d59c7f7ee4c6" member_type: VOTER last_known_addr { host: "127.20.240.252" port: 39583 } attrs { promote: false } }
I20260808 04:40:40.167716 29277 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9e743421bb6848248124d784dd3fe6ee [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9e743421bb6848248124d784dd3fe6ee. Latest consensus state: current_term: 3 leader_uuid: "9e743421bb6848248124d784dd3fe6ee" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "2a361414698e49a880ae63c23c2991be" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 33559 } } peers { permanent_uuid: "9e743421bb6848248124d784dd3fe6ee" member_type: VOTER last_known_addr { host: "127.20.240.253" port: 34575 } attrs { promote: false } } peers { permanent_uuid: "a6c01c87c3a84bc7a009d59c7f7ee4c6" member_type: VOTER last_known_addr { host: "127.20.240.252" port: 39583 } attrs { promote: false } } }
I20260808 04:40:40.167876 29277 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9e743421bb6848248124d784dd3fe6ee [sys.catalog]: This master's current role is: LEADER
I20260808 04:40:40.168229 29279 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 04:40:40.171195 29279 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 04:40:40.171651 29279 catalog_manager.cc:1259] Loaded cluster ID: b59e5a78215d4b33b7d72afd96aa3b8f
I20260808 04:40:40.171702 29279 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 04:40:40.172327 29279 catalog_manager.cc:1504] Loading token signing keys...
I20260808 04:40:40.172758 29279 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 9e743421bb6848248124d784dd3fe6ee: Loaded TSK: 0
I20260808 04:40:40.173573 29279 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 04:40:40.233104 28511 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53590:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 04:40:40.236372 28511 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 04:40:40.239804 28711 raft_consensus.cc:1261] T 00000000000000000000000000000000 P a6c01c87c3a84bc7a009d59c7f7ee4c6 [term 3 FOLLOWER]: Refusing update from remote peer 9e743421bb6848248124d784dd3fe6ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 12. Preceding OpId from leader: term: 3 index: 14. (index mismatch)
I20260808 04:40:40.239866 29275 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:40.239606 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:33559 (local address 127.0.0.1:50304)
0808 04:40:40.239732 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:40.239790 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.240.254:33559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
I20260808 04:40:40.240428 29274 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 9e743421bb6848248124d784dd3fe6ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "a6c01c87c3a84bc7a009d59c7f7ee4c6" member_type: VOTER last_known_addr { host: "127.20.240.252" port: 39583 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260808 04:40:40.240772 29275 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:40.240528 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:33559 (local address 127.0.0.1:50310)
0808 04:40:40.240650 (+ 122us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:40.240707 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.240.254:33559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
W20260808 04:40:40.240989 28495 consensus_peers.cc:487] T 00000000000000000000000000000000 P 9e743421bb6848248124d784dd3fe6ee -> Peer 2a361414698e49a880ae63c23c2991be (127.20.240.254:33559): Couldn't send request to peer 2a361414698e49a880ae63c23c2991be. Status: Network error: Client connection negotiation failed: client connection to 127.20.240.254:33559: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260808 04:40:40.242224 29281 sys_catalog.cc:455] T 00000000000000000000000000000000 P a6c01c87c3a84bc7a009d59c7f7ee4c6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9e743421bb6848248124d784dd3fe6ee. Latest consensus state: current_term: 3 leader_uuid: "9e743421bb6848248124d784dd3fe6ee" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "2a361414698e49a880ae63c23c2991be" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 33559 } } peers { permanent_uuid: "9e743421bb6848248124d784dd3fe6ee" member_type: VOTER last_known_addr { host: "127.20.240.253" port: 34575 } attrs { promote: false } } peers { permanent_uuid: "a6c01c87c3a84bc7a009d59c7f7ee4c6" member_type: VOTER last_known_addr { host: "127.20.240.252" port: 39583 } attrs { promote: false } } }
I20260808 04:40:40.242364 29281 sys_catalog.cc:458] T 00000000000000000000000000000000 P a6c01c87c3a84bc7a009d59c7f7ee4c6 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 04:40:40.244104 29277 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9e743421bb6848248124d784dd3fe6ee [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 3 leader_uuid: "9e743421bb6848248124d784dd3fe6ee" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "2a361414698e49a880ae63c23c2991be" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 33559 } } peers { permanent_uuid: "9e743421bb6848248124d784dd3fe6ee" member_type: VOTER last_known_addr { host: "127.20.240.253" port: 34575 } attrs { promote: false } } peers { permanent_uuid: "a6c01c87c3a84bc7a009d59c7f7ee4c6" member_type: VOTER last_known_addr { host: "127.20.240.252" port: 39583 } attrs { promote: false } } }
I20260808 04:40:40.244318 29277 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9e743421bb6848248124d784dd3fe6ee [sys.catalog]: This master's current role is: LEADER
I20260808 04:40:40.244256 29281 sys_catalog.cc:455] T 00000000000000000000000000000000 P a6c01c87c3a84bc7a009d59c7f7ee4c6 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 3 leader_uuid: "9e743421bb6848248124d784dd3fe6ee" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "2a361414698e49a880ae63c23c2991be" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 33559 } } peers { permanent_uuid: "9e743421bb6848248124d784dd3fe6ee" member_type: VOTER last_known_addr { host: "127.20.240.253" port: 34575 } attrs { promote: false } } peers { permanent_uuid: "a6c01c87c3a84bc7a009d59c7f7ee4c6" member_type: VOTER last_known_addr { host: "127.20.240.252" port: 39583 } attrs { promote: false } } }
I20260808 04:40:40.244400 29281 sys_catalog.cc:458] T 00000000000000000000000000000000 P a6c01c87c3a84bc7a009d59c7f7ee4c6 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 04:40:40.254812 29275 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:40.250480 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.195:45885 (local address 127.0.0.1:54490)
0808 04:40:40.250579 (+ 99us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:40.250594 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:40.250703 (+ 109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:40.251242 (+ 539us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:40.251245 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:40.251263 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 04:40:40.251372 (+ 109us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:40.251379 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:40.252332 (+ 953us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:40.252335 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:40.253586 (+ 1251us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:40.253598 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:40.254340 (+ 742us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:40.254347 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:40.254473 (+ 126us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:40.254511 (+ 38us) client_negotiation.cc:769] Sending connection context
0808 04:40:40.254566 (+ 55us) client_negotiation.cc:240] Negotiation successful
0808 04:40:40.254642 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":27,"mutex_wait_us":1}
I20260808 04:40:40.255316 29287 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:40.250591 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54490 (local address 127.20.240.195:45885)
0808 04:40:40.250850 (+ 259us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:40.250855 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:40.250868 (+ 13us) server_negotiation.cc:407] Connection header received
0808 04:40:40.250911 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:40.250913 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:40.250974 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:40.251066 (+ 92us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 04:40:40.251505 (+ 439us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:40.252209 (+ 704us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:40.253693 (+ 1484us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:40.254194 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:40.255053 (+ 859us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:40.255115 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:40.255147 (+ 32us) server_negotiation.cc:299] Negotiation successful
0808 04:40:40.255208 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":174,"thread_start_us":75,"threads_started":1}
I20260808 04:40:40.256031 29112 tablet_service.cc:1467] Processing CreateTablet for tablet c8a2da6ac9eb4f2dabe011305669a899 (DEFAULT_TABLE table=test-table [id=132c01d0e7f04e6e95be8675d66e90a8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 04:40:40.256198 29288 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:40.251007 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.193:41911 (local address 127.0.0.1:36662)
0808 04:40:40.251664 (+ 657us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:40.251678 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:40.251757 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:40.252455 (+ 698us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:40.252459 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:40.252481 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 04:40:40.252605 (+ 124us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:40.252611 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:40.253636 (+ 1025us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:40.253640 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:40.254890 (+ 1250us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:40.254904 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:40.255799 (+ 895us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:40.255803 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:40.255891 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:40.255913 (+ 22us) client_negotiation.cc:769] Sending connection context
0808 04:40:40.255993 (+ 80us) client_negotiation.cc:240] Negotiation successful
0808 04:40:40.256057 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":591,"mutex_wait_us":5,"thread_start_us":97,"threads_started":1}
I20260808 04:40:40.256253 29291 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:40.251403 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36662 (local address 127.20.240.193:41911)
0808 04:40:40.252192 (+ 789us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:40.252196 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:40.252208 (+ 12us) server_negotiation.cc:407] Connection header received
0808 04:40:40.252284 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:40.252289 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:40.252340 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:40.252428 (+ 88us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 04:40:40.252727 (+ 299us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:40.253517 (+ 790us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:40.255055 (+ 1538us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:40.255702 (+ 647us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:40.255815 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:40.255874 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:40.256024 (+ 150us) server_negotiation.cc:299] Negotiation successful
0808 04:40:40.256109 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":697,"thread_start_us":105,"threads_started":1}
I20260808 04:40:40.256362 29112 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c8a2da6ac9eb4f2dabe011305669a899. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:40:40.256714 28823 tablet_service.cc:1467] Processing CreateTablet for tablet c8a2da6ac9eb4f2dabe011305669a899 (DEFAULT_TABLE table=test-table [id=132c01d0e7f04e6e95be8675d66e90a8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 04:40:40.256896 29289 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:40.251007 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.194:44761 (local address 127.0.0.1:37340)
0808 04:40:40.251932 (+ 925us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:40.251947 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:40.252095 (+ 148us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:40.252495 (+ 400us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:40.252497 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:40.252510 (+ 13us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 04:40:40.252605 (+ 95us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:40.252611 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:40.254035 (+ 1424us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:40.254038 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:40.255597 (+ 1559us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:40.255608 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:40.256482 (+ 874us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:40.256486 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:40.256571 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:40.256592 (+ 21us) client_negotiation.cc:769] Sending connection context
0808 04:40:40.256690 (+ 98us) client_negotiation.cc:240] Negotiation successful
0808 04:40:40.256759 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":865,"mutex_wait_us":69,"thread_start_us":89,"threads_started":1}
I20260808 04:40:40.256901 29290 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:40.251142 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37340 (local address 127.20.240.194:44761)
0808 04:40:40.251695 (+ 553us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:40.251700 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:40.252025 (+ 325us) server_negotiation.cc:407] Connection header received
0808 04:40:40.252206 (+ 181us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:40.252209 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:40.252270 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:40.252363 (+ 93us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 04:40:40.253255 (+ 892us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:40.253902 (+ 647us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:40.255733 (+ 1831us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:40.256381 (+ 648us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:40.256499 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:40.256548 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:40.256707 (+ 159us) server_negotiation.cc:299] Negotiation successful
0808 04:40:40.256780 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":478,"thread_start_us":129,"threads_started":1}
I20260808 04:40:40.256980 28823 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c8a2da6ac9eb4f2dabe011305669a899. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:40:40.259130 29292 tablet_bootstrap.cc:492] T c8a2da6ac9eb4f2dabe011305669a899 P a19d6220e3f74533a788ce03b62f1944: Bootstrap starting.
I20260808 04:40:40.259987 28966 tablet_service.cc:1467] Processing CreateTablet for tablet c8a2da6ac9eb4f2dabe011305669a899 (DEFAULT_TABLE table=test-table [id=132c01d0e7f04e6e95be8675d66e90a8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 04:40:40.260092 29292 tablet_bootstrap.cc:654] T c8a2da6ac9eb4f2dabe011305669a899 P a19d6220e3f74533a788ce03b62f1944: Neither blocks nor log segments found. Creating new log.
I20260808 04:40:40.260281 28966 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c8a2da6ac9eb4f2dabe011305669a899. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:40:40.261487 29292 tablet_bootstrap.cc:492] T c8a2da6ac9eb4f2dabe011305669a899 P a19d6220e3f74533a788ce03b62f1944: No bootstrap required, opened a new log
I20260808 04:40:40.261597 29292 ts_tablet_manager.cc:1397] T c8a2da6ac9eb4f2dabe011305669a899 P a19d6220e3f74533a788ce03b62f1944: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260808 04:40:40.262066 29292 raft_consensus.cc:348] T c8a2da6ac9eb4f2dabe011305669a899 P a19d6220e3f74533a788ce03b62f1944 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a19d6220e3f74533a788ce03b62f1944" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 45885 } } peers { permanent_uuid: "13451d5e45d9432c9a40de3584233526" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 41911 } } peers { permanent_uuid: "6135fa034b434540bf65da8cedaf4de2" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 44761 } }
I20260808 04:40:40.262209 29292 raft_consensus.cc:374] T c8a2da6ac9eb4f2dabe011305669a899 P a19d6220e3f74533a788ce03b62f1944 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:40:40.262247 29292 raft_consensus.cc:729] T c8a2da6ac9eb4f2dabe011305669a899 P a19d6220e3f74533a788ce03b62f1944 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a19d6220e3f74533a788ce03b62f1944, State: Initialized, Role: FOLLOWER
I20260808 04:40:40.262409 29292 consensus_queue.cc:260] T c8a2da6ac9eb4f2dabe011305669a899 P a19d6220e3f74533a788ce03b62f1944 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a19d6220e3f74533a788ce03b62f1944" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 45885 } } peers { permanent_uuid: "13451d5e45d9432c9a40de3584233526" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 41911 } } peers { permanent_uuid: "6135fa034b434540bf65da8cedaf4de2" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 44761 } }
I20260808 04:40:40.262804 29292 ts_tablet_manager.cc:1428] T c8a2da6ac9eb4f2dabe011305669a899 P a19d6220e3f74533a788ce03b62f1944: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260808 04:40:40.262944 29297 tablet_bootstrap.cc:492] T c8a2da6ac9eb4f2dabe011305669a899 P 6135fa034b434540bf65da8cedaf4de2: Bootstrap starting.
I20260808 04:40:40.263574 29293 tablet_bootstrap.cc:492] T c8a2da6ac9eb4f2dabe011305669a899 P 13451d5e45d9432c9a40de3584233526: Bootstrap starting.
I20260808 04:40:40.263911 29297 tablet_bootstrap.cc:654] T c8a2da6ac9eb4f2dabe011305669a899 P 6135fa034b434540bf65da8cedaf4de2: Neither blocks nor log segments found. Creating new log.
I20260808 04:40:40.264565 29293 tablet_bootstrap.cc:654] T c8a2da6ac9eb4f2dabe011305669a899 P 13451d5e45d9432c9a40de3584233526: Neither blocks nor log segments found. Creating new log.
I20260808 04:40:40.264814 29298 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:40.263203 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:33559 (local address 127.20.240.195:33271)
0808 04:40:40.264631 (+ 1428us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:40.264697 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.240.254:33559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1359,"thread_start_us":92,"threads_started":1}
I20260808 04:40:40.265859 29297 tablet_bootstrap.cc:492] T c8a2da6ac9eb4f2dabe011305669a899 P 6135fa034b434540bf65da8cedaf4de2: No bootstrap required, opened a new log
I20260808 04:40:40.265939 29297 ts_tablet_manager.cc:1397] T c8a2da6ac9eb4f2dabe011305669a899 P 6135fa034b434540bf65da8cedaf4de2: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260808 04:40:40.266224 29184 heartbeater.cc:503] Master 127.20.240.253:34575 was elected leader, sending a full tablet report...
I20260808 04:40:40.266345 29298 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:40.265885 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:33559 (local address 127.20.240.195:39675)
0808 04:40:40.266175 (+ 290us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:40.266229 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.240.254:33559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":223}
I20260808 04:40:40.266434 29297 raft_consensus.cc:348] T c8a2da6ac9eb4f2dabe011305669a899 P 6135fa034b434540bf65da8cedaf4de2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a19d6220e3f74533a788ce03b62f1944" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 45885 } } peers { permanent_uuid: "13451d5e45d9432c9a40de3584233526" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 41911 } } peers { permanent_uuid: "6135fa034b434540bf65da8cedaf4de2" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 44761 } }
I20260808 04:40:40.266791 29297 raft_consensus.cc:374] T c8a2da6ac9eb4f2dabe011305669a899 P 6135fa034b434540bf65da8cedaf4de2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:40:40.266839 29297 raft_consensus.cc:729] T c8a2da6ac9eb4f2dabe011305669a899 P 6135fa034b434540bf65da8cedaf4de2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6135fa034b434540bf65da8cedaf4de2, State: Initialized, Role: FOLLOWER
I20260808 04:40:40.266968 29297 consensus_queue.cc:260] T c8a2da6ac9eb4f2dabe011305669a899 P 6135fa034b434540bf65da8cedaf4de2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a19d6220e3f74533a788ce03b62f1944" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 45885 } } peers { permanent_uuid: "13451d5e45d9432c9a40de3584233526" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 41911 } } peers { permanent_uuid: "6135fa034b434540bf65da8cedaf4de2" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 44761 } }
I20260808 04:40:40.267367 29297 ts_tablet_manager.cc:1428] T c8a2da6ac9eb4f2dabe011305669a899 P 6135fa034b434540bf65da8cedaf4de2: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20260808 04:40:40.268077 29302 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:40.267642 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:33559 (local address 127.20.240.194:37379)
0808 04:40:40.267903 (+ 261us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:40.267968 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.240.254:33559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":187,"thread_start_us":107,"threads_started":1}
I20260808 04:40:40.268457 29293 tablet_bootstrap.cc:492] T c8a2da6ac9eb4f2dabe011305669a899 P 13451d5e45d9432c9a40de3584233526: No bootstrap required, opened a new log
I20260808 04:40:40.268567 29293 ts_tablet_manager.cc:1397] T c8a2da6ac9eb4f2dabe011305669a899 P 13451d5e45d9432c9a40de3584233526: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
I20260808 04:40:40.268847 29302 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:40.268618 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:33559 (local address 127.20.240.194:39133)
0808 04:40:40.268720 (+ 102us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:40.268782 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.240.254:33559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
I20260808 04:40:40.269068 29293 raft_consensus.cc:348] T c8a2da6ac9eb4f2dabe011305669a899 P 13451d5e45d9432c9a40de3584233526 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a19d6220e3f74533a788ce03b62f1944" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 45885 } } peers { permanent_uuid: "13451d5e45d9432c9a40de3584233526" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 41911 } } peers { permanent_uuid: "6135fa034b434540bf65da8cedaf4de2" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 44761 } }
I20260808 04:40:40.269223 29293 raft_consensus.cc:374] T c8a2da6ac9eb4f2dabe011305669a899 P 13451d5e45d9432c9a40de3584233526 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:40:40.269270 29293 raft_consensus.cc:729] T c8a2da6ac9eb4f2dabe011305669a899 P 13451d5e45d9432c9a40de3584233526 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 13451d5e45d9432c9a40de3584233526, State: Initialized, Role: FOLLOWER
I20260808 04:40:40.269403 29293 consensus_queue.cc:260] T c8a2da6ac9eb4f2dabe011305669a899 P 13451d5e45d9432c9a40de3584233526 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a19d6220e3f74533a788ce03b62f1944" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 45885 } } peers { permanent_uuid: "13451d5e45d9432c9a40de3584233526" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 41911 } } peers { permanent_uuid: "6135fa034b434540bf65da8cedaf4de2" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 44761 } }
I20260808 04:40:40.269763 29293 ts_tablet_manager.cc:1428] T c8a2da6ac9eb4f2dabe011305669a899 P 13451d5e45d9432c9a40de3584233526: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
W20260808 04:40:40.269835 29038 tablet.cc:2369] T c8a2da6ac9eb4f2dabe011305669a899 P 6135fa034b434540bf65da8cedaf4de2: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 04:40:40.270329 29037 heartbeater.cc:503] Master 127.20.240.253:34575 was elected leader, sending a full tablet report...
I20260808 04:40:40.270790 29304 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:40.270362 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:33559 (local address 127.20.240.193:58259)
0808 04:40:40.270631 (+ 269us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:40.270697 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.240.254:33559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":195,"thread_start_us":110,"threads_started":1}
I20260808 04:40:40.271803 28893 heartbeater.cc:503] Master 127.20.240.253:34575 was elected leader, sending a full tablet report...
I20260808 04:40:40.271951 29304 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:40.271557 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:33559 (local address 127.20.240.193:37443)
0808 04:40:40.271819 (+ 262us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:40.271883 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.240.254:33559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":177}
W20260808 04:40:40.313607 28894 tablet.cc:2369] T c8a2da6ac9eb4f2dabe011305669a899 P 13451d5e45d9432c9a40de3584233526: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 04:40:40.472342 29296 raft_consensus.cc:482] T c8a2da6ac9eb4f2dabe011305669a899 P a19d6220e3f74533a788ce03b62f1944 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 04:40:40.472502 29296 raft_consensus.cc:504] T c8a2da6ac9eb4f2dabe011305669a899 P a19d6220e3f74533a788ce03b62f1944 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a19d6220e3f74533a788ce03b62f1944" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 45885 } } peers { permanent_uuid: "13451d5e45d9432c9a40de3584233526" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 41911 } } peers { permanent_uuid: "6135fa034b434540bf65da8cedaf4de2" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 44761 } }
I20260808 04:40:40.473843 29296 leader_election.cc:288] T c8a2da6ac9eb4f2dabe011305669a899 P a19d6220e3f74533a788ce03b62f1944 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 13451d5e45d9432c9a40de3584233526 (127.20.240.193:41911), 6135fa034b434540bf65da8cedaf4de2 (127.20.240.194:44761)
I20260808 04:40:40.479413 29290 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:40.474217 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.240.195:52825 (local address 127.20.240.194:44761)
0808 04:40:40.474339 (+ 122us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:40.474344 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:40.474436 (+ 92us) server_negotiation.cc:407] Connection header received
0808 04:40:40.474638 (+ 202us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:40.474642 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:40.474705 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:40.474830 (+ 125us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 04:40:40.475321 (+ 491us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:40.476154 (+ 833us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:40.478078 (+ 1924us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:40.478702 (+ 624us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:40.478837 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:40.478931 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:40.479185 (+ 254us) server_negotiation.cc:299] Negotiation successful
0808 04:40:40.479267 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260808 04:40:40.479420 29291 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:40.474216 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.240.195:45829 (local address 127.20.240.193:41911)
0808 04:40:40.474376 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:40.474382 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:40.474609 (+ 227us) server_negotiation.cc:407] Connection header received
0808 04:40:40.474698 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:40.474701 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:40.474760 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:40.474846 (+ 86us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 04:40:40.475322 (+ 476us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:40.476132 (+ 810us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:40.478078 (+ 1946us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:40.478702 (+ 624us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:40.478837 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:40.478894 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:40.479185 (+ 291us) server_negotiation.cc:299] Negotiation successful
0808 04:40:40.479267 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260808 04:40:40.479467 29298 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:40.474101 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.194:44761 (local address 127.20.240.195:52825)
0808 04:40:40.474320 (+ 219us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:40.474336 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:40.474483 (+ 147us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:40.474907 (+ 424us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:40.474911 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:40.474944 (+ 33us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 04:40:40.475150 (+ 206us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:40.475158 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:40.476290 (+ 1132us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:40.476293 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:40.477932 (+ 1639us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:40.477944 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:40.478864 (+ 920us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:40.478868 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:40.479001 (+ 133us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:40.479074 (+ 73us) client_negotiation.cc:769] Sending connection context
0808 04:40:40.479155 (+ 81us) client_negotiation.cc:240] Negotiation successful
0808 04:40:40.479290 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":134,"mutex_wait_us":225,"spinlock_wait_cycles":2816}
I20260808 04:40:40.479478 29305 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:40.474101 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.193:41911 (local address 127.20.240.195:45829)
0808 04:40:40.474510 (+ 409us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:40.474524 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:40.474622 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:40.474908 (+ 286us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:40.474911 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:40.474949 (+ 38us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 04:40:40.475150 (+ 201us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:40.475158 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:40.476290 (+ 1132us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:40.476293 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:40.477956 (+ 1663us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:40.477962 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:40.478864 (+ 902us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:40.478868 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:40.479027 (+ 159us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:40.479073 (+ 46us) client_negotiation.cc:769] Sending connection context
0808 04:40:40.479155 (+ 82us) client_negotiation.cc:240] Negotiation successful
0808 04:40:40.479290 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":352,"mutex_wait_us":327,"spinlock_wait_cycles":18048,"thread_start_us":161,"threads_started":1}
I20260808 04:40:40.480077 28987 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8a2da6ac9eb4f2dabe011305669a899" candidate_uuid: "a19d6220e3f74533a788ce03b62f1944" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6135fa034b434540bf65da8cedaf4de2" is_pre_election: true
I20260808 04:40:40.480270 28987 raft_consensus.cc:2454] T c8a2da6ac9eb4f2dabe011305669a899 P 6135fa034b434540bf65da8cedaf4de2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a19d6220e3f74533a788ce03b62f1944 in term 0.
I20260808 04:40:40.480330 28844 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8a2da6ac9eb4f2dabe011305669a899" candidate_uuid: "a19d6220e3f74533a788ce03b62f1944" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13451d5e45d9432c9a40de3584233526" is_pre_election: true
I20260808 04:40:40.480623 28844 raft_consensus.cc:2454] T c8a2da6ac9eb4f2dabe011305669a899 P 13451d5e45d9432c9a40de3584233526 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a19d6220e3f74533a788ce03b62f1944 in term 0.
I20260808 04:40:40.480770 29067 leader_election.cc:302] T c8a2da6ac9eb4f2dabe011305669a899 P a19d6220e3f74533a788ce03b62f1944 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6135fa034b434540bf65da8cedaf4de2, a19d6220e3f74533a788ce03b62f1944; no voters:
I20260808 04:40:40.481094 29296 raft_consensus.cc:2781] T c8a2da6ac9eb4f2dabe011305669a899 P a19d6220e3f74533a788ce03b62f1944 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 04:40:40.481172 29296 raft_consensus.cc:482] T c8a2da6ac9eb4f2dabe011305669a899 P a19d6220e3f74533a788ce03b62f1944 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 04:40:40.481213 29296 raft_consensus.cc:3037] T c8a2da6ac9eb4f2dabe011305669a899 P a19d6220e3f74533a788ce03b62f1944 [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:40:40.482270 29296 raft_consensus.cc:504] T c8a2da6ac9eb4f2dabe011305669a899 P a19d6220e3f74533a788ce03b62f1944 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a19d6220e3f74533a788ce03b62f1944" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 45885 } } peers { permanent_uuid: "13451d5e45d9432c9a40de3584233526" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 41911 } } peers { permanent_uuid: "6135fa034b434540bf65da8cedaf4de2" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 44761 } }
I20260808 04:40:40.482612 29296 leader_election.cc:288] T c8a2da6ac9eb4f2dabe011305669a899 P a19d6220e3f74533a788ce03b62f1944 [CANDIDATE]: Term 1 election: Requested vote from peers 13451d5e45d9432c9a40de3584233526 (127.20.240.193:41911), 6135fa034b434540bf65da8cedaf4de2 (127.20.240.194:44761)
I20260808 04:40:40.482926 28844 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8a2da6ac9eb4f2dabe011305669a899" candidate_uuid: "a19d6220e3f74533a788ce03b62f1944" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13451d5e45d9432c9a40de3584233526"
I20260808 04:40:40.482969 28987 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8a2da6ac9eb4f2dabe011305669a899" candidate_uuid: "a19d6220e3f74533a788ce03b62f1944" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6135fa034b434540bf65da8cedaf4de2"
I20260808 04:40:40.483072 28844 raft_consensus.cc:3037] T c8a2da6ac9eb4f2dabe011305669a899 P 13451d5e45d9432c9a40de3584233526 [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:40:40.483098 28987 raft_consensus.cc:3037] T c8a2da6ac9eb4f2dabe011305669a899 P 6135fa034b434540bf65da8cedaf4de2 [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:40:40.484148 28844 raft_consensus.cc:2454] T c8a2da6ac9eb4f2dabe011305669a899 P 13451d5e45d9432c9a40de3584233526 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a19d6220e3f74533a788ce03b62f1944 in term 1.
I20260808 04:40:40.484162 28987 raft_consensus.cc:2454] T c8a2da6ac9eb4f2dabe011305669a899 P 6135fa034b434540bf65da8cedaf4de2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a19d6220e3f74533a788ce03b62f1944 in term 1.
I20260808 04:40:40.484428 29067 leader_election.cc:302] T c8a2da6ac9eb4f2dabe011305669a899 P a19d6220e3f74533a788ce03b62f1944 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6135fa034b434540bf65da8cedaf4de2, a19d6220e3f74533a788ce03b62f1944; no voters:
I20260808 04:40:40.484611 29296 raft_consensus.cc:2781] T c8a2da6ac9eb4f2dabe011305669a899 P a19d6220e3f74533a788ce03b62f1944 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 04:40:40.484957 29296 raft_consensus.cc:686] T c8a2da6ac9eb4f2dabe011305669a899 P a19d6220e3f74533a788ce03b62f1944 [term 1 LEADER]: Becoming Leader. State: Replica: a19d6220e3f74533a788ce03b62f1944, State: Running, Role: LEADER
I20260808 04:40:40.485332 29296 consensus_queue.cc:237] T c8a2da6ac9eb4f2dabe011305669a899 P a19d6220e3f74533a788ce03b62f1944 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a19d6220e3f74533a788ce03b62f1944" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 45885 } } peers { permanent_uuid: "13451d5e45d9432c9a40de3584233526" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 41911 } } peers { permanent_uuid: "6135fa034b434540bf65da8cedaf4de2" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 44761 } }
I20260808 04:40:40.485759 29305 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:40.485470 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:33559 (local address 127.20.240.195:36689)
0808 04:40:40.485627 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:40.485687 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.240.254:33559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":80}
I20260808 04:40:40.488021 28511 catalog_manager.cc:5495] T c8a2da6ac9eb4f2dabe011305669a899 P a19d6220e3f74533a788ce03b62f1944 reported cstate change: term changed from 0 to 1, leader changed from <none> to a19d6220e3f74533a788ce03b62f1944 (127.20.240.195). New cstate: current_term: 1 leader_uuid: "a19d6220e3f74533a788ce03b62f1944" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a19d6220e3f74533a788ce03b62f1944" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 45885 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "13451d5e45d9432c9a40de3584233526" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 41911 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6135fa034b434540bf65da8cedaf4de2" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 44761 } health_report { overall_health: UNKNOWN } } }
I20260808 04:40:40.551210 29287 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:40.547210 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54492 (local address 127.20.240.195:45885)
0808 04:40:40.547351 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:40.547355 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:40.547369 (+ 14us) server_negotiation.cc:407] Connection header received
0808 04:40:40.547450 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:40.547452 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:40.547507 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:40.547611 (+ 104us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 04:40:40.547846 (+ 235us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:40.548366 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:40.549270 (+ 904us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:40.549644 (+ 374us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:40.549794 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:40.550148 (+ 354us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 04:40:40.550655 (+ 507us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 04:40:40.550880 (+ 225us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:40.550950 (+ 70us) server_negotiation.cc:299] Negotiation successful
0808 04:40:40.551033 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260808 04:40:40.554513 28987 raft_consensus.cc:1261] T c8a2da6ac9eb4f2dabe011305669a899 P 6135fa034b434540bf65da8cedaf4de2 [term 1 FOLLOWER]: Refusing update from remote peer a19d6220e3f74533a788ce03b62f1944: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 04:40:40.554857 28844 raft_consensus.cc:1261] T c8a2da6ac9eb4f2dabe011305669a899 P 13451d5e45d9432c9a40de3584233526 [term 1 FOLLOWER]: Refusing update from remote peer a19d6220e3f74533a788ce03b62f1944: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 04:40:40.555101 29306 consensus_queue.cc:1035] T c8a2da6ac9eb4f2dabe011305669a899 P a19d6220e3f74533a788ce03b62f1944 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6135fa034b434540bf65da8cedaf4de2" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 44761 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 04:40:40.555472 29296 consensus_queue.cc:1035] T c8a2da6ac9eb4f2dabe011305669a899 P a19d6220e3f74533a788ce03b62f1944 [LEADER]: Connected to new peer: Peer: permanent_uuid: "13451d5e45d9432c9a40de3584233526" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 41911 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 04:40:40.557241 29302 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:40.556902 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:33559 (local address 127.20.240.194:47927)
0808 04:40:40.557062 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:40.557125 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.240.254:33559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":93}
I20260808 04:40:40.559024 29304 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:40.557719 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:33559 (local address 127.20.240.193:46207)
0808 04:40:40.558874 (+ 1155us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:40.558940 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.240.254:33559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1076}
I20260808 04:40:40.560596 29310 mvcc.cc:205] Tried to move back new op lower bound from 7316127910105239552 to 7316127909830742016. Current Snapshot: MvccSnapshot[applied={T|T < 7316127910105239552}]
I20260808 04:40:40.560945 29305 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:40.560385 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:33559 (local address 127.20.240.195:50523)
0808 04:40:40.560802 (+ 417us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:40.560861 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.240.254:33559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":344}
I20260808 04:40:40.561280 29302 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:40.560873 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:33559 (local address 127.20.240.194:56333)
0808 04:40:40.561122 (+ 249us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:40.561205 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.240.254:33559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":180}
I20260808 04:40:40.564065 29305 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:40.563818 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:33559 (local address 127.20.240.195:44903)
0808 04:40:40.563934 (+ 116us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:40.563992 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.240.254:33559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
I20260808 04:40:40.564535 29312 mvcc.cc:205] Tried to move back new op lower bound from 7316127910105239552 to 7316127909830742016. Current Snapshot: MvccSnapshot[applied={T|T < 7316127910105239552}]
I20260808 04:40:40.565193 29304 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:40.564943 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:33559 (local address 127.20.240.193:48923)
0808 04:40:40.565042 (+ 99us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:40.565100 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.240.254:33559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
I20260808 04:40:40.570624 28510 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53590:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 04:40:40.570803 28510 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53590:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 04:40:40.574936 28510 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 9e743421bb6848248124d784dd3fe6ee: Sending DeleteTablet for 3 replicas of tablet c8a2da6ac9eb4f2dabe011305669a899
I20260808 04:40:40.575608 29112 tablet_service.cc:1514] Processing DeleteTablet for tablet c8a2da6ac9eb4f2dabe011305669a899 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 04:40:40 UTC) from {username='oryx', principal='oryx/127.20.240.253@KRBTEST.COM'} at 127.0.0.1:54490
I20260808 04:40:40.576007 29319 tablet_replica.cc:330] T c8a2da6ac9eb4f2dabe011305669a899 P a19d6220e3f74533a788ce03b62f1944: stopping tablet replica
I20260808 04:40:40.576035 28823 tablet_service.cc:1514] Processing DeleteTablet for tablet c8a2da6ac9eb4f2dabe011305669a899 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 04:40:40 UTC) from {username='oryx', principal='oryx/127.20.240.253@KRBTEST.COM'} at 127.0.0.1:36662
I20260808 04:40:40.576232 29319 raft_consensus.cc:2229] T c8a2da6ac9eb4f2dabe011305669a899 P a19d6220e3f74533a788ce03b62f1944 [term 1 LEADER]: Raft consensus shutting down.
I20260808 04:40:40.576303 28966 tablet_service.cc:1514] Processing DeleteTablet for tablet c8a2da6ac9eb4f2dabe011305669a899 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 04:40:40 UTC) from {username='oryx', principal='oryx/127.20.240.253@KRBTEST.COM'} at 127.0.0.1:37340
I20260808 04:40:40.576581 29319 raft_consensus.cc:2258] T c8a2da6ac9eb4f2dabe011305669a899 P a19d6220e3f74533a788ce03b62f1944 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 04:40:40.576983 29321 tablet_replica.cc:330] T c8a2da6ac9eb4f2dabe011305669a899 P 6135fa034b434540bf65da8cedaf4de2: stopping tablet replica
I20260808 04:40:40.577143 29321 raft_consensus.cc:2229] T c8a2da6ac9eb4f2dabe011305669a899 P 6135fa034b434540bf65da8cedaf4de2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 04:40:40.577479 21443 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu with pid 28660
I20260808 04:40:40.577544 29319 ts_tablet_manager.cc:1905] T c8a2da6ac9eb4f2dabe011305669a899 P a19d6220e3f74533a788ce03b62f1944: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 04:40:40.577597 29320 tablet_replica.cc:330] T c8a2da6ac9eb4f2dabe011305669a899 P 13451d5e45d9432c9a40de3584233526: stopping tablet replica
I20260808 04:40:40.577706 29320 raft_consensus.cc:2229] T c8a2da6ac9eb4f2dabe011305669a899 P 13451d5e45d9432c9a40de3584233526 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 04:40:40.577818 29320 raft_consensus.cc:2258] T c8a2da6ac9eb4f2dabe011305669a899 P 13451d5e45d9432c9a40de3584233526 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 04:40:40.577991 29321 raft_consensus.cc:2258] T c8a2da6ac9eb4f2dabe011305669a899 P 6135fa034b434540bf65da8cedaf4de2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 04:40:40.579294 29321 ts_tablet_manager.cc:1905] T c8a2da6ac9eb4f2dabe011305669a899 P 6135fa034b434540bf65da8cedaf4de2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 04:40:40.581485 29319 ts_tablet_manager.cc:1918] T c8a2da6ac9eb4f2dabe011305669a899 P a19d6220e3f74533a788ce03b62f1944: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 04:40:40.581614 29319 log.cc:1196] T c8a2da6ac9eb4f2dabe011305669a899 P a19d6220e3f74533a788ce03b62f1944: Deleting WAL directory at /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164000593138-21443-0/minicluster-data/ts-2/wal/wals/c8a2da6ac9eb4f2dabe011305669a899
I20260808 04:40:40.581938 29319 ts_tablet_manager.cc:1939] T c8a2da6ac9eb4f2dabe011305669a899 P a19d6220e3f74533a788ce03b62f1944: Deleting consensus metadata
I20260808 04:40:40.582015 29321 ts_tablet_manager.cc:1918] T c8a2da6ac9eb4f2dabe011305669a899 P 6135fa034b434540bf65da8cedaf4de2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 04:40:40.582129 29321 log.cc:1196] T c8a2da6ac9eb4f2dabe011305669a899 P 6135fa034b434540bf65da8cedaf4de2: Deleting WAL directory at /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164000593138-21443-0/minicluster-data/ts-1/wal/wals/c8a2da6ac9eb4f2dabe011305669a899
I20260808 04:40:40.582428 29321 ts_tablet_manager.cc:1939] T c8a2da6ac9eb4f2dabe011305669a899 P 6135fa034b434540bf65da8cedaf4de2: Deleting consensus metadata
I20260808 04:40:40.583293 28497 catalog_manager.cc:4841] TS 6135fa034b434540bf65da8cedaf4de2 (127.20.240.194:44761): tablet c8a2da6ac9eb4f2dabe011305669a899 (table test-table [id=132c01d0e7f04e6e95be8675d66e90a8]) successfully deleted
I20260808 04:40:40.583860 28497 catalog_manager.cc:4841] TS a19d6220e3f74533a788ce03b62f1944 (127.20.240.195:45885): tablet c8a2da6ac9eb4f2dabe011305669a899 (table test-table [id=132c01d0e7f04e6e95be8675d66e90a8]) successfully deleted
I20260808 04:40:40.593307 21443 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu with pid 28901
I20260808 04:40:40.593473 29289 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:40.593019 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.193:41911 (local address 127.0.0.1:36664)
0808 04:40:40.593290 (+ 271us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:40.593362 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.240.193:41911: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":164}
W20260808 04:40:40.595965 28495 catalog_manager.cc:4584] TS 13451d5e45d9432c9a40de3584233526 (127.20.240.193:41911): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet c8a2da6ac9eb4f2dabe011305669a899: Network error: Client connection negotiation failed: client connection to 127.20.240.193:41911: connect: Connection refused (error 111)
I20260808 04:40:40.600011 21443 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu with pid 29042
I20260808 04:40:40.606846 21443 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu with pid 28367
I20260808 04:40:40.614741 21443 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu with pid 28476
2026-08-08T04:40:40Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipalMultipleMaster (7948 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786164000593138-21443-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 04:40:40 dist-test-slave-vxj2 krb5kdc[29324](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 04:40:40 dist-test-slave-vxj2 krb5kdc[29324](info): set up 2 sockets
Aug 08 04:40:40 dist-test-slave-vxj2 krb5kdc[29324](info): commencing operation
krb5kdc: starting...
W20260808 04:40:41.729457 21443 mini_kdc.cc:121] Time spent starting KDC: real 1.089s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786164000593138-21443-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786164000593138-21443-0/krb5kdc/test-user.keytab.
Aug 08 04:40:41 dist-test-slave-vxj2 krb5kdc[29324](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164041, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T04:40:41Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T04:40:41Z Disabled control of system clock
WARNING: no policy specified for oryx/127.20.240.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.20.240.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.20.240.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786164000593138-21443-0/krb5kdc/oryx_127.20.240.254.keytab.
Entry for principal oryx/127.20.240.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786164000593138-21443-0/krb5kdc/oryx_127.20.240.254.keytab.
I20260808 04:40:41.865008 21443 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
/tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786164000593138-21443-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786164000593138-21443-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786164000593138-21443-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786164000593138-21443-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.240.254:43347
--webserver_interface=127.20.240.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786164000593138-21443-0/krb5kdc/oryx_127.20.240.254.keytab
--principal=oryx/127.20.240.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.240.212:42929
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.240.254:43347
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786164000593138-21443-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786164000593138-21443-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786164000593138-21443-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 04:40:41.979035 29338 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:40:41.979400 29338 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:40:41.979485 29338 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:40:41.983709 29338 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 04:40:41.983814 29338 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260808 04:40:41.983847 29338 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:40:41.983898 29338 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:40:41.983942 29338 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 04:40:41.983979 29338 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 04:40:41.989603 29338 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.240.212:42929
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786164000593138-21443-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786164000593138-21443-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.240.254:43347
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786164000593138-21443-0/krb5kdc/oryx_127.20.240.254.keytab
--principal=oryx/127.20.240.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.240.254:43347
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786164000593138-21443-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.240.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29338
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786164000593138-21443-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 04:05:18 UTC on ccycloud.quasar-drfdgt.root.comops.site
build id 4574101
I20260808 04:40:41.990824 29338 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:40:41.991938 29338 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:40:42.001142 29345 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:40:42.001233 29338 server_base.cc:1034] running on GCE node
W20260808 04:40:42.001142 29347 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:40:42.001143 29344 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:40:42.002115 29338 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:40:42.003347 29338 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:40:42.004540 29338 hybrid_clock.cc:648] HybridClock initialized: now 1786164042004524 us; error 26 us; skew 500 ppm
Aug 08 04:40:42 dist-test-slave-vxj2 krb5kdc[29324](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164042, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.240.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:40:42.007769 29338 init.cc:377] Logged in from keytab as oryx/127.20.240.254@KRBTEST.COM (short username oryx)
I20260808 04:40:42.008828 29338 webserver.cc:460] Webserver started at http://127.20.240.254:46035/ using document root <none> and password file <none>
I20260808 04:40:42.009477 29338 fs_manager.cc:359] Metadata directory not provided
I20260808 04:40:42.009549 29338 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:40:42.009732 29338 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 04:40:42.011961 29338 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786164000593138-21443-0/minicluster-data/master-0/data/instance:
uuid: "fc87c6b2494c4b6c8b57e3923aab1f25"
format_stamp: "Formatted at 2026-08-08 04:40:42 on dist-test-slave-vxj2"
server_key: "ce349ddc0b8f3a14b38dee16ec6bcf4b"
server_key_iv: "82a12e129caea604594746e52c2247a6"
server_key_version: "encryptionkey@0"
I20260808 04:40:42.012565 29338 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786164000593138-21443-0/minicluster-data/master-0/wal/instance:
uuid: "fc87c6b2494c4b6c8b57e3923aab1f25"
format_stamp: "Formatted at 2026-08-08 04:40:42 on dist-test-slave-vxj2"
server_key: "ce349ddc0b8f3a14b38dee16ec6bcf4b"
server_key_iv: "82a12e129caea604594746e52c2247a6"
server_key_version: "encryptionkey@0"
I20260808 04:40:42.017320 29338 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.002s
I20260808 04:40:42.020455 29354 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:42.022205 29338 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 04:40:42.022374 29338 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786164000593138-21443-0/minicluster-data/master-0/data,/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786164000593138-21443-0/minicluster-data/master-0/wal
uuid: "fc87c6b2494c4b6c8b57e3923aab1f25"
format_stamp: "Formatted at 2026-08-08 04:40:42 on dist-test-slave-vxj2"
server_key: "ce349ddc0b8f3a14b38dee16ec6bcf4b"
server_key_iv: "82a12e129caea604594746e52c2247a6"
server_key_version: "encryptionkey@0"
I20260808 04:40:42.022518 29338 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786164000593138-21443-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786164000593138-21443-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786164000593138-21443-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:40:42.040422 29338 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:40:42.044389 29338 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:40:42.044631 29338 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:40:42.053844 29338 rpc_server.cc:307] RPC server started. Bound to: 127.20.240.254:43347
I20260808 04:40:42.053859 29418 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.240.254:43347 every 8 connection(s)
I20260808 04:40:42.054980 29338 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786164000593138-21443-0/minicluster-data/master-0/data/info.pb
I20260808 04:40:42.058167 29419 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:40:42.062924 21443 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu as pid 29338
I20260808 04:40:42.063112 21443 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786164000593138-21443-0/minicluster-data/master-0/wal/instance
I20260808 04:40:42.063463 21443 external_mini_cluster.cc:1428] Setting key e41eb7f621a5103e99a7c43cc641e561
I20260808 04:40:42.065274 29419 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fc87c6b2494c4b6c8b57e3923aab1f25: Bootstrap starting.
I20260808 04:40:42.067863 29419 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P fc87c6b2494c4b6c8b57e3923aab1f25: Neither blocks nor log segments found. Creating new log.
I20260808 04:40:42.068732 29419 log.cc:824] T 00000000000000000000000000000000 P fc87c6b2494c4b6c8b57e3923aab1f25: Log is configured to *not* fsync() on all Append() calls
I20260808 04:40:42.070945 29419 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fc87c6b2494c4b6c8b57e3923aab1f25: No bootstrap required, opened a new log
Aug 08 04:40:42 dist-test-slave-vxj2 krb5kdc[29324](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164041, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.20.240.254@KRBTEST.COM
I20260808 04:40:42.074831 29419 raft_consensus.cc:348] T 00000000000000000000000000000000 P fc87c6b2494c4b6c8b57e3923aab1f25 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fc87c6b2494c4b6c8b57e3923aab1f25" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 43347 } }
I20260808 04:40:42.075155 29419 raft_consensus.cc:374] T 00000000000000000000000000000000 P fc87c6b2494c4b6c8b57e3923aab1f25 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:40:42.075253 29419 raft_consensus.cc:729] T 00000000000000000000000000000000 P fc87c6b2494c4b6c8b57e3923aab1f25 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc87c6b2494c4b6c8b57e3923aab1f25, State: Initialized, Role: FOLLOWER
I20260808 04:40:42.075886 29419 consensus_queue.cc:260] T 00000000000000000000000000000000 P fc87c6b2494c4b6c8b57e3923aab1f25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fc87c6b2494c4b6c8b57e3923aab1f25" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 43347 } }
I20260808 04:40:42.076138 29419 raft_consensus.cc:388] T 00000000000000000000000000000000 P fc87c6b2494c4b6c8b57e3923aab1f25 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 04:40:42.076216 29419 raft_consensus.cc:482] T 00000000000000000000000000000000 P fc87c6b2494c4b6c8b57e3923aab1f25 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 04:40:42.076323 29419 raft_consensus.cc:3037] T 00000000000000000000000000000000 P fc87c6b2494c4b6c8b57e3923aab1f25 [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:40:42.077420 29419 raft_consensus.cc:504] T 00000000000000000000000000000000 P fc87c6b2494c4b6c8b57e3923aab1f25 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fc87c6b2494c4b6c8b57e3923aab1f25" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 43347 } }
I20260808 04:40:42.077796 29419 leader_election.cc:302] T 00000000000000000000000000000000 P fc87c6b2494c4b6c8b57e3923aab1f25 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: fc87c6b2494c4b6c8b57e3923aab1f25; no voters:
I20260808 04:40:42.078173 29419 leader_election.cc:288] T 00000000000000000000000000000000 P fc87c6b2494c4b6c8b57e3923aab1f25 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 04:40:42.078327 29424 raft_consensus.cc:2781] T 00000000000000000000000000000000 P fc87c6b2494c4b6c8b57e3923aab1f25 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 04:40:42.078647 29424 raft_consensus.cc:686] T 00000000000000000000000000000000 P fc87c6b2494c4b6c8b57e3923aab1f25 [term 1 LEADER]: Becoming Leader. State: Replica: fc87c6b2494c4b6c8b57e3923aab1f25, State: Running, Role: LEADER
I20260808 04:40:42.079051 29424 consensus_queue.cc:237] T 00000000000000000000000000000000 P fc87c6b2494c4b6c8b57e3923aab1f25 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fc87c6b2494c4b6c8b57e3923aab1f25" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 43347 } }
I20260808 04:40:42.079499 29422 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:42.065209 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37542 (local address 127.20.240.254:43347)
0808 04:40:42.065729 (+ 520us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:42.065744 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:42.065785 (+ 41us) server_negotiation.cc:407] Connection header received
0808 04:40:42.066570 (+ 785us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:42.066588 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:42.066948 (+ 360us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:42.067329 (+ 381us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:42.068266 (+ 937us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:42.069426 (+ 1160us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:42.070317 (+ 891us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:42.070802 (+ 485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:42.070994 (+ 192us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:42.073661 (+ 2667us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:40:42.073666 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:40:42.073681 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:40:42.073713 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:40:42.076038 (+ 2325us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:42.076619 (+ 581us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:42.076624 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:42.076629 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:42.076749 (+ 120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:42.077075 (+ 326us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:42.077078 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:42.077080 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:42.077624 (+ 544us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:40:42.077854 (+ 230us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:42.078144 (+ 290us) server_negotiation.cc:299] Negotiation successful
0808 04:40:42.078493 (+ 349us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":360,"thread_start_us":153,"threads_started":1}
I20260808 04:40:42.079636 29419 sys_catalog.cc:564] T 00000000000000000000000000000000 P fc87c6b2494c4b6c8b57e3923aab1f25 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 04:40:42.080689 29425 sys_catalog.cc:455] T 00000000000000000000000000000000 P fc87c6b2494c4b6c8b57e3923aab1f25 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "fc87c6b2494c4b6c8b57e3923aab1f25" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fc87c6b2494c4b6c8b57e3923aab1f25" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 43347 } } }
I20260808 04:40:42.080914 29425 sys_catalog.cc:458] T 00000000000000000000000000000000 P fc87c6b2494c4b6c8b57e3923aab1f25 [sys.catalog]: This master's current role is: LEADER
I20260808 04:40:42.081243 29425 sys_catalog.cc:455] T 00000000000000000000000000000000 P fc87c6b2494c4b6c8b57e3923aab1f25 [sys.catalog]: SysCatalogTable state changed. Reason: New leader fc87c6b2494c4b6c8b57e3923aab1f25. Latest consensus state: current_term: 1 leader_uuid: "fc87c6b2494c4b6c8b57e3923aab1f25" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fc87c6b2494c4b6c8b57e3923aab1f25" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 43347 } } }
I20260808 04:40:42.081386 29425 sys_catalog.cc:458] T 00000000000000000000000000000000 P fc87c6b2494c4b6c8b57e3923aab1f25 [sys.catalog]: This master's current role is: LEADER
I20260808 04:40:42.081925 29434 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 04:40:42.084851 29434 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 04:40:42.090413 29434 catalog_manager.cc:1347] Generated new cluster ID: 438c98a65281486da4d3664451559545
I20260808 04:40:42.090494 29434 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 04:40:42.105449 29434 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 04:40:42.106860 29434 catalog_manager.cc:1504] Loading token signing keys...
I20260808 04:40:42.131553 29434 catalog_manager.cc:5868] T 00000000000000000000000000000000 P fc87c6b2494c4b6c8b57e3923aab1f25: Generated new TSK 0
I20260808 04:40:42.132375 29434 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.20.240.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.20.240.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.20.240.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786164000593138-21443-0/krb5kdc/oryx_127.20.240.193.keytab.
Entry for principal oryx/127.20.240.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786164000593138-21443-0/krb5kdc/oryx_127.20.240.193.keytab.
I20260808 04:40:42.173461 21443 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
/tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786164000593138-21443-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786164000593138-21443-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786164000593138-21443-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786164000593138-21443-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.240.193:0
--local_ip_for_outbound_sockets=127.20.240.193
--webserver_interface=127.20.240.193
--webserver_port=0
--tserver_master_addrs=127.20.240.254:43347
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786164000593138-21443-0/krb5kdc/oryx_127.20.240.193.keytab
--principal=oryx/127.20.240.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.240.212:42929
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786164000593138-21443-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786164000593138-21443-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786164000593138-21443-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 04:40:42.307739 29446 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:40:42.308094 29446 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:40:42.308143 29446 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:40:42.312402 29446 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:40:42.312477 29446 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:40:42.312516 29446 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260808 04:40:42.312551 29446 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.240.193
I20260808 04:40:42.318099 29446 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.240.212:42929
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786164000593138-21443-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786164000593138-21443-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786164000593138-21443-0/krb5kdc/oryx_127.20.240.193.keytab
--principal=oryx/127.20.240.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.240.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786164000593138-21443-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.240.193
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.20.240.254:43347
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29446
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.240.193
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786164000593138-21443-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 04:05:18 UTC on ccycloud.quasar-drfdgt.root.comops.site
build id 4574101
I20260808 04:40:42.319281 29446 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:40:42.320369 29446 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:40:42.331101 29452 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:40:42.331128 29451 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:40:42.331123 29446 server_base.cc:1034] running on GCE node
W20260808 04:40:42.331274 29454 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:40:42.331825 29446 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:40:42.332583 29446 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:40:42.333839 29446 hybrid_clock.cc:648] HybridClock initialized: now 1786164042333759 us; error 53 us; skew 500 ppm
Aug 08 04:40:42 dist-test-slave-vxj2 krb5kdc[29324](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164042, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.240.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:40:42.337110 29446 init.cc:377] Logged in from keytab as oryx/127.20.240.193@KRBTEST.COM (short username oryx)
I20260808 04:40:42.338096 29446 webserver.cc:460] Webserver started at http://127.20.240.193:41297/ using document root <none> and password file <none>
I20260808 04:40:42.338699 29446 fs_manager.cc:359] Metadata directory not provided
I20260808 04:40:42.338800 29446 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:40:42.339061 29446 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 04:40:42.341470 29446 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786164000593138-21443-0/minicluster-data/ts-0/data/instance:
uuid: "ae908af2388f439fac792d86667e0b59"
format_stamp: "Formatted at 2026-08-08 04:40:42 on dist-test-slave-vxj2"
server_key: "429fd86fd9be5c6a386b0ffdef52b5de"
server_key_iv: "308b5fa2221d6480faac3fb537df49f5"
server_key_version: "encryptionkey@0"
I20260808 04:40:42.342087 29446 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786164000593138-21443-0/minicluster-data/ts-0/wal/instance:
uuid: "ae908af2388f439fac792d86667e0b59"
format_stamp: "Formatted at 2026-08-08 04:40:42 on dist-test-slave-vxj2"
server_key: "429fd86fd9be5c6a386b0ffdef52b5de"
server_key_iv: "308b5fa2221d6480faac3fb537df49f5"
server_key_version: "encryptionkey@0"
I20260808 04:40:42.346269 29446 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260808 04:40:42.348894 29461 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:42.350270 29446 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 04:40:42.350440 29446 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786164000593138-21443-0/minicluster-data/ts-0/data,/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786164000593138-21443-0/minicluster-data/ts-0/wal
uuid: "ae908af2388f439fac792d86667e0b59"
format_stamp: "Formatted at 2026-08-08 04:40:42 on dist-test-slave-vxj2"
server_key: "429fd86fd9be5c6a386b0ffdef52b5de"
server_key_iv: "308b5fa2221d6480faac3fb537df49f5"
server_key_version: "encryptionkey@0"
I20260808 04:40:42.350574 29446 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786164000593138-21443-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786164000593138-21443-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786164000593138-21443-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:40:42.364898 29446 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:40:42.368192 29446 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:40:42.368419 29446 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:40:42.370048 29446 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 04:40:42.370133 29446 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:42.370210 29446 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 04:40:42.370254 29446 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 08 04:40:42 dist-test-slave-vxj2 krb5kdc[29324](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164042, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.240.193@KRBTEST.COM for oryx/127.20.240.254@KRBTEST.COM
I20260808 04:40:42.382714 29446 rpc_server.cc:307] RPC server started. Bound to: 127.20.240.193:37241
I20260808 04:40:42.382762 29582 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.240.193:37241 every 8 connection(s)
I20260808 04:40:42.383939 29446 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786164000593138-21443-0/minicluster-data/ts-0/data/info.pb
I20260808 04:40:42.385356 29422 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:42.371122 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.240.193:60859 (local address 127.20.240.254:43347)
0808 04:40:42.371266 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:42.371270 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:42.372477 (+ 1207us) server_negotiation.cc:407] Connection header received
0808 04:40:42.373771 (+ 1294us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:42.373775 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:42.373853 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:42.373961 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:42.375306 (+ 1345us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:42.375862 (+ 556us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:42.377097 (+ 1235us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:42.377452 (+ 355us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:42.377583 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:42.380942 (+ 3359us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:40:42.380945 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:40:42.380948 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:40:42.380980 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:40:42.382858 (+ 1878us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:42.383503 (+ 645us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:42.383506 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:42.383507 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:42.383588 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:42.383980 (+ 392us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:42.383982 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:42.383984 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:42.384229 (+ 245us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:40:42.384338 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:42.384977 (+ 639us) server_negotiation.cc:299] Negotiation successful
0808 04:40:42.385117 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260808 04:40:42.386114 29470 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:42.371712 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:43347 (local address 127.20.240.193:60859)
0808 04:40:42.372256 (+ 544us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:42.372323 (+ 67us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:42.373531 (+ 1208us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:42.374155 (+ 624us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:42.374163 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:42.374546 (+ 383us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:40:42.375132 (+ 586us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:42.375147 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:42.376010 (+ 863us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:42.376019 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:42.376950 (+ 931us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:42.376960 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:42.377643 (+ 683us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:42.377647 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:42.377837 (+ 190us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:42.378566 (+ 729us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:40:42.378583 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:40:42.380577 (+ 1994us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:40:42.383010 (+ 2433us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:42.383016 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:42.383031 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:42.383391 (+ 360us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:42.383691 (+ 300us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:42.383694 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:42.383696 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:42.383877 (+ 181us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:42.384349 (+ 472us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:40:42.384358 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:40:42.384685 (+ 327us) client_negotiation.cc:769] Sending connection context
0808 04:40:42.384931 (+ 246us) client_negotiation.cc:240] Negotiation successful
0808 04:40:42.385297 (+ 366us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":341,"thread_start_us":146,"threads_started":1}
I20260808 04:40:42.387471 29584 heartbeater.cc:347] Connected to a master server at 127.20.240.254:43347
I20260808 04:40:42.387616 29584 heartbeater.cc:464] Registering TS with master...
I20260808 04:40:42.388186 29584 heartbeater.cc:511] Master 127.20.240.254:43347 requested a full tablet report, sending...
I20260808 04:40:42.390074 29370 ts_manager.cc:194] Registered new tserver with Master: ae908af2388f439fac792d86667e0b59 (127.20.240.193:37241)
I20260808 04:40:42.391268 29370 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.20.240.193@KRBTEST.COM'} at 127.20.240.193:60859
I20260808 04:40:42.391952 21443 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu as pid 29446
I20260808 04:40:42.392102 21443 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786164000593138-21443-0/minicluster-data/ts-0/wal/instance
I20260808 04:40:42.392428 21443 external_mini_cluster.cc:1428] Setting key 68b5f245f3947640124125d7c5789ff4
I20260808 04:40:42.399196 29422 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:42.389974 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.240.193:56267 (local address 127.20.240.254:43347)
0808 04:40:42.390110 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:42.390115 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:42.390298 (+ 183us) server_negotiation.cc:407] Connection header received
0808 04:40:42.390413 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:42.390416 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:42.390464 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:42.390549 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:42.391005 (+ 456us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:42.391573 (+ 568us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:42.393669 (+ 2096us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:42.393940 (+ 271us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:42.394071 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:42.395373 (+ 1302us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:40:42.395384 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:40:42.395387 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:40:42.395412 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:40:42.397046 (+ 1634us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:42.397768 (+ 722us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:42.397772 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:42.397773 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:42.397866 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:42.398283 (+ 417us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:42.398287 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:42.398288 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:42.398525 (+ 237us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:40:42.398616 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:42.398961 (+ 345us) server_negotiation.cc:299] Negotiation successful
0808 04:40:42.399070 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260808 04:40:42.399398 29592 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:42.389899 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:43347 (local address 127.20.240.193:56267)
0808 04:40:42.390206 (+ 307us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:42.390221 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:42.390333 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:42.390567 (+ 234us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:42.390570 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:42.390788 (+ 218us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:40:42.390888 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:42.390894 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:42.391715 (+ 821us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:42.391718 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:42.393534 (+ 1816us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:42.393545 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:42.394087 (+ 542us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:42.394092 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:42.394202 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:42.394817 (+ 615us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:40:42.394830 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:40:42.395201 (+ 371us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:40:42.397298 (+ 2097us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:42.397304 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:42.397309 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:42.397603 (+ 294us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:42.397979 (+ 376us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:42.397986 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:42.397991 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:42.398106 (+ 115us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:42.398640 (+ 534us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:40:42.398643 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:40:42.398767 (+ 124us) client_negotiation.cc:769] Sending connection context
0808 04:40:42.398903 (+ 136us) client_negotiation.cc:240] Negotiation successful
0808 04:40:42.399094 (+ 191us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":214,"thread_start_us":114,"threads_started":1}
WARNING: no policy specified for oryx/127.20.240.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.20.240.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.20.240.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786164000593138-21443-0/krb5kdc/oryx_127.20.240.194.keytab.
Entry for principal oryx/127.20.240.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786164000593138-21443-0/krb5kdc/oryx_127.20.240.194.keytab.
I20260808 04:40:42.425839 21443 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
/tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786164000593138-21443-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786164000593138-21443-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786164000593138-21443-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786164000593138-21443-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.240.194:0
--local_ip_for_outbound_sockets=127.20.240.194
--webserver_interface=127.20.240.194
--webserver_port=0
--tserver_master_addrs=127.20.240.254:43347
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786164000593138-21443-0/krb5kdc/oryx_127.20.240.194.keytab
--principal=oryx/127.20.240.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.240.212:42929
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786164000593138-21443-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786164000593138-21443-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786164000593138-21443-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 04:40:42.542564 29595 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:40:42.542903 29595 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:40:42.543026 29595 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:40:42.547217 29595 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:40:42.547325 29595 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:40:42.547401 29595 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260808 04:40:42.547488 29595 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.240.194
I20260808 04:40:42.553133 29595 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.240.212:42929
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786164000593138-21443-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786164000593138-21443-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786164000593138-21443-0/krb5kdc/oryx_127.20.240.194.keytab
--principal=oryx/127.20.240.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.240.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786164000593138-21443-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.240.194
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.20.240.254:43347
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29595
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.240.194
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786164000593138-21443-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 04:05:18 UTC on ccycloud.quasar-drfdgt.root.comops.site
build id 4574101
I20260808 04:40:42.554401 29595 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:40:42.555588 29595 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:40:42.565692 29601 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:40:42.565721 29604 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:40:42.565908 29595 server_base.cc:1034] running on GCE node
W20260808 04:40:42.565712 29602 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:40:42.566402 29595 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:40:42.567097 29595 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:40:42.568293 29595 hybrid_clock.cc:648] HybridClock initialized: now 1786164042568279 us; error 24 us; skew 500 ppm
Aug 08 04:40:42 dist-test-slave-vxj2 krb5kdc[29324](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164042, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.240.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:40:42.571133 29595 init.cc:377] Logged in from keytab as oryx/127.20.240.194@KRBTEST.COM (short username oryx)
I20260808 04:40:42.571993 29595 webserver.cc:460] Webserver started at http://127.20.240.194:42045/ using document root <none> and password file <none>
I20260808 04:40:42.572544 29595 fs_manager.cc:359] Metadata directory not provided
I20260808 04:40:42.572603 29595 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:40:42.572830 29595 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 04:40:42.575006 29595 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786164000593138-21443-0/minicluster-data/ts-1/data/instance:
uuid: "0c816c768f7b4dc5ae2082e195d3e681"
format_stamp: "Formatted at 2026-08-08 04:40:42 on dist-test-slave-vxj2"
server_key: "e432cb8cad5fb94cab6b4ce0ad0933d1"
server_key_iv: "55fd5bdfe8472aa5af311b9462950708"
server_key_version: "encryptionkey@0"
I20260808 04:40:42.575587 29595 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786164000593138-21443-0/minicluster-data/ts-1/wal/instance:
uuid: "0c816c768f7b4dc5ae2082e195d3e681"
format_stamp: "Formatted at 2026-08-08 04:40:42 on dist-test-slave-vxj2"
server_key: "e432cb8cad5fb94cab6b4ce0ad0933d1"
server_key_iv: "55fd5bdfe8472aa5af311b9462950708"
server_key_version: "encryptionkey@0"
I20260808 04:40:42.579650 29595 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260808 04:40:42.582568 29611 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:42.583930 29595 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260808 04:40:42.584077 29595 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786164000593138-21443-0/minicluster-data/ts-1/data,/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786164000593138-21443-0/minicluster-data/ts-1/wal
uuid: "0c816c768f7b4dc5ae2082e195d3e681"
format_stamp: "Formatted at 2026-08-08 04:40:42 on dist-test-slave-vxj2"
server_key: "e432cb8cad5fb94cab6b4ce0ad0933d1"
server_key_iv: "55fd5bdfe8472aa5af311b9462950708"
server_key_version: "encryptionkey@0"
I20260808 04:40:42.584197 29595 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786164000593138-21443-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786164000593138-21443-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786164000593138-21443-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:40:42.618512 29595 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:40:42.621623 29595 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:40:42.621858 29595 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:40:42.623654 29595 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 04:40:42.623708 29595 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:42.623750 29595 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 04:40:42.623766 29595 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 08 04:40:42 dist-test-slave-vxj2 krb5kdc[29324](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164042, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.240.194@KRBTEST.COM for oryx/127.20.240.254@KRBTEST.COM
I20260808 04:40:42.635516 29595 rpc_server.cc:307] RPC server started. Bound to: 127.20.240.194:45349
I20260808 04:40:42.636488 29595 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786164000593138-21443-0/minicluster-data/ts-1/data/info.pb
I20260808 04:40:42.637377 29734 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.240.194:45349 every 8 connection(s)
I20260808 04:40:42.640071 29422 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:42.624965 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.240.194:33803 (local address 127.20.240.254:43347)
0808 04:40:42.625109 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:42.625113 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:42.626323 (+ 1210us) server_negotiation.cc:407] Connection header received
0808 04:40:42.627891 (+ 1568us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:42.627896 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:42.627971 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:42.628086 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:42.629943 (+ 1857us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:42.630574 (+ 631us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:42.632623 (+ 2049us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:42.632856 (+ 233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:42.632950 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:42.636143 (+ 3193us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:40:42.636147 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:40:42.636148 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:40:42.636212 (+ 64us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:40:42.637926 (+ 1714us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:42.638476 (+ 550us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:42.638482 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:42.638484 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:42.638569 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:42.638932 (+ 363us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:42.638935 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:42.638936 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:42.639135 (+ 199us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:40:42.639252 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:42.639757 (+ 505us) server_negotiation.cc:299] Negotiation successful
0808 04:40:42.639896 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260808 04:40:42.640915 29621 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:42.625515 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:43347 (local address 127.20.240.194:33803)
0808 04:40:42.626114 (+ 599us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:42.626184 (+ 70us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:42.627621 (+ 1437us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:42.628299 (+ 678us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:42.628312 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:42.628904 (+ 592us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:40:42.629728 (+ 824us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:42.629753 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:42.630882 (+ 1129us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:42.630886 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:42.632465 (+ 1579us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:42.632480 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:42.633048 (+ 568us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:42.633053 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:42.633331 (+ 278us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:42.634249 (+ 918us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:40:42.634272 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:40:42.635928 (+ 1656us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:40:42.638063 (+ 2135us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:42.638070 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:42.638084 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:42.638357 (+ 273us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:42.638666 (+ 309us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:42.638670 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:42.638672 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:42.638826 (+ 154us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:42.639242 (+ 416us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:40:42.639249 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:40:42.639512 (+ 263us) client_negotiation.cc:769] Sending connection context
0808 04:40:42.639697 (+ 185us) client_negotiation.cc:240] Negotiation successful
0808 04:40:42.640043 (+ 346us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":334,"thread_start_us":132,"threads_started":1}
I20260808 04:40:42.642238 29735 heartbeater.cc:347] Connected to a master server at 127.20.240.254:43347
I20260808 04:40:42.642421 29735 heartbeater.cc:464] Registering TS with master...
I20260808 04:40:42.643055 29735 heartbeater.cc:511] Master 127.20.240.254:43347 requested a full tablet report, sending...
I20260808 04:40:42.644037 21443 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu as pid 29595
I20260808 04:40:42.644182 21443 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786164000593138-21443-0/minicluster-data/ts-1/wal/instance
I20260808 04:40:42.644272 29370 ts_manager.cc:194] Registered new tserver with Master: 0c816c768f7b4dc5ae2082e195d3e681 (127.20.240.194:45349)
I20260808 04:40:42.644532 21443 external_mini_cluster.cc:1428] Setting key ce18e1a687759366814166ca872319fb
I20260808 04:40:42.645076 29370 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.20.240.194@KRBTEST.COM'} at 127.20.240.194:33803
I20260808 04:40:42.652612 29422 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:42.644818 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.240.194:46995 (local address 127.20.240.254:43347)
0808 04:40:42.644950 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:42.644955 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:42.644969 (+ 14us) server_negotiation.cc:407] Connection header received
0808 04:40:42.645012 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:42.645016 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:42.645070 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:42.645183 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:42.645727 (+ 544us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:42.646487 (+ 760us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:42.647570 (+ 1083us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:42.647790 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:42.647902 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:42.649224 (+ 1322us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:40:42.649227 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:40:42.649229 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:40:42.649264 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:40:42.650674 (+ 1410us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:42.651221 (+ 547us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:42.651224 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:42.651225 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:42.651324 (+ 99us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:42.651653 (+ 329us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:42.651655 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:42.651657 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:42.651931 (+ 274us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:40:42.652015 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:42.652389 (+ 374us) server_negotiation.cc:299] Negotiation successful
0808 04:40:42.652494 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260808 04:40:42.652700 29741 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:42.644469 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:43347 (local address 127.20.240.194:46995)
0808 04:40:42.644779 (+ 310us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:42.644795 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:42.644879 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:42.645208 (+ 329us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:42.645210 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:42.645449 (+ 239us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:40:42.645591 (+ 142us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:42.645599 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:42.646655 (+ 1056us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:42.646658 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:42.647443 (+ 785us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:42.647452 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:42.647903 (+ 451us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:42.647907 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:42.647999 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:42.648551 (+ 552us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:40:42.648571 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:40:42.649043 (+ 472us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:40:42.650791 (+ 1748us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:42.650796 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:42.650802 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:42.651092 (+ 290us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:42.651433 (+ 341us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:42.651438 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:42.651443 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:42.651549 (+ 106us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:42.652040 (+ 491us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:40:42.652044 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:40:42.652156 (+ 112us) client_negotiation.cc:769] Sending connection context
0808 04:40:42.652283 (+ 127us) client_negotiation.cc:240] Negotiation successful
0808 04:40:42.652455 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":211,"thread_start_us":108,"threads_started":1}
WARNING: no policy specified for oryx/127.20.240.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.20.240.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.20.240.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786164000593138-21443-0/krb5kdc/oryx_127.20.240.195.keytab.
Entry for principal oryx/127.20.240.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786164000593138-21443-0/krb5kdc/oryx_127.20.240.195.keytab.
I20260808 04:40:42.676854 21443 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
/tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786164000593138-21443-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786164000593138-21443-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786164000593138-21443-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786164000593138-21443-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.240.195:0
--local_ip_for_outbound_sockets=127.20.240.195
--webserver_interface=127.20.240.195
--webserver_port=0
--tserver_master_addrs=127.20.240.254:43347
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786164000593138-21443-0/krb5kdc/oryx_127.20.240.195.keytab
--principal=oryx/127.20.240.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.240.212:42929
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786164000593138-21443-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786164000593138-21443-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786164000593138-21443-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 04:40:42.793743 29744 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:40:42.794039 29744 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:40:42.794086 29744 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:40:42.798163 29744 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:40:42.798226 29744 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:40:42.798266 29744 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260808 04:40:42.798300 29744 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.240.195
I20260808 04:40:42.803705 29744 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.240.212:42929
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786164000593138-21443-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786164000593138-21443-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786164000593138-21443-0/krb5kdc/oryx_127.20.240.195.keytab
--principal=oryx/127.20.240.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.240.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786164000593138-21443-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.240.195
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.20.240.254:43347
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29744
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.240.195
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786164000593138-21443-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 04:05:18 UTC on ccycloud.quasar-drfdgt.root.comops.site
build id 4574101
I20260808 04:40:42.804777 29744 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:40:42.805800 29744 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:40:42.815948 29752 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:40:42.815930 29749 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:40:42.815930 29750 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:40:42.816480 29744 server_base.cc:1034] running on GCE node
I20260808 04:40:42.816949 29744 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:40:42.817663 29744 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:40:42.818822 29744 hybrid_clock.cc:648] HybridClock initialized: now 1786164042818809 us; error 28 us; skew 500 ppm
Aug 08 04:40:42 dist-test-slave-vxj2 krb5kdc[29324](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164042, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.240.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:40:42.821817 29744 init.cc:377] Logged in from keytab as oryx/127.20.240.195@KRBTEST.COM (short username oryx)
I20260808 04:40:42.822750 29744 webserver.cc:460] Webserver started at http://127.20.240.195:38623/ using document root <none> and password file <none>
I20260808 04:40:42.823388 29744 fs_manager.cc:359] Metadata directory not provided
I20260808 04:40:42.823549 29744 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:40:42.823803 29744 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 04:40:42.826062 29744 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786164000593138-21443-0/minicluster-data/ts-2/data/instance:
uuid: "d01930ef1a8847ce986d5c9895b2294c"
format_stamp: "Formatted at 2026-08-08 04:40:42 on dist-test-slave-vxj2"
server_key: "10325318c25e2bac9469df84395169f4"
server_key_iv: "02bbdb5983723dce731d45016cedd161"
server_key_version: "encryptionkey@0"
I20260808 04:40:42.826679 29744 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786164000593138-21443-0/minicluster-data/ts-2/wal/instance:
uuid: "d01930ef1a8847ce986d5c9895b2294c"
format_stamp: "Formatted at 2026-08-08 04:40:42 on dist-test-slave-vxj2"
server_key: "10325318c25e2bac9469df84395169f4"
server_key_iv: "02bbdb5983723dce731d45016cedd161"
server_key_version: "encryptionkey@0"
I20260808 04:40:42.830710 29744 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260808 04:40:42.833453 29759 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:42.835819 29744 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260808 04:40:42.835963 29744 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786164000593138-21443-0/minicluster-data/ts-2/data,/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786164000593138-21443-0/minicluster-data/ts-2/wal
uuid: "d01930ef1a8847ce986d5c9895b2294c"
format_stamp: "Formatted at 2026-08-08 04:40:42 on dist-test-slave-vxj2"
server_key: "10325318c25e2bac9469df84395169f4"
server_key_iv: "02bbdb5983723dce731d45016cedd161"
server_key_version: "encryptionkey@0"
I20260808 04:40:42.836086 29744 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786164000593138-21443-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786164000593138-21443-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786164000593138-21443-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:40:42.847910 29744 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:40:42.851454 29744 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:40:42.851673 29744 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:40:42.853307 29744 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 04:40:42.853368 29744 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:42.853432 29744 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 04:40:42.853463 29744 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 08 04:40:42 dist-test-slave-vxj2 krb5kdc[29324](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164042, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.240.195@KRBTEST.COM for oryx/127.20.240.254@KRBTEST.COM
I20260808 04:40:42.864966 29744 rpc_server.cc:307] RPC server started. Bound to: 127.20.240.195:40113
I20260808 04:40:42.865046 29882 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.240.195:40113 every 8 connection(s)
I20260808 04:40:42.866179 29744 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786164000593138-21443-0/minicluster-data/ts-2/data/info.pb
I20260808 04:40:42.868786 29422 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:42.854188 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.240.195:44173 (local address 127.20.240.254:43347)
0808 04:40:42.854325 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:42.854329 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:42.855514 (+ 1185us) server_negotiation.cc:407] Connection header received
0808 04:40:42.856532 (+ 1018us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:42.856539 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:42.856606 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:42.856701 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:42.858312 (+ 1611us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:42.859204 (+ 892us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:42.861190 (+ 1986us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:42.861521 (+ 331us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:42.861612 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:42.864863 (+ 3251us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:40:42.864867 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:40:42.864870 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:40:42.864903 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:40:42.866607 (+ 1704us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:42.867192 (+ 585us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:42.867195 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:42.867197 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:42.867283 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:42.867642 (+ 359us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:42.867644 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:42.867645 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:42.867871 (+ 226us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:40:42.867952 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:42.868549 (+ 597us) server_negotiation.cc:299] Negotiation successful
0808 04:40:42.868661 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260808 04:40:42.869946 29768 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:42.854739 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:43347 (local address 127.20.240.195:44173)
0808 04:40:42.855333 (+ 594us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:42.855379 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:42.856246 (+ 867us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:42.857129 (+ 883us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:42.857136 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:42.857667 (+ 531us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:40:42.858158 (+ 491us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:42.858172 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:42.859365 (+ 1193us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:42.859370 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:42.860998 (+ 1628us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:42.861013 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:42.861675 (+ 662us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:42.861680 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:42.861895 (+ 215us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:42.862554 (+ 659us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:40:42.862578 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:40:42.864595 (+ 2017us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:40:42.866749 (+ 2154us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:42.866756 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:42.866770 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:42.867066 (+ 296us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:42.867379 (+ 313us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:42.867382 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:42.867385 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:42.867557 (+ 172us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:42.868017 (+ 460us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:40:42.868022 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:40:42.868309 (+ 287us) client_negotiation.cc:769] Sending connection context
0808 04:40:42.868507 (+ 198us) client_negotiation.cc:240] Negotiation successful
0808 04:40:42.868924 (+ 417us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":357,"thread_start_us":146,"threads_started":1}
I20260808 04:40:42.871346 29883 heartbeater.cc:347] Connected to a master server at 127.20.240.254:43347
I20260808 04:40:42.871527 29883 heartbeater.cc:464] Registering TS with master...
I20260808 04:40:42.872077 29883 heartbeater.cc:511] Master 127.20.240.254:43347 requested a full tablet report, sending...
I20260808 04:40:42.873301 29371 ts_manager.cc:194] Registered new tserver with Master: d01930ef1a8847ce986d5c9895b2294c (127.20.240.195:40113)
I20260808 04:40:42.873912 29371 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.20.240.195@KRBTEST.COM'} at 127.20.240.195:44173
I20260808 04:40:42.874511 21443 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu as pid 29744
I20260808 04:40:42.874687 21443 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786164000593138-21443-0/minicluster-data/ts-2/wal/instance
I20260808 04:40:42.875049 21443 external_mini_cluster.cc:1428] Setting key 3a187932e8740186be43f5ae137b43de
I20260808 04:40:42.877211 21443 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 04:40:42.882638 29422 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:42.874166 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.240.195:33211 (local address 127.20.240.254:43347)
0808 04:40:42.874337 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:42.874342 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:42.874656 (+ 314us) server_negotiation.cc:407] Connection header received
0808 04:40:42.874789 (+ 133us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:42.874793 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:42.874845 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:42.874944 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:42.875542 (+ 598us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:42.876277 (+ 735us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:42.877313 (+ 1036us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:42.877632 (+ 319us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:42.877749 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:42.879014 (+ 1265us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:40:42.879021 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:40:42.879027 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:40:42.879061 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:40:42.880696 (+ 1635us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:42.881279 (+ 583us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:42.881281 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:42.881283 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:42.881360 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:42.881682 (+ 322us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:42.881684 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:42.881685 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:42.881915 (+ 230us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:40:42.882014 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:42.882343 (+ 329us) server_negotiation.cc:299] Negotiation successful
0808 04:40:42.882445 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260808 04:40:42.882726 29889 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:42.874106 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:43347 (local address 127.20.240.195:33211)
0808 04:40:42.874524 (+ 418us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:42.874538 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:42.874683 (+ 145us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:42.874982 (+ 299us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:42.874985 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:42.875260 (+ 275us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:40:42.875427 (+ 167us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:42.875437 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:42.876406 (+ 969us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:42.876410 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:42.877121 (+ 711us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:42.877132 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:42.877789 (+ 657us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:42.877794 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:42.877881 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:42.878452 (+ 571us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:40:42.878465 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:40:42.878862 (+ 397us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:40:42.880822 (+ 1960us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:42.880829 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:42.880834 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:42.881170 (+ 336us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:42.881454 (+ 284us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:42.881460 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:42.881485 (+ 25us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:42.881592 (+ 107us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:42.882030 (+ 438us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:40:42.882036 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:40:42.882156 (+ 120us) client_negotiation.cc:769] Sending connection context
0808 04:40:42.882291 (+ 135us) client_negotiation.cc:240] Negotiation successful
0808 04:40:42.882481 (+ 190us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":339,"thread_start_us":153,"threads_started":1}
Aug 08 04:40:42 dist-test-slave-vxj2 krb5kdc[29324](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164042, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 08 04:40:42 dist-test-slave-vxj2 krb5kdc[29324](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.20.240.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 04:40:42 dist-test-slave-vxj2 krb5kdc[29324](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.20.240.254@KRBTEST.COM, Server not found in Kerberos database
W20260808 04:40:42.904804 29422 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 04:40:42.897610 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37546 (local address 127.20.240.254:43347)
0808 04:40:42.897755 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:42.897760 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:42.897779 (+ 19us) server_negotiation.cc:407] Connection header received
0808 04:40:42.897823 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:42.897825 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:42.897866 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:42.897936 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:42.898747 (+ 811us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:42.899312 (+ 565us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:42.900171 (+ 859us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:42.900395 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:42.900496 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:42.904541 (+ 4045us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:37546: BlockingRecv error: recv got EOF from 127.0.0.1:37546 (error 108)
Metrics: {"server-negotiator.queue_time_us":51}
Aug 08 04:40:42 dist-test-slave-vxj2 krb5kdc[29324](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164042, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for oryx/127.20.240.254@KRBTEST.COM
I20260808 04:40:42.916239 29422 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:42.906518 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37556 (local address 127.20.240.254:43347)
0808 04:40:42.906655 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:42.906660 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:42.906676 (+ 16us) server_negotiation.cc:407] Connection header received
0808 04:40:42.906830 (+ 154us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:42.906833 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:42.906882 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:42.906969 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:42.907846 (+ 877us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:42.908712 (+ 866us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:42.910082 (+ 1370us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:42.910493 (+ 411us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:42.910642 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:42.913551 (+ 2909us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:40:42.913555 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:40:42.913557 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:40:42.913583 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:40:42.914827 (+ 1244us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:42.915227 (+ 400us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:42.915229 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:42.915231 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:42.915304 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:42.915547 (+ 243us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:42.915549 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:42.915550 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:42.915725 (+ 175us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:40:42.915825 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:42.916017 (+ 192us) server_negotiation.cc:299] Negotiation successful
0808 04:40:42.916114 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260808 04:40:42.919291 29371 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:37556:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 04:40:42.922415 29371 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 04:40:42.937856 29912 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:42.933134 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45532 (local address 127.20.240.193:37241)
0808 04:40:42.933515 (+ 381us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:42.933523 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:42.933689 (+ 166us) server_negotiation.cc:407] Connection header received
0808 04:40:42.933822 (+ 133us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:42.933829 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:42.934014 (+ 185us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:42.934157 (+ 143us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 04:40:42.934320 (+ 163us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:42.935281 (+ 961us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:42.936609 (+ 1328us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:42.937202 (+ 593us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:42.937324 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:42.937482 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:42.937610 (+ 128us) server_negotiation.cc:299] Negotiation successful
0808 04:40:42.937706 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":268,"thread_start_us":107,"threads_started":1}
I20260808 04:40:42.937856 29909 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:42.932725 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.193:37241 (local address 127.0.0.1:45532)
0808 04:40:42.933587 (+ 862us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:42.933599 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:42.933713 (+ 114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:42.934131 (+ 418us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:42.934134 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:42.934150 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 04:40:42.934229 (+ 79us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:42.934234 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:42.935420 (+ 1186us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:42.935423 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:42.936496 (+ 1073us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:42.936503 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:42.937310 (+ 807us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:42.937313 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:42.937422 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:42.937460 (+ 38us) client_negotiation.cc:769] Sending connection context
0808 04:40:42.937578 (+ 118us) client_negotiation.cc:240] Negotiation successful
0808 04:40:42.937706 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":807,"thread_start_us":76,"threads_started":1}
I20260808 04:40:42.938145 29911 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:42.932377 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.195:40113 (local address 127.0.0.1:58468)
0808 04:40:42.933146 (+ 769us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:42.933212 (+ 66us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:42.933328 (+ 116us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:42.933848 (+ 520us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:42.933851 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:42.933866 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 04:40:42.933967 (+ 101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:42.933973 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:42.935258 (+ 1285us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:42.935261 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:42.936255 (+ 994us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:42.936267 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:42.937580 (+ 1313us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:42.937584 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:42.937780 (+ 196us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:42.937827 (+ 47us) client_negotiation.cc:769] Sending connection context
0808 04:40:42.937896 (+ 69us) client_negotiation.cc:240] Negotiation successful
0808 04:40:42.938006 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":717,"mutex_wait_us":96,"thread_start_us":112,"threads_started":1}
I20260808 04:40:42.938494 29908 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:42.931883 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33970 (local address 127.20.240.194:45349)
0808 04:40:42.932225 (+ 342us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:42.932240 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:42.932269 (+ 29us) server_negotiation.cc:407] Connection header received
0808 04:40:42.932460 (+ 191us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:42.932466 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:42.932674 (+ 208us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:42.932830 (+ 156us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 04:40:42.933468 (+ 638us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:42.934642 (+ 1174us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:42.936369 (+ 1727us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:42.937248 (+ 879us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:42.937392 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:42.937512 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:42.937990 (+ 478us) server_negotiation.cc:299] Negotiation successful
0808 04:40:42.938085 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":232,"thread_start_us":105,"threads_started":1}
I20260808 04:40:42.938596 29910 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:42.932538 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58468 (local address 127.20.240.195:40113)
0808 04:40:42.932990 (+ 452us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:42.933003 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:42.933314 (+ 311us) server_negotiation.cc:407] Connection header received
0808 04:40:42.933541 (+ 227us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:42.933547 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:42.933723 (+ 176us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:42.933878 (+ 155us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 04:40:42.934084 (+ 206us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:42.935134 (+ 1050us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:42.936416 (+ 1282us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:42.937246 (+ 830us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:42.937389 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:42.937512 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:42.938335 (+ 823us) server_negotiation.cc:299] Negotiation successful
0808 04:40:42.938440 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":343,"thread_start_us":119,"threads_started":1}
I20260808 04:40:42.939072 29907 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:42.931670 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.194:45349 (local address 127.0.0.1:33970)
0808 04:40:42.932037 (+ 367us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:42.932093 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:42.932230 (+ 137us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:42.933049 (+ 819us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:42.933055 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:42.933078 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 04:40:42.933302 (+ 224us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:42.933314 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:42.934768 (+ 1454us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:42.934772 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:42.936237 (+ 1465us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:42.936248 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:42.937580 (+ 1332us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:42.937584 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:42.937765 (+ 181us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:42.937822 (+ 57us) client_negotiation.cc:769] Sending connection context
0808 04:40:42.937896 (+ 74us) client_negotiation.cc:240] Negotiation successful
0808 04:40:42.938949 (+ 1053us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":170,"mutex_wait_us":1068,"thread_start_us":70,"threads_started":1}
I20260808 04:40:42.941588 29812 tablet_service.cc:1467] Processing CreateTablet for tablet 2eef19bc94544229bfeaf6c31fc533d6 (DEFAULT_TABLE table=test-table [id=faddc44d95b044f78ba12d64d7c60d3d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 04:40:42.941597 29514 tablet_service.cc:1467] Processing CreateTablet for tablet 2eef19bc94544229bfeaf6c31fc533d6 (DEFAULT_TABLE table=test-table [id=faddc44d95b044f78ba12d64d7c60d3d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 04:40:42.941728 29663 tablet_service.cc:1467] Processing CreateTablet for tablet 2eef19bc94544229bfeaf6c31fc533d6 (DEFAULT_TABLE table=test-table [id=faddc44d95b044f78ba12d64d7c60d3d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 04:40:42.942721 29663 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2eef19bc94544229bfeaf6c31fc533d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:40:42.942745 29812 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2eef19bc94544229bfeaf6c31fc533d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:40:42.942739 29514 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2eef19bc94544229bfeaf6c31fc533d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:40:42.949502 29913 tablet_bootstrap.cc:492] T 2eef19bc94544229bfeaf6c31fc533d6 P 0c816c768f7b4dc5ae2082e195d3e681: Bootstrap starting.
I20260808 04:40:42.950863 29915 tablet_bootstrap.cc:492] T 2eef19bc94544229bfeaf6c31fc533d6 P d01930ef1a8847ce986d5c9895b2294c: Bootstrap starting.
I20260808 04:40:42.951830 29913 tablet_bootstrap.cc:654] T 2eef19bc94544229bfeaf6c31fc533d6 P 0c816c768f7b4dc5ae2082e195d3e681: Neither blocks nor log segments found. Creating new log.
I20260808 04:40:42.952591 29913 log.cc:824] T 2eef19bc94544229bfeaf6c31fc533d6 P 0c816c768f7b4dc5ae2082e195d3e681: Log is configured to *not* fsync() on all Append() calls
I20260808 04:40:42.952808 29915 tablet_bootstrap.cc:654] T 2eef19bc94544229bfeaf6c31fc533d6 P d01930ef1a8847ce986d5c9895b2294c: Neither blocks nor log segments found. Creating new log.
I20260808 04:40:42.953536 29914 tablet_bootstrap.cc:492] T 2eef19bc94544229bfeaf6c31fc533d6 P ae908af2388f439fac792d86667e0b59: Bootstrap starting.
I20260808 04:40:42.953668 29915 log.cc:824] T 2eef19bc94544229bfeaf6c31fc533d6 P d01930ef1a8847ce986d5c9895b2294c: Log is configured to *not* fsync() on all Append() calls
I20260808 04:40:42.954905 29913 tablet_bootstrap.cc:492] T 2eef19bc94544229bfeaf6c31fc533d6 P 0c816c768f7b4dc5ae2082e195d3e681: No bootstrap required, opened a new log
I20260808 04:40:42.955125 29913 ts_tablet_manager.cc:1397] T 2eef19bc94544229bfeaf6c31fc533d6 P 0c816c768f7b4dc5ae2082e195d3e681: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260808 04:40:42.955749 29915 tablet_bootstrap.cc:492] T 2eef19bc94544229bfeaf6c31fc533d6 P d01930ef1a8847ce986d5c9895b2294c: No bootstrap required, opened a new log
I20260808 04:40:42.956039 29915 ts_tablet_manager.cc:1397] T 2eef19bc94544229bfeaf6c31fc533d6 P d01930ef1a8847ce986d5c9895b2294c: Time spent bootstrapping tablet: real 0.005s user 0.005s sys 0.000s
I20260808 04:40:42.956188 29914 tablet_bootstrap.cc:654] T 2eef19bc94544229bfeaf6c31fc533d6 P ae908af2388f439fac792d86667e0b59: Neither blocks nor log segments found. Creating new log.
I20260808 04:40:42.957068 29914 log.cc:824] T 2eef19bc94544229bfeaf6c31fc533d6 P ae908af2388f439fac792d86667e0b59: Log is configured to *not* fsync() on all Append() calls
I20260808 04:40:42.958815 29913 raft_consensus.cc:348] T 2eef19bc94544229bfeaf6c31fc533d6 P 0c816c768f7b4dc5ae2082e195d3e681 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c816c768f7b4dc5ae2082e195d3e681" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 45349 } } peers { permanent_uuid: "d01930ef1a8847ce986d5c9895b2294c" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 40113 } } peers { permanent_uuid: "ae908af2388f439fac792d86667e0b59" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 37241 } }
I20260808 04:40:42.959069 29913 raft_consensus.cc:374] T 2eef19bc94544229bfeaf6c31fc533d6 P 0c816c768f7b4dc5ae2082e195d3e681 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:40:42.959151 29913 raft_consensus.cc:729] T 2eef19bc94544229bfeaf6c31fc533d6 P 0c816c768f7b4dc5ae2082e195d3e681 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c816c768f7b4dc5ae2082e195d3e681, State: Initialized, Role: FOLLOWER
I20260808 04:40:42.959173 29914 tablet_bootstrap.cc:492] T 2eef19bc94544229bfeaf6c31fc533d6 P ae908af2388f439fac792d86667e0b59: No bootstrap required, opened a new log
I20260808 04:40:42.959362 29914 ts_tablet_manager.cc:1397] T 2eef19bc94544229bfeaf6c31fc533d6 P ae908af2388f439fac792d86667e0b59: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.002s
I20260808 04:40:42.959647 29913 consensus_queue.cc:260] T 2eef19bc94544229bfeaf6c31fc533d6 P 0c816c768f7b4dc5ae2082e195d3e681 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c816c768f7b4dc5ae2082e195d3e681" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 45349 } } peers { permanent_uuid: "d01930ef1a8847ce986d5c9895b2294c" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 40113 } } peers { permanent_uuid: "ae908af2388f439fac792d86667e0b59" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 37241 } }
I20260808 04:40:42.960012 29915 raft_consensus.cc:348] T 2eef19bc94544229bfeaf6c31fc533d6 P d01930ef1a8847ce986d5c9895b2294c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c816c768f7b4dc5ae2082e195d3e681" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 45349 } } peers { permanent_uuid: "d01930ef1a8847ce986d5c9895b2294c" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 40113 } } peers { permanent_uuid: "ae908af2388f439fac792d86667e0b59" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 37241 } }
I20260808 04:40:42.960306 29915 raft_consensus.cc:374] T 2eef19bc94544229bfeaf6c31fc533d6 P d01930ef1a8847ce986d5c9895b2294c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:40:42.960371 29915 raft_consensus.cc:729] T 2eef19bc94544229bfeaf6c31fc533d6 P d01930ef1a8847ce986d5c9895b2294c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d01930ef1a8847ce986d5c9895b2294c, State: Initialized, Role: FOLLOWER
I20260808 04:40:42.960355 29735 heartbeater.cc:503] Master 127.20.240.254:43347 was elected leader, sending a full tablet report...
I20260808 04:40:42.960850 29915 consensus_queue.cc:260] T 2eef19bc94544229bfeaf6c31fc533d6 P d01930ef1a8847ce986d5c9895b2294c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c816c768f7b4dc5ae2082e195d3e681" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 45349 } } peers { permanent_uuid: "d01930ef1a8847ce986d5c9895b2294c" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 40113 } } peers { permanent_uuid: "ae908af2388f439fac792d86667e0b59" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 37241 } }
I20260808 04:40:42.961980 29915 ts_tablet_manager.cc:1428] T 2eef19bc94544229bfeaf6c31fc533d6 P d01930ef1a8847ce986d5c9895b2294c: Time spent starting tablet: real 0.006s user 0.004s sys 0.001s
I20260808 04:40:42.962060 29883 heartbeater.cc:503] Master 127.20.240.254:43347 was elected leader, sending a full tablet report...
I20260808 04:40:42.964252 29913 ts_tablet_manager.cc:1428] T 2eef19bc94544229bfeaf6c31fc533d6 P 0c816c768f7b4dc5ae2082e195d3e681: Time spent starting tablet: real 0.009s user 0.007s sys 0.000s
I20260808 04:40:42.964310 29914 raft_consensus.cc:348] T 2eef19bc94544229bfeaf6c31fc533d6 P ae908af2388f439fac792d86667e0b59 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c816c768f7b4dc5ae2082e195d3e681" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 45349 } } peers { permanent_uuid: "d01930ef1a8847ce986d5c9895b2294c" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 40113 } } peers { permanent_uuid: "ae908af2388f439fac792d86667e0b59" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 37241 } }
I20260808 04:40:42.964629 29914 raft_consensus.cc:374] T 2eef19bc94544229bfeaf6c31fc533d6 P ae908af2388f439fac792d86667e0b59 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:40:42.964692 29914 raft_consensus.cc:729] T 2eef19bc94544229bfeaf6c31fc533d6 P ae908af2388f439fac792d86667e0b59 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae908af2388f439fac792d86667e0b59, State: Initialized, Role: FOLLOWER
I20260808 04:40:42.965216 29914 consensus_queue.cc:260] T 2eef19bc94544229bfeaf6c31fc533d6 P ae908af2388f439fac792d86667e0b59 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c816c768f7b4dc5ae2082e195d3e681" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 45349 } } peers { permanent_uuid: "d01930ef1a8847ce986d5c9895b2294c" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 40113 } } peers { permanent_uuid: "ae908af2388f439fac792d86667e0b59" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 37241 } }
I20260808 04:40:42.965960 29584 heartbeater.cc:503] Master 127.20.240.254:43347 was elected leader, sending a full tablet report...
I20260808 04:40:42.966231 29914 ts_tablet_manager.cc:1428] T 2eef19bc94544229bfeaf6c31fc533d6 P ae908af2388f439fac792d86667e0b59: Time spent starting tablet: real 0.007s user 0.005s sys 0.000s
I20260808 04:40:43.088423 29921 raft_consensus.cc:482] T 2eef19bc94544229bfeaf6c31fc533d6 P d01930ef1a8847ce986d5c9895b2294c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 04:40:43.088696 29921 raft_consensus.cc:504] T 2eef19bc94544229bfeaf6c31fc533d6 P d01930ef1a8847ce986d5c9895b2294c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c816c768f7b4dc5ae2082e195d3e681" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 45349 } } peers { permanent_uuid: "d01930ef1a8847ce986d5c9895b2294c" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 40113 } } peers { permanent_uuid: "ae908af2388f439fac792d86667e0b59" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 37241 } }
I20260808 04:40:43.089999 29921 leader_election.cc:288] T 2eef19bc94544229bfeaf6c31fc533d6 P d01930ef1a8847ce986d5c9895b2294c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c816c768f7b4dc5ae2082e195d3e681 (127.20.240.194:45349), ae908af2388f439fac792d86667e0b59 (127.20.240.193:37241)
I20260808 04:40:43.092617 29920 raft_consensus.cc:482] T 2eef19bc94544229bfeaf6c31fc533d6 P 0c816c768f7b4dc5ae2082e195d3e681 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 04:40:43.092823 29920 raft_consensus.cc:504] T 2eef19bc94544229bfeaf6c31fc533d6 P 0c816c768f7b4dc5ae2082e195d3e681 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c816c768f7b4dc5ae2082e195d3e681" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 45349 } } peers { permanent_uuid: "d01930ef1a8847ce986d5c9895b2294c" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 40113 } } peers { permanent_uuid: "ae908af2388f439fac792d86667e0b59" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 37241 } }
I20260808 04:40:43.094295 29920 leader_election.cc:288] T 2eef19bc94544229bfeaf6c31fc533d6 P 0c816c768f7b4dc5ae2082e195d3e681 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d01930ef1a8847ce986d5c9895b2294c (127.20.240.195:40113), ae908af2388f439fac792d86667e0b59 (127.20.240.193:37241)
I20260808 04:40:43.094719 29768 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:43.090397 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.194:45349 (local address 127.20.240.195:52269)
0808 04:40:43.090523 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:43.090565 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:43.090689 (+ 124us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:43.091219 (+ 530us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:43.091222 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:43.091250 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 04:40:43.091402 (+ 152us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:43.091409 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:43.092410 (+ 1001us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:43.092413 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:43.093550 (+ 1137us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:43.093561 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:43.094237 (+ 676us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:43.094240 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:43.094360 (+ 120us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:43.094391 (+ 31us) client_negotiation.cc:769] Sending connection context
0808 04:40:43.094468 (+ 77us) client_negotiation.cc:240] Negotiation successful
0808 04:40:43.094546 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":39}
I20260808 04:40:43.095166 29908 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:43.090494 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.240.195:52269 (local address 127.20.240.194:45349)
0808 04:40:43.090648 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:43.090653 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:43.090669 (+ 16us) server_negotiation.cc:407] Connection header received
0808 04:40:43.091036 (+ 367us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:43.091040 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:43.091094 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:43.091181 (+ 87us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 04:40:43.091570 (+ 389us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:43.092297 (+ 727us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:43.093690 (+ 1393us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:43.094106 (+ 416us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:43.094244 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:43.094300 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:43.094968 (+ 668us) server_negotiation.cc:299] Negotiation successful
0808 04:40:43.095057 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260808 04:40:43.096133 29912 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:43.090890 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.240.195:40109 (local address 127.20.240.193:37241)
0808 04:40:43.091061 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:43.091065 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:43.091481 (+ 416us) server_negotiation.cc:407] Connection header received
0808 04:40:43.091575 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:43.091578 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:43.091631 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:43.091708 (+ 77us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 04:40:43.092040 (+ 332us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:43.092755 (+ 715us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:43.094699 (+ 1944us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:43.095375 (+ 676us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:43.095477 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:43.095527 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:43.095935 (+ 408us) server_negotiation.cc:299] Negotiation successful
0808 04:40:43.096022 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260808 04:40:43.096179 29684 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2eef19bc94544229bfeaf6c31fc533d6" candidate_uuid: "d01930ef1a8847ce986d5c9895b2294c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c816c768f7b4dc5ae2082e195d3e681" is_pre_election: true
I20260808 04:40:43.096411 29684 raft_consensus.cc:2454] T 2eef19bc94544229bfeaf6c31fc533d6 P 0c816c768f7b4dc5ae2082e195d3e681 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d01930ef1a8847ce986d5c9895b2294c in term 0.
I20260808 04:40:43.096755 29923 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:43.090725 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.193:37241 (local address 127.20.240.195:40109)
0808 04:40:43.091368 (+ 643us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:43.091385 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:43.091487 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:43.091736 (+ 249us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:43.091739 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:43.091755 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 04:40:43.091887 (+ 132us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:43.091895 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:43.092893 (+ 998us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:43.092896 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:43.094546 (+ 1650us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:43.094560 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:43.095649 (+ 1089us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:43.095652 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:43.095771 (+ 119us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:43.095814 (+ 43us) client_negotiation.cc:769] Sending connection context
0808 04:40:43.096509 (+ 695us) client_negotiation.cc:240] Negotiation successful
0808 04:40:43.096596 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":540,"thread_start_us":120,"threads_started":1}
I20260808 04:40:43.097040 29761 leader_election.cc:302] T 2eef19bc94544229bfeaf6c31fc533d6 P d01930ef1a8847ce986d5c9895b2294c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c816c768f7b4dc5ae2082e195d3e681, d01930ef1a8847ce986d5c9895b2294c; no voters:
I20260808 04:40:43.097604 29921 raft_consensus.cc:2781] T 2eef19bc94544229bfeaf6c31fc533d6 P d01930ef1a8847ce986d5c9895b2294c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 04:40:43.097733 29921 raft_consensus.cc:482] T 2eef19bc94544229bfeaf6c31fc533d6 P d01930ef1a8847ce986d5c9895b2294c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 04:40:43.097792 29921 raft_consensus.cc:3037] T 2eef19bc94544229bfeaf6c31fc533d6 P d01930ef1a8847ce986d5c9895b2294c [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:40:43.098083 29536 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2eef19bc94544229bfeaf6c31fc533d6" candidate_uuid: "d01930ef1a8847ce986d5c9895b2294c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae908af2388f439fac792d86667e0b59" is_pre_election: true
I20260808 04:40:43.098407 29536 raft_consensus.cc:2454] T 2eef19bc94544229bfeaf6c31fc533d6 P ae908af2388f439fac792d86667e0b59 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d01930ef1a8847ce986d5c9895b2294c in term 0.
I20260808 04:40:43.099229 29921 raft_consensus.cc:504] T 2eef19bc94544229bfeaf6c31fc533d6 P d01930ef1a8847ce986d5c9895b2294c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c816c768f7b4dc5ae2082e195d3e681" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 45349 } } peers { permanent_uuid: "d01930ef1a8847ce986d5c9895b2294c" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 40113 } } peers { permanent_uuid: "ae908af2388f439fac792d86667e0b59" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 37241 } }
I20260808 04:40:43.099651 29621 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:43.094904 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.193:37241 (local address 127.20.240.194:43305)
0808 04:40:43.095572 (+ 668us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:43.095586 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:43.095656 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:43.095905 (+ 249us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:43.095907 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:43.095923 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 04:40:43.096029 (+ 106us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:43.096034 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:43.097079 (+ 1045us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:43.097082 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:43.098255 (+ 1173us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:43.098267 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:43.099184 (+ 917us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:43.099188 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:43.099300 (+ 112us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:43.099328 (+ 28us) client_negotiation.cc:769] Sending connection context
0808 04:40:43.099425 (+ 97us) client_negotiation.cc:240] Negotiation successful
0808 04:40:43.099505 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":589,"mutex_wait_us":27,"thread_start_us":103,"threads_started":1}
I20260808 04:40:43.099658 29925 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:43.095279 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.240.194:43305 (local address 127.20.240.193:37241)
0808 04:40:43.095610 (+ 331us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:43.095619 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:43.095632 (+ 13us) server_negotiation.cc:407] Connection header received
0808 04:40:43.095739 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:43.095742 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:43.095782 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:43.096126 (+ 344us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 04:40:43.096221 (+ 95us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:43.096955 (+ 734us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:43.098416 (+ 1461us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:43.099026 (+ 610us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:43.099185 (+ 159us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:43.099230 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:43.099440 (+ 210us) server_negotiation.cc:299] Negotiation successful
0808 04:40:43.099506 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":253,"thread_start_us":130,"threads_started":1}
I20260808 04:40:43.100118 29921 leader_election.cc:288] T 2eef19bc94544229bfeaf6c31fc533d6 P d01930ef1a8847ce986d5c9895b2294c [CANDIDATE]: Term 1 election: Requested vote from peers 0c816c768f7b4dc5ae2082e195d3e681 (127.20.240.194:45349), ae908af2388f439fac792d86667e0b59 (127.20.240.193:37241)
I20260808 04:40:43.100360 29684 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2eef19bc94544229bfeaf6c31fc533d6" candidate_uuid: "d01930ef1a8847ce986d5c9895b2294c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c816c768f7b4dc5ae2082e195d3e681"
I20260808 04:40:43.100418 29536 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2eef19bc94544229bfeaf6c31fc533d6" candidate_uuid: "d01930ef1a8847ce986d5c9895b2294c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae908af2388f439fac792d86667e0b59"
I20260808 04:40:43.100476 29535 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2eef19bc94544229bfeaf6c31fc533d6" candidate_uuid: "0c816c768f7b4dc5ae2082e195d3e681" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae908af2388f439fac792d86667e0b59" is_pre_election: true
I20260808 04:40:43.100502 29684 raft_consensus.cc:3037] T 2eef19bc94544229bfeaf6c31fc533d6 P 0c816c768f7b4dc5ae2082e195d3e681 [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:40:43.100525 29536 raft_consensus.cc:3037] T 2eef19bc94544229bfeaf6c31fc533d6 P ae908af2388f439fac792d86667e0b59 [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:40:43.100634 29910 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:43.094717 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.240.194:51959 (local address 127.20.240.195:40113)
0808 04:40:43.094844 (+ 127us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:43.094849 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:43.095303 (+ 454us) server_negotiation.cc:407] Connection header received
0808 04:40:43.095493 (+ 190us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:43.095497 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:43.095543 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:43.095592 (+ 49us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 04:40:43.096031 (+ 439us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:43.096773 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:43.098383 (+ 1610us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:43.098986 (+ 603us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:43.099097 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:43.099165 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:43.100445 (+ 1280us) server_negotiation.cc:299] Negotiation successful
0808 04:40:43.100532 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260808 04:40:43.101033 29924 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:43.094637 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.195:40113 (local address 127.20.240.194:51959)
0808 04:40:43.095209 (+ 572us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:43.095226 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:43.095382 (+ 156us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:43.095732 (+ 350us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:43.095734 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:43.095752 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 04:40:43.095913 (+ 161us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:43.095919 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:43.096922 (+ 1003us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:43.096925 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:43.098237 (+ 1312us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:43.098247 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:43.099273 (+ 1026us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:43.099277 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:43.100291 (+ 1014us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:43.100317 (+ 26us) client_negotiation.cc:769] Sending connection context
0808 04:40:43.100796 (+ 479us) client_negotiation.cc:240] Negotiation successful
0808 04:40:43.100888 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":487,"mutex_wait_us":48}
I20260808 04:40:43.101902 29684 raft_consensus.cc:2454] T 2eef19bc94544229bfeaf6c31fc533d6 P 0c816c768f7b4dc5ae2082e195d3e681 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d01930ef1a8847ce986d5c9895b2294c in term 1.
I20260808 04:40:43.101908 29536 raft_consensus.cc:2454] T 2eef19bc94544229bfeaf6c31fc533d6 P ae908af2388f439fac792d86667e0b59 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d01930ef1a8847ce986d5c9895b2294c in term 1.
I20260808 04:40:43.102295 29835 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2eef19bc94544229bfeaf6c31fc533d6" candidate_uuid: "0c816c768f7b4dc5ae2082e195d3e681" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d01930ef1a8847ce986d5c9895b2294c" is_pre_election: true
I20260808 04:40:43.102509 29835 raft_consensus.cc:2379] T 2eef19bc94544229bfeaf6c31fc533d6 P d01930ef1a8847ce986d5c9895b2294c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c816c768f7b4dc5ae2082e195d3e681 in current term 1: Already voted for candidate d01930ef1a8847ce986d5c9895b2294c in this term.
I20260808 04:40:43.102991 29761 leader_election.cc:302] T 2eef19bc94544229bfeaf6c31fc533d6 P d01930ef1a8847ce986d5c9895b2294c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ae908af2388f439fac792d86667e0b59, d01930ef1a8847ce986d5c9895b2294c; no voters:
I20260808 04:40:43.103283 29921 raft_consensus.cc:2781] T 2eef19bc94544229bfeaf6c31fc533d6 P d01930ef1a8847ce986d5c9895b2294c [term 1 FOLLOWER]: Leader election won for term 1
I20260808 04:40:43.103252 29613 leader_election.cc:302] T 2eef19bc94544229bfeaf6c31fc533d6 P 0c816c768f7b4dc5ae2082e195d3e681 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c816c768f7b4dc5ae2082e195d3e681; no voters: ae908af2388f439fac792d86667e0b59, d01930ef1a8847ce986d5c9895b2294c
I20260808 04:40:43.103569 29920 raft_consensus.cc:2726] T 2eef19bc94544229bfeaf6c31fc533d6 P 0c816c768f7b4dc5ae2082e195d3e681 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260808 04:40:43.103569 29921 raft_consensus.cc:686] T 2eef19bc94544229bfeaf6c31fc533d6 P d01930ef1a8847ce986d5c9895b2294c [term 1 LEADER]: Becoming Leader. State: Replica: d01930ef1a8847ce986d5c9895b2294c, State: Running, Role: LEADER
I20260808 04:40:43.103996 29921 consensus_queue.cc:237] T 2eef19bc94544229bfeaf6c31fc533d6 P d01930ef1a8847ce986d5c9895b2294c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c816c768f7b4dc5ae2082e195d3e681" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 45349 } } peers { permanent_uuid: "d01930ef1a8847ce986d5c9895b2294c" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 40113 } } peers { permanent_uuid: "ae908af2388f439fac792d86667e0b59" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 37241 } }
I20260808 04:40:43.107580 29371 catalog_manager.cc:5495] T 2eef19bc94544229bfeaf6c31fc533d6 P d01930ef1a8847ce986d5c9895b2294c reported cstate change: term changed from 0 to 1, leader changed from <none> to d01930ef1a8847ce986d5c9895b2294c (127.20.240.195). New cstate: current_term: 1 leader_uuid: "d01930ef1a8847ce986d5c9895b2294c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c816c768f7b4dc5ae2082e195d3e681" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 45349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d01930ef1a8847ce986d5c9895b2294c" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 40113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ae908af2388f439fac792d86667e0b59" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 37241 } health_report { overall_health: UNKNOWN } } }
W20260808 04:40:43.117774 29884 tablet.cc:2369] T 2eef19bc94544229bfeaf6c31fc533d6 P d01930ef1a8847ce986d5c9895b2294c: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 04:40:43.135550 29585 tablet.cc:2369] T 2eef19bc94544229bfeaf6c31fc533d6 P ae908af2388f439fac792d86667e0b59: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 04:40:43.137727 29910 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:43.133705 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58478 (local address 127.20.240.195:40113)
0808 04:40:43.133852 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:43.133855 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:43.133869 (+ 14us) server_negotiation.cc:407] Connection header received
0808 04:40:43.134002 (+ 133us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:43.134005 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:43.134064 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:43.134156 (+ 92us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 04:40:43.134389 (+ 233us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:43.134901 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:43.136236 (+ 1335us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:43.136452 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:43.136534 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:43.136904 (+ 370us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 04:40:43.137359 (+ 455us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 04:40:43.137448 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:43.137559 (+ 111us) server_negotiation.cc:299] Negotiation successful
0808 04:40:43.137614 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
W20260808 04:40:43.138149 29736 tablet.cc:2369] T 2eef19bc94544229bfeaf6c31fc533d6 P 0c816c768f7b4dc5ae2082e195d3e681: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 04:40:43.144449 29684 raft_consensus.cc:1261] T 2eef19bc94544229bfeaf6c31fc533d6 P 0c816c768f7b4dc5ae2082e195d3e681 [term 1 FOLLOWER]: Refusing update from remote peer d01930ef1a8847ce986d5c9895b2294c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 04:40:43.144449 29536 raft_consensus.cc:1261] T 2eef19bc94544229bfeaf6c31fc533d6 P ae908af2388f439fac792d86667e0b59 [term 1 FOLLOWER]: Refusing update from remote peer d01930ef1a8847ce986d5c9895b2294c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 04:40:43.145157 29921 consensus_queue.cc:1035] T 2eef19bc94544229bfeaf6c31fc533d6 P d01930ef1a8847ce986d5c9895b2294c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae908af2388f439fac792d86667e0b59" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 37241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 04:40:43.145422 29926 consensus_queue.cc:1035] T 2eef19bc94544229bfeaf6c31fc533d6 P d01930ef1a8847ce986d5c9895b2294c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c816c768f7b4dc5ae2082e195d3e681" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 45349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 04:40:43.152076 29929 mvcc.cc:205] Tried to move back new op lower bound from 7316127920710877184 to 7316127920556634112. Current Snapshot: MvccSnapshot[applied={T|T < 7316127920710877184}]
I20260808 04:40:43.162096 29370 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:37556:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 04:40:43.162328 29370 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:37556:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 04:40:43.165040 29370 catalog_manager.cc:5782] T 00000000000000000000000000000000 P fc87c6b2494c4b6c8b57e3923aab1f25: Sending DeleteTablet for 3 replicas of tablet 2eef19bc94544229bfeaf6c31fc533d6
I20260808 04:40:43.165890 29663 tablet_service.cc:1514] Processing DeleteTablet for tablet 2eef19bc94544229bfeaf6c31fc533d6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 04:40:43 UTC) from {username='oryx', principal='oryx/127.20.240.254@KRBTEST.COM'} at 127.0.0.1:33970
I20260808 04:40:43.166014 29812 tablet_service.cc:1514] Processing DeleteTablet for tablet 2eef19bc94544229bfeaf6c31fc533d6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 04:40:43 UTC) from {username='oryx', principal='oryx/127.20.240.254@KRBTEST.COM'} at 127.0.0.1:58468
I20260808 04:40:43.166028 29514 tablet_service.cc:1514] Processing DeleteTablet for tablet 2eef19bc94544229bfeaf6c31fc533d6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 04:40:43 UTC) from {username='oryx', principal='oryx/127.20.240.254@KRBTEST.COM'} at 127.0.0.1:45532
I20260808 04:40:43.166625 29939 tablet_replica.cc:330] T 2eef19bc94544229bfeaf6c31fc533d6 P 0c816c768f7b4dc5ae2082e195d3e681: stopping tablet replica
I20260808 04:40:43.166796 29940 tablet_replica.cc:330] T 2eef19bc94544229bfeaf6c31fc533d6 P d01930ef1a8847ce986d5c9895b2294c: stopping tablet replica
I20260808 04:40:43.167058 29941 tablet_replica.cc:330] T 2eef19bc94544229bfeaf6c31fc533d6 P ae908af2388f439fac792d86667e0b59: stopping tablet replica
I20260808 04:40:43.167212 29940 raft_consensus.cc:2229] T 2eef19bc94544229bfeaf6c31fc533d6 P d01930ef1a8847ce986d5c9895b2294c [term 1 LEADER]: Raft consensus shutting down.
I20260808 04:40:43.167331 29941 raft_consensus.cc:2229] T 2eef19bc94544229bfeaf6c31fc533d6 P ae908af2388f439fac792d86667e0b59 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 04:40:43.167332 29370 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:37556:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260808 04:40:43.167670 29941 raft_consensus.cc:2258] T 2eef19bc94544229bfeaf6c31fc533d6 P ae908af2388f439fac792d86667e0b59 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260808 04:40:43.167779 29370 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 04:40:43.167951 29940 raft_consensus.cc:2258] T 2eef19bc94544229bfeaf6c31fc533d6 P d01930ef1a8847ce986d5c9895b2294c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 04:40:43.169358 29941 ts_tablet_manager.cc:1905] T 2eef19bc94544229bfeaf6c31fc533d6 P ae908af2388f439fac792d86667e0b59: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 04:40:43.169358 29940 ts_tablet_manager.cc:1905] T 2eef19bc94544229bfeaf6c31fc533d6 P d01930ef1a8847ce986d5c9895b2294c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 04:40:43.172345 29941 ts_tablet_manager.cc:1918] T 2eef19bc94544229bfeaf6c31fc533d6 P ae908af2388f439fac792d86667e0b59: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 04:40:43.172345 29940 ts_tablet_manager.cc:1918] T 2eef19bc94544229bfeaf6c31fc533d6 P d01930ef1a8847ce986d5c9895b2294c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 04:40:43.172490 29941 log.cc:1196] T 2eef19bc94544229bfeaf6c31fc533d6 P ae908af2388f439fac792d86667e0b59: Deleting WAL directory at /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786164000593138-21443-0/minicluster-data/ts-0/wal/wals/2eef19bc94544229bfeaf6c31fc533d6
I20260808 04:40:43.172616 29940 log.cc:1196] T 2eef19bc94544229bfeaf6c31fc533d6 P d01930ef1a8847ce986d5c9895b2294c: Deleting WAL directory at /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786164000593138-21443-0/minicluster-data/ts-2/wal/wals/2eef19bc94544229bfeaf6c31fc533d6
I20260808 04:40:43.172854 29941 ts_tablet_manager.cc:1939] T 2eef19bc94544229bfeaf6c31fc533d6 P ae908af2388f439fac792d86667e0b59: Deleting consensus metadata
I20260808 04:40:43.173115 29940 ts_tablet_manager.cc:1939] T 2eef19bc94544229bfeaf6c31fc533d6 P d01930ef1a8847ce986d5c9895b2294c: Deleting consensus metadata
I20260808 04:40:43.174228 29356 catalog_manager.cc:4841] TS ae908af2388f439fac792d86667e0b59 (127.20.240.193:37241): tablet 2eef19bc94544229bfeaf6c31fc533d6 (table test-table [id=faddc44d95b044f78ba12d64d7c60d3d]) successfully deleted
I20260808 04:40:43.174412 29514 tablet_service.cc:1467] Processing CreateTablet for tablet 3cf9f7ac57ea47f8bd1d39924bffad41 (DEFAULT_TABLE table=test-table [id=6192d245aa5d47a8a7328798dbd483a6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 04:40:43.174688 29514 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3cf9f7ac57ea47f8bd1d39924bffad41. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:40:43.176520 29914 tablet_bootstrap.cc:492] T 3cf9f7ac57ea47f8bd1d39924bffad41 P ae908af2388f439fac792d86667e0b59: Bootstrap starting.
I20260808 04:40:43.176715 29356 catalog_manager.cc:4841] TS d01930ef1a8847ce986d5c9895b2294c (127.20.240.195:40113): tablet 2eef19bc94544229bfeaf6c31fc533d6 (table test-table [id=faddc44d95b044f78ba12d64d7c60d3d]) successfully deleted
I20260808 04:40:43.177196 29812 tablet_service.cc:1467] Processing CreateTablet for tablet 3cf9f7ac57ea47f8bd1d39924bffad41 (DEFAULT_TABLE table=test-table [id=6192d245aa5d47a8a7328798dbd483a6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 04:40:43.177477 29812 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3cf9f7ac57ea47f8bd1d39924bffad41. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:40:43.177687 29939 raft_consensus.cc:2229] T 2eef19bc94544229bfeaf6c31fc533d6 P 0c816c768f7b4dc5ae2082e195d3e681 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 04:40:43.178056 29914 tablet_bootstrap.cc:654] T 3cf9f7ac57ea47f8bd1d39924bffad41 P ae908af2388f439fac792d86667e0b59: Neither blocks nor log segments found. Creating new log.
I20260808 04:40:43.178217 29939 raft_consensus.cc:2258] T 2eef19bc94544229bfeaf6c31fc533d6 P 0c816c768f7b4dc5ae2082e195d3e681 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 04:40:43.178895 29663 tablet_service.cc:1467] Processing CreateTablet for tablet 3cf9f7ac57ea47f8bd1d39924bffad41 (DEFAULT_TABLE table=test-table [id=6192d245aa5d47a8a7328798dbd483a6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 04:40:43.179168 29663 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3cf9f7ac57ea47f8bd1d39924bffad41. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:40:43.179987 29915 tablet_bootstrap.cc:492] T 3cf9f7ac57ea47f8bd1d39924bffad41 P d01930ef1a8847ce986d5c9895b2294c: Bootstrap starting.
I20260808 04:40:43.180696 29939 ts_tablet_manager.cc:1905] T 2eef19bc94544229bfeaf6c31fc533d6 P 0c816c768f7b4dc5ae2082e195d3e681: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 04:40:43.181077 29915 tablet_bootstrap.cc:654] T 3cf9f7ac57ea47f8bd1d39924bffad41 P d01930ef1a8847ce986d5c9895b2294c: Neither blocks nor log segments found. Creating new log.
I20260808 04:40:43.181656 29913 tablet_bootstrap.cc:492] T 3cf9f7ac57ea47f8bd1d39924bffad41 P 0c816c768f7b4dc5ae2082e195d3e681: Bootstrap starting.
I20260808 04:40:43.182590 29913 tablet_bootstrap.cc:654] T 3cf9f7ac57ea47f8bd1d39924bffad41 P 0c816c768f7b4dc5ae2082e195d3e681: Neither blocks nor log segments found. Creating new log.
I20260808 04:40:43.183127 29939 ts_tablet_manager.cc:1918] T 2eef19bc94544229bfeaf6c31fc533d6 P 0c816c768f7b4dc5ae2082e195d3e681: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 04:40:43.183269 29939 log.cc:1196] T 2eef19bc94544229bfeaf6c31fc533d6 P 0c816c768f7b4dc5ae2082e195d3e681: Deleting WAL directory at /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786164000593138-21443-0/minicluster-data/ts-1/wal/wals/2eef19bc94544229bfeaf6c31fc533d6
I20260808 04:40:43.183617 29939 ts_tablet_manager.cc:1939] T 2eef19bc94544229bfeaf6c31fc533d6 P 0c816c768f7b4dc5ae2082e195d3e681: Deleting consensus metadata
I20260808 04:40:43.183987 29913 tablet_bootstrap.cc:492] T 3cf9f7ac57ea47f8bd1d39924bffad41 P 0c816c768f7b4dc5ae2082e195d3e681: No bootstrap required, opened a new log
I20260808 04:40:43.184056 29913 ts_tablet_manager.cc:1397] T 3cf9f7ac57ea47f8bd1d39924bffad41 P 0c816c768f7b4dc5ae2082e195d3e681: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260808 04:40:43.184458 29913 raft_consensus.cc:348] T 3cf9f7ac57ea47f8bd1d39924bffad41 P 0c816c768f7b4dc5ae2082e195d3e681 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae908af2388f439fac792d86667e0b59" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 37241 } } peers { permanent_uuid: "0c816c768f7b4dc5ae2082e195d3e681" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 45349 } } peers { permanent_uuid: "d01930ef1a8847ce986d5c9895b2294c" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 40113 } }
I20260808 04:40:43.184566 29913 raft_consensus.cc:374] T 3cf9f7ac57ea47f8bd1d39924bffad41 P 0c816c768f7b4dc5ae2082e195d3e681 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:40:43.184564 29914 tablet_bootstrap.cc:492] T 3cf9f7ac57ea47f8bd1d39924bffad41 P ae908af2388f439fac792d86667e0b59: No bootstrap required, opened a new log
I20260808 04:40:43.184594 29913 raft_consensus.cc:729] T 3cf9f7ac57ea47f8bd1d39924bffad41 P 0c816c768f7b4dc5ae2082e195d3e681 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c816c768f7b4dc5ae2082e195d3e681, State: Initialized, Role: FOLLOWER
I20260808 04:40:43.184649 29914 ts_tablet_manager.cc:1397] T 3cf9f7ac57ea47f8bd1d39924bffad41 P ae908af2388f439fac792d86667e0b59: Time spent bootstrapping tablet: real 0.008s user 0.000s sys 0.002s
I20260808 04:40:43.184720 29913 consensus_queue.cc:260] T 3cf9f7ac57ea47f8bd1d39924bffad41 P 0c816c768f7b4dc5ae2082e195d3e681 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae908af2388f439fac792d86667e0b59" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 37241 } } peers { permanent_uuid: "0c816c768f7b4dc5ae2082e195d3e681" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 45349 } } peers { permanent_uuid: "d01930ef1a8847ce986d5c9895b2294c" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 40113 } }
I20260808 04:40:43.185022 29913 ts_tablet_manager.cc:1428] T 3cf9f7ac57ea47f8bd1d39924bffad41 P 0c816c768f7b4dc5ae2082e195d3e681: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260808 04:40:43.185134 29914 raft_consensus.cc:348] T 3cf9f7ac57ea47f8bd1d39924bffad41 P ae908af2388f439fac792d86667e0b59 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae908af2388f439fac792d86667e0b59" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 37241 } } peers { permanent_uuid: "0c816c768f7b4dc5ae2082e195d3e681" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 45349 } } peers { permanent_uuid: "d01930ef1a8847ce986d5c9895b2294c" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 40113 } }
I20260808 04:40:43.185269 29914 raft_consensus.cc:374] T 3cf9f7ac57ea47f8bd1d39924bffad41 P ae908af2388f439fac792d86667e0b59 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:40:43.185300 29914 raft_consensus.cc:729] T 3cf9f7ac57ea47f8bd1d39924bffad41 P ae908af2388f439fac792d86667e0b59 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae908af2388f439fac792d86667e0b59, State: Initialized, Role: FOLLOWER
I20260808 04:40:43.185424 29914 consensus_queue.cc:260] T 3cf9f7ac57ea47f8bd1d39924bffad41 P ae908af2388f439fac792d86667e0b59 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae908af2388f439fac792d86667e0b59" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 37241 } } peers { permanent_uuid: "0c816c768f7b4dc5ae2082e195d3e681" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 45349 } } peers { permanent_uuid: "d01930ef1a8847ce986d5c9895b2294c" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 40113 } }
I20260808 04:40:43.185672 29914 ts_tablet_manager.cc:1428] T 3cf9f7ac57ea47f8bd1d39924bffad41 P ae908af2388f439fac792d86667e0b59: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260808 04:40:43.185729 29356 catalog_manager.cc:4841] TS 0c816c768f7b4dc5ae2082e195d3e681 (127.20.240.194:45349): tablet 2eef19bc94544229bfeaf6c31fc533d6 (table test-table [id=faddc44d95b044f78ba12d64d7c60d3d]) successfully deleted
I20260808 04:40:43.186823 29915 tablet_bootstrap.cc:492] T 3cf9f7ac57ea47f8bd1d39924bffad41 P d01930ef1a8847ce986d5c9895b2294c: No bootstrap required, opened a new log
I20260808 04:40:43.186954 29915 ts_tablet_manager.cc:1397] T 3cf9f7ac57ea47f8bd1d39924bffad41 P d01930ef1a8847ce986d5c9895b2294c: Time spent bootstrapping tablet: real 0.007s user 0.000s sys 0.001s
I20260808 04:40:43.187531 29915 raft_consensus.cc:348] T 3cf9f7ac57ea47f8bd1d39924bffad41 P d01930ef1a8847ce986d5c9895b2294c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae908af2388f439fac792d86667e0b59" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 37241 } } peers { permanent_uuid: "0c816c768f7b4dc5ae2082e195d3e681" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 45349 } } peers { permanent_uuid: "d01930ef1a8847ce986d5c9895b2294c" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 40113 } }
I20260808 04:40:43.187701 29915 raft_consensus.cc:374] T 3cf9f7ac57ea47f8bd1d39924bffad41 P d01930ef1a8847ce986d5c9895b2294c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:40:43.187736 29915 raft_consensus.cc:729] T 3cf9f7ac57ea47f8bd1d39924bffad41 P d01930ef1a8847ce986d5c9895b2294c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d01930ef1a8847ce986d5c9895b2294c, State: Initialized, Role: FOLLOWER
I20260808 04:40:43.187873 29915 consensus_queue.cc:260] T 3cf9f7ac57ea47f8bd1d39924bffad41 P d01930ef1a8847ce986d5c9895b2294c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae908af2388f439fac792d86667e0b59" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 37241 } } peers { permanent_uuid: "0c816c768f7b4dc5ae2082e195d3e681" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 45349 } } peers { permanent_uuid: "d01930ef1a8847ce986d5c9895b2294c" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 40113 } }
I20260808 04:40:43.188133 29915 ts_tablet_manager.cc:1428] T 3cf9f7ac57ea47f8bd1d39924bffad41 P d01930ef1a8847ce986d5c9895b2294c: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260808 04:40:43.420399 29922 raft_consensus.cc:482] T 3cf9f7ac57ea47f8bd1d39924bffad41 P ae908af2388f439fac792d86667e0b59 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 04:40:43.420578 29922 raft_consensus.cc:504] T 3cf9f7ac57ea47f8bd1d39924bffad41 P ae908af2388f439fac792d86667e0b59 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae908af2388f439fac792d86667e0b59" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 37241 } } peers { permanent_uuid: "0c816c768f7b4dc5ae2082e195d3e681" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 45349 } } peers { permanent_uuid: "d01930ef1a8847ce986d5c9895b2294c" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 40113 } }
I20260808 04:40:43.421938 29922 leader_election.cc:288] T 3cf9f7ac57ea47f8bd1d39924bffad41 P ae908af2388f439fac792d86667e0b59 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c816c768f7b4dc5ae2082e195d3e681 (127.20.240.194:45349), d01930ef1a8847ce986d5c9895b2294c (127.20.240.195:40113)
I20260808 04:40:43.426352 29908 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:43.422302 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.240.193:49287 (local address 127.20.240.194:45349)
0808 04:40:43.422496 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:43.422500 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:43.422520 (+ 20us) server_negotiation.cc:407] Connection header received
0808 04:40:43.422707 (+ 187us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:43.422711 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:43.422768 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:43.422849 (+ 81us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 04:40:43.423209 (+ 360us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:43.423821 (+ 612us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:43.425191 (+ 1370us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:43.425731 (+ 540us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:43.425872 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:43.425929 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:43.426135 (+ 206us) server_negotiation.cc:299] Negotiation successful
0808 04:40:43.426203 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
I20260808 04:40:43.426364 29946 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:43.422155 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.194:45349 (local address 127.20.240.193:49287)
0808 04:40:43.422429 (+ 274us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:43.422443 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:43.422575 (+ 132us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:43.422886 (+ 311us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:43.422894 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:43.422934 (+ 40us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 04:40:43.423065 (+ 131us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:43.423071 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:43.423936 (+ 865us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:43.423940 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:43.425047 (+ 1107us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:43.425057 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:43.425900 (+ 843us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:43.425904 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:43.425997 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:43.426024 (+ 27us) client_negotiation.cc:769] Sending connection context
0808 04:40:43.426118 (+ 94us) client_negotiation.cc:240] Negotiation successful
0808 04:40:43.426192 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":177,"mutex_wait_us":1,"spinlock_wait_cycles":768,"thread_start_us":69,"threads_started":1}
I20260808 04:40:43.426602 29910 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:43.422682 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.240.193:43491 (local address 127.20.240.195:40113)
0808 04:40:43.422838 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:43.422845 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:43.422944 (+ 99us) server_negotiation.cc:407] Connection header received
0808 04:40:43.423055 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:43.423058 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:43.423109 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:43.423188 (+ 79us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 04:40:43.423439 (+ 251us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:43.424051 (+ 612us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:43.425323 (+ 1272us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:43.425859 (+ 536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:43.425981 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:43.426040 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:43.426358 (+ 318us) server_negotiation.cc:299] Negotiation successful
0808 04:40:43.426436 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260808 04:40:43.426698 29947 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:43.422529 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.195:40113 (local address 127.20.240.193:43491)
0808 04:40:43.422855 (+ 326us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:43.422869 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:43.422960 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:43.423211 (+ 251us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:43.423214 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:43.423231 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 04:40:43.423334 (+ 103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:43.423340 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:43.424200 (+ 860us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:43.424203 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:43.425183 (+ 980us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:43.425193 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:43.426105 (+ 912us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:43.426110 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:43.426224 (+ 114us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:43.426242 (+ 18us) client_negotiation.cc:769] Sending connection context
0808 04:40:43.426340 (+ 98us) client_negotiation.cc:240] Negotiation successful
0808 04:40:43.426408 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":230,"thread_start_us":119,"threads_started":1}
I20260808 04:40:43.426946 29684 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3cf9f7ac57ea47f8bd1d39924bffad41" candidate_uuid: "ae908af2388f439fac792d86667e0b59" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c816c768f7b4dc5ae2082e195d3e681" is_pre_election: true
I20260808 04:40:43.427140 29684 raft_consensus.cc:2454] T 3cf9f7ac57ea47f8bd1d39924bffad41 P 0c816c768f7b4dc5ae2082e195d3e681 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ae908af2388f439fac792d86667e0b59 in term 0.
I20260808 04:40:43.427551 29463 leader_election.cc:302] T 3cf9f7ac57ea47f8bd1d39924bffad41 P ae908af2388f439fac792d86667e0b59 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c816c768f7b4dc5ae2082e195d3e681, ae908af2388f439fac792d86667e0b59; no voters:
I20260808 04:40:43.427591 29835 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3cf9f7ac57ea47f8bd1d39924bffad41" candidate_uuid: "ae908af2388f439fac792d86667e0b59" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d01930ef1a8847ce986d5c9895b2294c" is_pre_election: true
I20260808 04:40:43.427742 29835 raft_consensus.cc:2454] T 3cf9f7ac57ea47f8bd1d39924bffad41 P d01930ef1a8847ce986d5c9895b2294c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ae908af2388f439fac792d86667e0b59 in term 0.
I20260808 04:40:43.427852 29922 raft_consensus.cc:2781] T 3cf9f7ac57ea47f8bd1d39924bffad41 P ae908af2388f439fac792d86667e0b59 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 04:40:43.427917 29922 raft_consensus.cc:482] T 3cf9f7ac57ea47f8bd1d39924bffad41 P ae908af2388f439fac792d86667e0b59 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 04:40:43.427964 29922 raft_consensus.cc:3037] T 3cf9f7ac57ea47f8bd1d39924bffad41 P ae908af2388f439fac792d86667e0b59 [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:40:43.428937 29922 raft_consensus.cc:504] T 3cf9f7ac57ea47f8bd1d39924bffad41 P ae908af2388f439fac792d86667e0b59 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae908af2388f439fac792d86667e0b59" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 37241 } } peers { permanent_uuid: "0c816c768f7b4dc5ae2082e195d3e681" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 45349 } } peers { permanent_uuid: "d01930ef1a8847ce986d5c9895b2294c" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 40113 } }
I20260808 04:40:43.429307 29922 leader_election.cc:288] T 3cf9f7ac57ea47f8bd1d39924bffad41 P ae908af2388f439fac792d86667e0b59 [CANDIDATE]: Term 1 election: Requested vote from peers 0c816c768f7b4dc5ae2082e195d3e681 (127.20.240.194:45349), d01930ef1a8847ce986d5c9895b2294c (127.20.240.195:40113)
I20260808 04:40:43.429646 29684 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3cf9f7ac57ea47f8bd1d39924bffad41" candidate_uuid: "ae908af2388f439fac792d86667e0b59" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c816c768f7b4dc5ae2082e195d3e681"
I20260808 04:40:43.429760 29684 raft_consensus.cc:3037] T 3cf9f7ac57ea47f8bd1d39924bffad41 P 0c816c768f7b4dc5ae2082e195d3e681 [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:40:43.429694 29835 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3cf9f7ac57ea47f8bd1d39924bffad41" candidate_uuid: "ae908af2388f439fac792d86667e0b59" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d01930ef1a8847ce986d5c9895b2294c"
I20260808 04:40:43.429926 29835 raft_consensus.cc:3037] T 3cf9f7ac57ea47f8bd1d39924bffad41 P d01930ef1a8847ce986d5c9895b2294c [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:40:43.430756 29684 raft_consensus.cc:2454] T 3cf9f7ac57ea47f8bd1d39924bffad41 P 0c816c768f7b4dc5ae2082e195d3e681 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae908af2388f439fac792d86667e0b59 in term 1.
I20260808 04:40:43.431046 29463 leader_election.cc:302] T 3cf9f7ac57ea47f8bd1d39924bffad41 P ae908af2388f439fac792d86667e0b59 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c816c768f7b4dc5ae2082e195d3e681, ae908af2388f439fac792d86667e0b59; no voters:
I20260808 04:40:43.431051 29835 raft_consensus.cc:2454] T 3cf9f7ac57ea47f8bd1d39924bffad41 P d01930ef1a8847ce986d5c9895b2294c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae908af2388f439fac792d86667e0b59 in term 1.
I20260808 04:40:43.431231 29922 raft_consensus.cc:2781] T 3cf9f7ac57ea47f8bd1d39924bffad41 P ae908af2388f439fac792d86667e0b59 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 04:40:43.431457 29922 raft_consensus.cc:686] T 3cf9f7ac57ea47f8bd1d39924bffad41 P ae908af2388f439fac792d86667e0b59 [term 1 LEADER]: Becoming Leader. State: Replica: ae908af2388f439fac792d86667e0b59, State: Running, Role: LEADER
I20260808 04:40:43.431728 29922 consensus_queue.cc:237] T 3cf9f7ac57ea47f8bd1d39924bffad41 P ae908af2388f439fac792d86667e0b59 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae908af2388f439fac792d86667e0b59" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 37241 } } peers { permanent_uuid: "0c816c768f7b4dc5ae2082e195d3e681" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 45349 } } peers { permanent_uuid: "d01930ef1a8847ce986d5c9895b2294c" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 40113 } }
I20260808 04:40:43.434137 29370 catalog_manager.cc:5495] T 3cf9f7ac57ea47f8bd1d39924bffad41 P ae908af2388f439fac792d86667e0b59 reported cstate change: term changed from 0 to 1, leader changed from <none> to ae908af2388f439fac792d86667e0b59 (127.20.240.193). New cstate: current_term: 1 leader_uuid: "ae908af2388f439fac792d86667e0b59" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae908af2388f439fac792d86667e0b59" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 37241 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c816c768f7b4dc5ae2082e195d3e681" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 45349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d01930ef1a8847ce986d5c9895b2294c" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 40113 } health_report { overall_health: UNKNOWN } } }
Aug 08 04:40:43 dist-test-slave-vxj2 krb5kdc[29324](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164042, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.240.254@KRBTEST.COM for oryx/127.20.240.254@KRBTEST.COM
I20260808 04:40:43.521242 29957 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:43.511192 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37562 (local address 127.20.240.254:43347)
0808 04:40:43.511629 (+ 437us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:43.511639 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:43.511833 (+ 194us) server_negotiation.cc:407] Connection header received
0808 04:40:43.511989 (+ 156us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:43.511994 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:43.512048 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:43.512160 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:43.512943 (+ 783us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:43.513627 (+ 684us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:43.514524 (+ 897us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:43.514801 (+ 277us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:43.514927 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:43.517621 (+ 2694us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:40:43.517624 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:40:43.517626 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:40:43.517647 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:40:43.519298 (+ 1651us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:43.519808 (+ 510us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:43.519814 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:43.519816 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:43.519899 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:43.520172 (+ 273us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:43.520177 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:43.520179 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:43.520394 (+ 215us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:40:43.520507 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:43.520841 (+ 334us) server_negotiation.cc:299] Negotiation successful
0808 04:40:43.521065 (+ 224us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":118,"server-negotiator.queue_time_us":373,"thread_start_us":132,"threads_started":1}
I20260808 04:40:43.521243 29956 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:43.511147 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:43347 (local address 127.0.0.1:37562)
0808 04:40:43.511651 (+ 504us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:43.511672 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:43.511854 (+ 182us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:43.512199 (+ 345us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:43.512202 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:43.512692 (+ 490us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:40:43.512800 (+ 108us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:43.512807 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:43.513748 (+ 941us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:43.513755 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:43.514386 (+ 631us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:43.514395 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:43.514934 (+ 539us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:43.514937 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:43.515034 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:43.515758 (+ 724us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:40:43.515772 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:40:43.517458 (+ 1686us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:40:43.519428 (+ 1970us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:43.519442 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:43.519449 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:43.519693 (+ 244us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:43.519993 (+ 300us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:43.519998 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:43.520000 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:43.520082 (+ 82us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:43.520520 (+ 438us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:40:43.520529 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:40:43.520644 (+ 115us) client_negotiation.cc:769] Sending connection context
0808 04:40:43.520788 (+ 144us) client_negotiation.cc:240] Negotiation successful
0808 04:40:43.521000 (+ 212us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":368,"thread_start_us":138,"threads_started":1}
I20260808 04:40:43.526228 29370 catalog_manager.cc:1908] Servicing CreateTable request from {username='oryx', principal='oryx/127.20.240.254@KRBTEST.COM'} at 127.0.0.1:37562:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260808 04:40:43.527172 29370 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 04:40:43.533070 29812 tablet_service.cc:1467] Processing CreateTablet for tablet 2d0cb6a1967c48b79d44a6aceb686f62 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=f2c45bd656724bd1940c3e6dda1fbeb1]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260808 04:40:43.533070 29514 tablet_service.cc:1467] Processing CreateTablet for tablet 2d0cb6a1967c48b79d44a6aceb686f62 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=f2c45bd656724bd1940c3e6dda1fbeb1]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260808 04:40:43.533134 29663 tablet_service.cc:1467] Processing CreateTablet for tablet 2d0cb6a1967c48b79d44a6aceb686f62 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=f2c45bd656724bd1940c3e6dda1fbeb1]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260808 04:40:43.533571 29812 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2d0cb6a1967c48b79d44a6aceb686f62. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:40:43.533571 29514 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2d0cb6a1967c48b79d44a6aceb686f62. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:40:43.533602 29663 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2d0cb6a1967c48b79d44a6aceb686f62. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:40:43.536233 29913 tablet_bootstrap.cc:492] T 2d0cb6a1967c48b79d44a6aceb686f62 P 0c816c768f7b4dc5ae2082e195d3e681: Bootstrap starting.
I20260808 04:40:43.536491 29915 tablet_bootstrap.cc:492] T 2d0cb6a1967c48b79d44a6aceb686f62 P d01930ef1a8847ce986d5c9895b2294c: Bootstrap starting.
I20260808 04:40:43.536813 29914 tablet_bootstrap.cc:492] T 2d0cb6a1967c48b79d44a6aceb686f62 P ae908af2388f439fac792d86667e0b59: Bootstrap starting.
I20260808 04:40:43.537386 29913 tablet_bootstrap.cc:654] T 2d0cb6a1967c48b79d44a6aceb686f62 P 0c816c768f7b4dc5ae2082e195d3e681: Neither blocks nor log segments found. Creating new log.
I20260808 04:40:43.537448 29915 tablet_bootstrap.cc:654] T 2d0cb6a1967c48b79d44a6aceb686f62 P d01930ef1a8847ce986d5c9895b2294c: Neither blocks nor log segments found. Creating new log.
I20260808 04:40:43.537815 29914 tablet_bootstrap.cc:654] T 2d0cb6a1967c48b79d44a6aceb686f62 P ae908af2388f439fac792d86667e0b59: Neither blocks nor log segments found. Creating new log.
I20260808 04:40:43.538561 29915 tablet_bootstrap.cc:492] T 2d0cb6a1967c48b79d44a6aceb686f62 P d01930ef1a8847ce986d5c9895b2294c: No bootstrap required, opened a new log
I20260808 04:40:43.538657 29915 ts_tablet_manager.cc:1397] T 2d0cb6a1967c48b79d44a6aceb686f62 P d01930ef1a8847ce986d5c9895b2294c: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 04:40:43.539044 29914 tablet_bootstrap.cc:492] T 2d0cb6a1967c48b79d44a6aceb686f62 P ae908af2388f439fac792d86667e0b59: No bootstrap required, opened a new log
I20260808 04:40:43.539147 29914 ts_tablet_manager.cc:1397] T 2d0cb6a1967c48b79d44a6aceb686f62 P ae908af2388f439fac792d86667e0b59: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.001s
I20260808 04:40:43.539072 29915 raft_consensus.cc:348] T 2d0cb6a1967c48b79d44a6aceb686f62 P d01930ef1a8847ce986d5c9895b2294c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae908af2388f439fac792d86667e0b59" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 37241 } } peers { permanent_uuid: "0c816c768f7b4dc5ae2082e195d3e681" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 45349 } } peers { permanent_uuid: "d01930ef1a8847ce986d5c9895b2294c" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 40113 } }
I20260808 04:40:43.539249 29915 raft_consensus.cc:374] T 2d0cb6a1967c48b79d44a6aceb686f62 P d01930ef1a8847ce986d5c9895b2294c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:40:43.539297 29915 raft_consensus.cc:729] T 2d0cb6a1967c48b79d44a6aceb686f62 P d01930ef1a8847ce986d5c9895b2294c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d01930ef1a8847ce986d5c9895b2294c, State: Initialized, Role: FOLLOWER
I20260808 04:40:43.539469 29915 consensus_queue.cc:260] T 2d0cb6a1967c48b79d44a6aceb686f62 P d01930ef1a8847ce986d5c9895b2294c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae908af2388f439fac792d86667e0b59" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 37241 } } peers { permanent_uuid: "0c816c768f7b4dc5ae2082e195d3e681" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 45349 } } peers { permanent_uuid: "d01930ef1a8847ce986d5c9895b2294c" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 40113 } }
I20260808 04:40:43.539619 29914 raft_consensus.cc:348] T 2d0cb6a1967c48b79d44a6aceb686f62 P ae908af2388f439fac792d86667e0b59 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae908af2388f439fac792d86667e0b59" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 37241 } } peers { permanent_uuid: "0c816c768f7b4dc5ae2082e195d3e681" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 45349 } } peers { permanent_uuid: "d01930ef1a8847ce986d5c9895b2294c" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 40113 } }
I20260808 04:40:43.539762 29914 raft_consensus.cc:374] T 2d0cb6a1967c48b79d44a6aceb686f62 P ae908af2388f439fac792d86667e0b59 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:40:43.539800 29914 raft_consensus.cc:729] T 2d0cb6a1967c48b79d44a6aceb686f62 P ae908af2388f439fac792d86667e0b59 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae908af2388f439fac792d86667e0b59, State: Initialized, Role: FOLLOWER
I20260808 04:40:43.539789 29921 tablet_replica.cc:439] T 2d0cb6a1967c48b79d44a6aceb686f62 P d01930ef1a8847ce986d5c9895b2294c: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae908af2388f439fac792d86667e0b59" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 37241 } } peers { permanent_uuid: "0c816c768f7b4dc5ae2082e195d3e681" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 45349 } } peers { permanent_uuid: "d01930ef1a8847ce986d5c9895b2294c" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 40113 } } }
I20260808 04:40:43.539947 29921 tablet_replica.cc:442] T 2d0cb6a1967c48b79d44a6aceb686f62 P d01930ef1a8847ce986d5c9895b2294c: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 04:40:43.539924 29914 consensus_queue.cc:260] T 2d0cb6a1967c48b79d44a6aceb686f62 P ae908af2388f439fac792d86667e0b59 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae908af2388f439fac792d86667e0b59" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 37241 } } peers { permanent_uuid: "0c816c768f7b4dc5ae2082e195d3e681" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 45349 } } peers { permanent_uuid: "d01930ef1a8847ce986d5c9895b2294c" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 40113 } }
I20260808 04:40:43.539790 29915 ts_tablet_manager.cc:1428] T 2d0cb6a1967c48b79d44a6aceb686f62 P d01930ef1a8847ce986d5c9895b2294c: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260808 04:40:43.540166 29922 tablet_replica.cc:439] T 2d0cb6a1967c48b79d44a6aceb686f62 P ae908af2388f439fac792d86667e0b59: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae908af2388f439fac792d86667e0b59" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 37241 } } peers { permanent_uuid: "0c816c768f7b4dc5ae2082e195d3e681" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 45349 } } peers { permanent_uuid: "d01930ef1a8847ce986d5c9895b2294c" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 40113 } } }
I20260808 04:40:43.540300 29922 tablet_replica.cc:442] T 2d0cb6a1967c48b79d44a6aceb686f62 P ae908af2388f439fac792d86667e0b59: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 04:40:43.540570 29913 tablet_bootstrap.cc:492] T 2d0cb6a1967c48b79d44a6aceb686f62 P 0c816c768f7b4dc5ae2082e195d3e681: No bootstrap required, opened a new log
I20260808 04:40:43.540686 29913 ts_tablet_manager.cc:1397] T 2d0cb6a1967c48b79d44a6aceb686f62 P 0c816c768f7b4dc5ae2082e195d3e681: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20260808 04:40:43.541229 29913 raft_consensus.cc:348] T 2d0cb6a1967c48b79d44a6aceb686f62 P 0c816c768f7b4dc5ae2082e195d3e681 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae908af2388f439fac792d86667e0b59" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 37241 } } peers { permanent_uuid: "0c816c768f7b4dc5ae2082e195d3e681" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 45349 } } peers { permanent_uuid: "d01930ef1a8847ce986d5c9895b2294c" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 40113 } }
I20260808 04:40:43.541365 29913 raft_consensus.cc:374] T 2d0cb6a1967c48b79d44a6aceb686f62 P 0c816c768f7b4dc5ae2082e195d3e681 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:40:43.541410 29913 raft_consensus.cc:729] T 2d0cb6a1967c48b79d44a6aceb686f62 P 0c816c768f7b4dc5ae2082e195d3e681 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c816c768f7b4dc5ae2082e195d3e681, State: Initialized, Role: FOLLOWER
I20260808 04:40:43.541584 29913 consensus_queue.cc:260] T 2d0cb6a1967c48b79d44a6aceb686f62 P 0c816c768f7b4dc5ae2082e195d3e681 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae908af2388f439fac792d86667e0b59" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 37241 } } peers { permanent_uuid: "0c816c768f7b4dc5ae2082e195d3e681" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 45349 } } peers { permanent_uuid: "d01930ef1a8847ce986d5c9895b2294c" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 40113 } }
I20260808 04:40:43.541875 29913 ts_tablet_manager.cc:1428] T 2d0cb6a1967c48b79d44a6aceb686f62 P 0c816c768f7b4dc5ae2082e195d3e681: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260808 04:40:43.542122 29920 tablet_replica.cc:439] T 2d0cb6a1967c48b79d44a6aceb686f62 P 0c816c768f7b4dc5ae2082e195d3e681: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae908af2388f439fac792d86667e0b59" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 37241 } } peers { permanent_uuid: "0c816c768f7b4dc5ae2082e195d3e681" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 45349 } } peers { permanent_uuid: "d01930ef1a8847ce986d5c9895b2294c" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 40113 } } }
I20260808 04:40:43.542186 29914 ts_tablet_manager.cc:1428] T 2d0cb6a1967c48b79d44a6aceb686f62 P ae908af2388f439fac792d86667e0b59: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260808 04:40:43.542260 29920 tablet_replica.cc:442] T 2d0cb6a1967c48b79d44a6aceb686f62 P 0c816c768f7b4dc5ae2082e195d3e681: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 04:40:43.665248 29920 raft_consensus.cc:482] T 2d0cb6a1967c48b79d44a6aceb686f62 P 0c816c768f7b4dc5ae2082e195d3e681 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 04:40:43.665410 29920 raft_consensus.cc:504] T 2d0cb6a1967c48b79d44a6aceb686f62 P 0c816c768f7b4dc5ae2082e195d3e681 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae908af2388f439fac792d86667e0b59" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 37241 } } peers { permanent_uuid: "0c816c768f7b4dc5ae2082e195d3e681" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 45349 } } peers { permanent_uuid: "d01930ef1a8847ce986d5c9895b2294c" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 40113 } }
I20260808 04:40:43.665948 29920 leader_election.cc:288] T 2d0cb6a1967c48b79d44a6aceb686f62 P 0c816c768f7b4dc5ae2082e195d3e681 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae908af2388f439fac792d86667e0b59 (127.20.240.193:37241), d01930ef1a8847ce986d5c9895b2294c (127.20.240.195:40113)
I20260808 04:40:43.666452 29536 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2d0cb6a1967c48b79d44a6aceb686f62" candidate_uuid: "0c816c768f7b4dc5ae2082e195d3e681" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae908af2388f439fac792d86667e0b59" is_pre_election: true
I20260808 04:40:43.666659 29536 raft_consensus.cc:2454] T 2d0cb6a1967c48b79d44a6aceb686f62 P ae908af2388f439fac792d86667e0b59 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c816c768f7b4dc5ae2082e195d3e681 in term 0.
I20260808 04:40:43.666620 29835 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2d0cb6a1967c48b79d44a6aceb686f62" candidate_uuid: "0c816c768f7b4dc5ae2082e195d3e681" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d01930ef1a8847ce986d5c9895b2294c" is_pre_election: true
I20260808 04:40:43.666824 29835 raft_consensus.cc:2454] T 2d0cb6a1967c48b79d44a6aceb686f62 P d01930ef1a8847ce986d5c9895b2294c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c816c768f7b4dc5ae2082e195d3e681 in term 0.
I20260808 04:40:43.667063 29613 leader_election.cc:302] T 2d0cb6a1967c48b79d44a6aceb686f62 P 0c816c768f7b4dc5ae2082e195d3e681 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c816c768f7b4dc5ae2082e195d3e681, ae908af2388f439fac792d86667e0b59; no voters:
I20260808 04:40:43.667249 29920 raft_consensus.cc:2781] T 2d0cb6a1967c48b79d44a6aceb686f62 P 0c816c768f7b4dc5ae2082e195d3e681 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 04:40:43.667320 29920 raft_consensus.cc:482] T 2d0cb6a1967c48b79d44a6aceb686f62 P 0c816c768f7b4dc5ae2082e195d3e681 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 04:40:43.667363 29920 raft_consensus.cc:3037] T 2d0cb6a1967c48b79d44a6aceb686f62 P 0c816c768f7b4dc5ae2082e195d3e681 [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:40:43.668489 29920 raft_consensus.cc:504] T 2d0cb6a1967c48b79d44a6aceb686f62 P 0c816c768f7b4dc5ae2082e195d3e681 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae908af2388f439fac792d86667e0b59" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 37241 } } peers { permanent_uuid: "0c816c768f7b4dc5ae2082e195d3e681" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 45349 } } peers { permanent_uuid: "d01930ef1a8847ce986d5c9895b2294c" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 40113 } }
I20260808 04:40:43.668854 29920 leader_election.cc:288] T 2d0cb6a1967c48b79d44a6aceb686f62 P 0c816c768f7b4dc5ae2082e195d3e681 [CANDIDATE]: Term 1 election: Requested vote from peers ae908af2388f439fac792d86667e0b59 (127.20.240.193:37241), d01930ef1a8847ce986d5c9895b2294c (127.20.240.195:40113)
I20260808 04:40:43.669257 29536 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2d0cb6a1967c48b79d44a6aceb686f62" candidate_uuid: "0c816c768f7b4dc5ae2082e195d3e681" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae908af2388f439fac792d86667e0b59"
I20260808 04:40:43.669387 29536 raft_consensus.cc:3037] T 2d0cb6a1967c48b79d44a6aceb686f62 P ae908af2388f439fac792d86667e0b59 [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:40:43.669332 29835 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2d0cb6a1967c48b79d44a6aceb686f62" candidate_uuid: "0c816c768f7b4dc5ae2082e195d3e681" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d01930ef1a8847ce986d5c9895b2294c"
I20260808 04:40:43.669519 29835 raft_consensus.cc:3037] T 2d0cb6a1967c48b79d44a6aceb686f62 P d01930ef1a8847ce986d5c9895b2294c [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:40:43.670380 29536 raft_consensus.cc:2454] T 2d0cb6a1967c48b79d44a6aceb686f62 P ae908af2388f439fac792d86667e0b59 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c816c768f7b4dc5ae2082e195d3e681 in term 1.
I20260808 04:40:43.670555 29835 raft_consensus.cc:2454] T 2d0cb6a1967c48b79d44a6aceb686f62 P d01930ef1a8847ce986d5c9895b2294c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c816c768f7b4dc5ae2082e195d3e681 in term 1.
I20260808 04:40:43.670713 29613 leader_election.cc:302] T 2d0cb6a1967c48b79d44a6aceb686f62 P 0c816c768f7b4dc5ae2082e195d3e681 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c816c768f7b4dc5ae2082e195d3e681, ae908af2388f439fac792d86667e0b59; no voters:
I20260808 04:40:43.670920 29920 raft_consensus.cc:2781] T 2d0cb6a1967c48b79d44a6aceb686f62 P 0c816c768f7b4dc5ae2082e195d3e681 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 04:40:43.671134 29920 raft_consensus.cc:686] T 2d0cb6a1967c48b79d44a6aceb686f62 P 0c816c768f7b4dc5ae2082e195d3e681 [term 1 LEADER]: Becoming Leader. State: Replica: 0c816c768f7b4dc5ae2082e195d3e681, State: Running, Role: LEADER
I20260808 04:40:43.671484 29920 consensus_queue.cc:237] T 2d0cb6a1967c48b79d44a6aceb686f62 P 0c816c768f7b4dc5ae2082e195d3e681 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae908af2388f439fac792d86667e0b59" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 37241 } } peers { permanent_uuid: "0c816c768f7b4dc5ae2082e195d3e681" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 45349 } } peers { permanent_uuid: "d01930ef1a8847ce986d5c9895b2294c" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 40113 } }
I20260808 04:40:43.672823 29961 tablet_replica.cc:439] T 2d0cb6a1967c48b79d44a6aceb686f62 P 0c816c768f7b4dc5ae2082e195d3e681: TxnStatusTablet state changed. Reason: New leader 0c816c768f7b4dc5ae2082e195d3e681. Latest consensus state: current_term: 1 leader_uuid: "0c816c768f7b4dc5ae2082e195d3e681" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae908af2388f439fac792d86667e0b59" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 37241 } } peers { permanent_uuid: "0c816c768f7b4dc5ae2082e195d3e681" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 45349 } } peers { permanent_uuid: "d01930ef1a8847ce986d5c9895b2294c" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 40113 } } }
I20260808 04:40:43.672968 29961 tablet_replica.cc:442] T 2d0cb6a1967c48b79d44a6aceb686f62 P 0c816c768f7b4dc5ae2082e195d3e681: This TxnStatusTablet replica's current role is: LEADER
I20260808 04:40:43.673305 29963 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260808 04:40:43.673470 29963 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260808 04:40:43.674364 29370 catalog_manager.cc:5495] T 2d0cb6a1967c48b79d44a6aceb686f62 P 0c816c768f7b4dc5ae2082e195d3e681 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0c816c768f7b4dc5ae2082e195d3e681 (127.20.240.194). New cstate: current_term: 1 leader_uuid: "0c816c768f7b4dc5ae2082e195d3e681" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae908af2388f439fac792d86667e0b59" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 37241 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c816c768f7b4dc5ae2082e195d3e681" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 45349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d01930ef1a8847ce986d5c9895b2294c" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 40113 } health_report { overall_health: UNKNOWN } } }
I20260808 04:40:43.699819 29908 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:43.695247 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33978 (local address 127.20.240.194:45349)
0808 04:40:43.695410 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:43.695422 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:43.695441 (+ 19us) server_negotiation.cc:407] Connection header received
0808 04:40:43.695703 (+ 262us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:43.695722 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:43.695793 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:43.695915 (+ 122us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 04:40:43.696234 (+ 319us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:43.696887 (+ 653us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:43.698027 (+ 1140us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:43.698295 (+ 268us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:43.698431 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:43.698822 (+ 391us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 04:40:43.699311 (+ 489us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 04:40:43.699464 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:43.699561 (+ 97us) server_negotiation.cc:299] Negotiation successful
0808 04:40:43.699632 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260808 04:40:43.699819 29956 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:43.695138 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.194:45349 (local address 127.0.0.1:33978)
0808 04:40:43.695331 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:43.695353 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:43.695497 (+ 144us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:43.695949 (+ 452us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:43.695953 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:43.695961 (+ 8us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 04:40:43.696104 (+ 143us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:43.696111 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:43.697033 (+ 922us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:43.697039 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:43.697865 (+ 826us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:43.697877 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:43.698432 (+ 555us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:43.698437 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:43.698548 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:43.698618 (+ 70us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 04:40:43.699435 (+ 817us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 04:40:43.699459 (+ 24us) client_negotiation.cc:769] Sending connection context
0808 04:40:43.699551 (+ 92us) client_negotiation.cc:240] Negotiation successful
0808 04:40:43.699667 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":39}
I20260808 04:40:43.703406 29536 raft_consensus.cc:1261] T 2d0cb6a1967c48b79d44a6aceb686f62 P ae908af2388f439fac792d86667e0b59 [term 1 FOLLOWER]: Refusing update from remote peer 0c816c768f7b4dc5ae2082e195d3e681: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 04:40:43.703534 29835 raft_consensus.cc:1261] T 2d0cb6a1967c48b79d44a6aceb686f62 P d01930ef1a8847ce986d5c9895b2294c [term 1 FOLLOWER]: Refusing update from remote peer 0c816c768f7b4dc5ae2082e195d3e681: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 04:40:43.703943 29920 consensus_queue.cc:1035] T 2d0cb6a1967c48b79d44a6aceb686f62 P 0c816c768f7b4dc5ae2082e195d3e681 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae908af2388f439fac792d86667e0b59" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 37241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 04:40:43.704160 29961 consensus_queue.cc:1035] T 2d0cb6a1967c48b79d44a6aceb686f62 P 0c816c768f7b4dc5ae2082e195d3e681 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d01930ef1a8847ce986d5c9895b2294c" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 40113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 04:40:43.705863 29922 tablet_replica.cc:439] T 2d0cb6a1967c48b79d44a6aceb686f62 P ae908af2388f439fac792d86667e0b59: TxnStatusTablet state changed. Reason: New leader 0c816c768f7b4dc5ae2082e195d3e681. Latest consensus state: current_term: 1 leader_uuid: "0c816c768f7b4dc5ae2082e195d3e681" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae908af2388f439fac792d86667e0b59" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 37241 } } peers { permanent_uuid: "0c816c768f7b4dc5ae2082e195d3e681" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 45349 } } peers { permanent_uuid: "d01930ef1a8847ce986d5c9895b2294c" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 40113 } } }
I20260808 04:40:43.705992 29922 tablet_replica.cc:442] T 2d0cb6a1967c48b79d44a6aceb686f62 P ae908af2388f439fac792d86667e0b59: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 04:40:43.706315 29921 tablet_replica.cc:439] T 2d0cb6a1967c48b79d44a6aceb686f62 P d01930ef1a8847ce986d5c9895b2294c: TxnStatusTablet state changed. Reason: New leader 0c816c768f7b4dc5ae2082e195d3e681. Latest consensus state: current_term: 1 leader_uuid: "0c816c768f7b4dc5ae2082e195d3e681" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae908af2388f439fac792d86667e0b59" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 37241 } } peers { permanent_uuid: "0c816c768f7b4dc5ae2082e195d3e681" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 45349 } } peers { permanent_uuid: "d01930ef1a8847ce986d5c9895b2294c" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 40113 } } }
I20260808 04:40:43.706440 29921 tablet_replica.cc:442] T 2d0cb6a1967c48b79d44a6aceb686f62 P d01930ef1a8847ce986d5c9895b2294c: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 04:40:43.708360 29920 tablet_replica.cc:439] T 2d0cb6a1967c48b79d44a6aceb686f62 P 0c816c768f7b4dc5ae2082e195d3e681: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "0c816c768f7b4dc5ae2082e195d3e681" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae908af2388f439fac792d86667e0b59" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 37241 } } peers { permanent_uuid: "0c816c768f7b4dc5ae2082e195d3e681" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 45349 } } peers { permanent_uuid: "d01930ef1a8847ce986d5c9895b2294c" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 40113 } } }
I20260808 04:40:43.708482 29920 tablet_replica.cc:442] T 2d0cb6a1967c48b79d44a6aceb686f62 P 0c816c768f7b4dc5ae2082e195d3e681: This TxnStatusTablet replica's current role is: LEADER
I20260808 04:40:43.708581 29966 mvcc.cc:205] Tried to move back new op lower bound from 7316127923003023360 to 7316127922881118208. Current Snapshot: MvccSnapshot[applied={T|T < 7316127923003023360}]
I20260808 04:40:43.710500 29920 tablet_replica.cc:439] T 2d0cb6a1967c48b79d44a6aceb686f62 P 0c816c768f7b4dc5ae2082e195d3e681: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "0c816c768f7b4dc5ae2082e195d3e681" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae908af2388f439fac792d86667e0b59" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 37241 } } peers { permanent_uuid: "0c816c768f7b4dc5ae2082e195d3e681" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 45349 } } peers { permanent_uuid: "d01930ef1a8847ce986d5c9895b2294c" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 40113 } } }
I20260808 04:40:43.710616 29920 tablet_replica.cc:442] T 2d0cb6a1967c48b79d44a6aceb686f62 P 0c816c768f7b4dc5ae2082e195d3e681: This TxnStatusTablet replica's current role is: LEADER
I20260808 04:40:43.710845 29922 tablet_replica.cc:439] T 2d0cb6a1967c48b79d44a6aceb686f62 P ae908af2388f439fac792d86667e0b59: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "0c816c768f7b4dc5ae2082e195d3e681" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae908af2388f439fac792d86667e0b59" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 37241 } } peers { permanent_uuid: "0c816c768f7b4dc5ae2082e195d3e681" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 45349 } } peers { permanent_uuid: "d01930ef1a8847ce986d5c9895b2294c" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 40113 } } }
I20260808 04:40:43.710969 29922 tablet_replica.cc:442] T 2d0cb6a1967c48b79d44a6aceb686f62 P ae908af2388f439fac792d86667e0b59: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 04:40:43.712688 29921 tablet_replica.cc:439] T 2d0cb6a1967c48b79d44a6aceb686f62 P d01930ef1a8847ce986d5c9895b2294c: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "0c816c768f7b4dc5ae2082e195d3e681" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae908af2388f439fac792d86667e0b59" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 37241 } } peers { permanent_uuid: "0c816c768f7b4dc5ae2082e195d3e681" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 45349 } } peers { permanent_uuid: "d01930ef1a8847ce986d5c9895b2294c" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 40113 } } }
I20260808 04:40:43.712805 29921 tablet_replica.cc:442] T 2d0cb6a1967c48b79d44a6aceb686f62 P d01930ef1a8847ce986d5c9895b2294c: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 04:40:43.713789 29967 mvcc.cc:205] Tried to move back new op lower bound from 7316127923003023360 to 7316127922881118208. Current Snapshot: MvccSnapshot[applied={T|T < 7316127923003023360}]
I20260808 04:40:43.719146 29976 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:43.715132 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45546 (local address 127.20.240.193:37241)
0808 04:40:43.715351 (+ 219us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:43.715355 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:43.715405 (+ 50us) server_negotiation.cc:407] Connection header received
0808 04:40:43.715608 (+ 203us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:43.715611 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:43.715677 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:43.715887 (+ 210us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 04:40:43.716130 (+ 243us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:43.716670 (+ 540us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:43.717618 (+ 948us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:43.717864 (+ 246us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:43.717978 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:43.718263 (+ 285us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 04:40:43.718717 (+ 454us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 04:40:43.718846 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:43.718909 (+ 63us) server_negotiation.cc:299] Negotiation successful
0808 04:40:43.718968 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":159,"thread_start_us":73,"threads_started":1}
I20260808 04:40:43.730651 29980 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:43.726837 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.194:45349 (local address 127.20.240.193:51429)
0808 04:40:43.727171 (+ 334us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:43.727185 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:43.727291 (+ 106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:43.727562 (+ 271us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:43.727564 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:43.727571 (+ 7us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 04:40:43.727676 (+ 105us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:43.727680 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:43.728678 (+ 998us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:43.728681 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:43.729414 (+ 733us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:43.729424 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:43.729986 (+ 562us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:43.729989 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:43.730050 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:43.730093 (+ 43us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 04:40:43.730388 (+ 295us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 04:40:43.730393 (+ 5us) client_negotiation.cc:769] Sending connection context
0808 04:40:43.730442 (+ 49us) client_negotiation.cc:240] Negotiation successful
0808 04:40:43.730507 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":205,"thread_start_us":108,"threads_started":1}
I20260808 04:40:43.730652 29908 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:43.727057 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.240.193:51429 (local address 127.20.240.194:45349)
0808 04:40:43.727200 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:43.727205 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:43.727245 (+ 40us) server_negotiation.cc:407] Connection header received
0808 04:40:43.727404 (+ 159us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:43.727408 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:43.727463 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:43.727543 (+ 80us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 04:40:43.727776 (+ 233us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:43.728565 (+ 789us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:43.729526 (+ 961us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:43.729873 (+ 347us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:43.729982 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:43.730217 (+ 235us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 04:40:43.730300 (+ 83us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 04:40:43.730378 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:43.730452 (+ 74us) server_negotiation.cc:299] Negotiation successful
0808 04:40:43.730506 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260808 04:40:43.738423 29835 raft_consensus.cc:1261] T 3cf9f7ac57ea47f8bd1d39924bffad41 P d01930ef1a8847ce986d5c9895b2294c [term 1 FOLLOWER]: Refusing update from remote peer ae908af2388f439fac792d86667e0b59: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 04:40:43.738529 29684 raft_consensus.cc:1261] T 3cf9f7ac57ea47f8bd1d39924bffad41 P 0c816c768f7b4dc5ae2082e195d3e681 [term 1 FOLLOWER]: Refusing update from remote peer ae908af2388f439fac792d86667e0b59: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 04:40:43.739001 29948 consensus_queue.cc:1035] T 3cf9f7ac57ea47f8bd1d39924bffad41 P ae908af2388f439fac792d86667e0b59 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c816c768f7b4dc5ae2082e195d3e681" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 45349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 04:40:43.739444 29948 consensus_queue.cc:1035] T 3cf9f7ac57ea47f8bd1d39924bffad41 P ae908af2388f439fac792d86667e0b59 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d01930ef1a8847ce986d5c9895b2294c" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 40113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 04:40:43.762508 29985 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:43.758485 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.193:37241 (local address 127.20.240.194:58111)
0808 04:40:43.758860 (+ 375us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:43.758873 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:43.759001 (+ 128us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:43.759257 (+ 256us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:43.759260 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:43.759289 (+ 29us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 04:40:43.759406 (+ 117us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:43.759413 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:43.760212 (+ 799us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:43.760216 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:43.761115 (+ 899us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:43.761123 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:43.761742 (+ 619us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:43.761746 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:43.761830 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:43.761878 (+ 48us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 04:40:43.762221 (+ 343us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 04:40:43.762228 (+ 7us) client_negotiation.cc:769] Sending connection context
0808 04:40:43.762299 (+ 71us) client_negotiation.cc:240] Negotiation successful
0808 04:40:43.762374 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":270,"thread_start_us":108,"threads_started":1}
I20260808 04:40:43.762533 29976 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:43.758525 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.240.194:58111 (local address 127.20.240.193:37241)
0808 04:40:43.758687 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:43.758691 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:43.758947 (+ 256us) server_negotiation.cc:407] Connection header received
0808 04:40:43.759103 (+ 156us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:43.759106 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:43.759151 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:43.759236 (+ 85us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 04:40:43.759514 (+ 278us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:43.760057 (+ 543us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:43.761263 (+ 1206us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:43.761621 (+ 358us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:43.761726 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:43.762014 (+ 288us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 04:40:43.762098 (+ 84us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 04:40:43.762174 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:43.762336 (+ 162us) server_negotiation.cc:299] Negotiation successful
0808 04:40:43.762403 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260808 04:40:43.794016 29369 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:37556:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 04:40:43.794200 29369 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:37556:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 04:40:43.796434 29369 catalog_manager.cc:5782] T 00000000000000000000000000000000 P fc87c6b2494c4b6c8b57e3923aab1f25: Sending DeleteTablet for 3 replicas of tablet 3cf9f7ac57ea47f8bd1d39924bffad41
I20260808 04:40:43.797415 29812 tablet_service.cc:1514] Processing DeleteTablet for tablet 3cf9f7ac57ea47f8bd1d39924bffad41 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 04:40:43 UTC) from {username='oryx', principal='oryx/127.20.240.254@KRBTEST.COM'} at 127.0.0.1:58468
I20260808 04:40:43.797768 29514 tablet_service.cc:1514] Processing DeleteTablet for tablet 3cf9f7ac57ea47f8bd1d39924bffad41 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 04:40:43 UTC) from {username='oryx', principal='oryx/127.20.240.254@KRBTEST.COM'} at 127.0.0.1:45532
I20260808 04:40:43.798478 29663 tablet_service.cc:1514] Processing DeleteTablet for tablet 3cf9f7ac57ea47f8bd1d39924bffad41 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 04:40:43 UTC) from {username='oryx', principal='oryx/127.20.240.254@KRBTEST.COM'} at 127.0.0.1:33970
I20260808 04:40:43.798954 29990 tablet_replica.cc:330] T 3cf9f7ac57ea47f8bd1d39924bffad41 P d01930ef1a8847ce986d5c9895b2294c: stopping tablet replica
I20260808 04:40:43.799185 29992 tablet_replica.cc:330] T 3cf9f7ac57ea47f8bd1d39924bffad41 P 0c816c768f7b4dc5ae2082e195d3e681: stopping tablet replica
I20260808 04:40:43.799706 29990 raft_consensus.cc:2229] T 3cf9f7ac57ea47f8bd1d39924bffad41 P d01930ef1a8847ce986d5c9895b2294c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 04:40:43.799898 29992 raft_consensus.cc:2229] T 3cf9f7ac57ea47f8bd1d39924bffad41 P 0c816c768f7b4dc5ae2082e195d3e681 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 04:40:43.800101 29990 raft_consensus.cc:2258] T 3cf9f7ac57ea47f8bd1d39924bffad41 P d01930ef1a8847ce986d5c9895b2294c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 04:40:43.800284 29992 raft_consensus.cc:2258] T 3cf9f7ac57ea47f8bd1d39924bffad41 P 0c816c768f7b4dc5ae2082e195d3e681 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 04:40:43.801093 29992 ts_tablet_manager.cc:1905] T 3cf9f7ac57ea47f8bd1d39924bffad41 P 0c816c768f7b4dc5ae2082e195d3e681: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 04:40:43.801415 29991 tablet_replica.cc:330] T 3cf9f7ac57ea47f8bd1d39924bffad41 P ae908af2388f439fac792d86667e0b59: stopping tablet replica
I20260808 04:40:43.801556 29991 raft_consensus.cc:2229] T 3cf9f7ac57ea47f8bd1d39924bffad41 P ae908af2388f439fac792d86667e0b59 [term 1 LEADER]: Raft consensus shutting down.
I20260808 04:40:43.801800 29990 ts_tablet_manager.cc:1905] T 3cf9f7ac57ea47f8bd1d39924bffad41 P d01930ef1a8847ce986d5c9895b2294c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 04:40:43.801920 29991 raft_consensus.cc:2258] T 3cf9f7ac57ea47f8bd1d39924bffad41 P ae908af2388f439fac792d86667e0b59 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 04:40:43.802587 29991 ts_tablet_manager.cc:1905] T 3cf9f7ac57ea47f8bd1d39924bffad41 P ae908af2388f439fac792d86667e0b59: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 04:40:43.805616 29992 ts_tablet_manager.cc:1918] T 3cf9f7ac57ea47f8bd1d39924bffad41 P 0c816c768f7b4dc5ae2082e195d3e681: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 04:40:43.805616 29991 ts_tablet_manager.cc:1918] T 3cf9f7ac57ea47f8bd1d39924bffad41 P ae908af2388f439fac792d86667e0b59: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 04:40:43.805706 29991 log.cc:1196] T 3cf9f7ac57ea47f8bd1d39924bffad41 P ae908af2388f439fac792d86667e0b59: Deleting WAL directory at /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786164000593138-21443-0/minicluster-data/ts-0/wal/wals/3cf9f7ac57ea47f8bd1d39924bffad41
I20260808 04:40:43.805992 29991 ts_tablet_manager.cc:1939] T 3cf9f7ac57ea47f8bd1d39924bffad41 P ae908af2388f439fac792d86667e0b59: Deleting consensus metadata
I20260808 04:40:43.808525 29356 catalog_manager.cc:4841] TS ae908af2388f439fac792d86667e0b59 (127.20.240.193:37241): tablet 3cf9f7ac57ea47f8bd1d39924bffad41 (table test-table [id=6192d245aa5d47a8a7328798dbd483a6]) successfully deleted
I20260808 04:40:43.808773 29992 log.cc:1196] T 3cf9f7ac57ea47f8bd1d39924bffad41 P 0c816c768f7b4dc5ae2082e195d3e681: Deleting WAL directory at /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786164000593138-21443-0/minicluster-data/ts-1/wal/wals/3cf9f7ac57ea47f8bd1d39924bffad41
I20260808 04:40:43.809108 29992 ts_tablet_manager.cc:1939] T 3cf9f7ac57ea47f8bd1d39924bffad41 P 0c816c768f7b4dc5ae2082e195d3e681: Deleting consensus metadata
I20260808 04:40:43.809873 29990 ts_tablet_manager.cc:1918] T 3cf9f7ac57ea47f8bd1d39924bffad41 P d01930ef1a8847ce986d5c9895b2294c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 04:40:43.809970 29990 log.cc:1196] T 3cf9f7ac57ea47f8bd1d39924bffad41 P d01930ef1a8847ce986d5c9895b2294c: Deleting WAL directory at /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786164000593138-21443-0/minicluster-data/ts-2/wal/wals/3cf9f7ac57ea47f8bd1d39924bffad41
I20260808 04:40:43.809986 29356 catalog_manager.cc:4841] TS 0c816c768f7b4dc5ae2082e195d3e681 (127.20.240.194:45349): tablet 3cf9f7ac57ea47f8bd1d39924bffad41 (table test-table [id=6192d245aa5d47a8a7328798dbd483a6]) successfully deleted
I20260808 04:40:43.810256 29990 ts_tablet_manager.cc:1939] T 3cf9f7ac57ea47f8bd1d39924bffad41 P d01930ef1a8847ce986d5c9895b2294c: Deleting consensus metadata
I20260808 04:40:43.811021 29356 catalog_manager.cc:4841] TS d01930ef1a8847ce986d5c9895b2294c (127.20.240.195:40113): tablet 3cf9f7ac57ea47f8bd1d39924bffad41 (table test-table [id=6192d245aa5d47a8a7328798dbd483a6]) successfully deleted
Aug 08 04:40:43 dist-test-slave-vxj2 krb5kdc[29324](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164043, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 08 04:40:43 dist-test-slave-vxj2 krb5kdc[29324](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.20.240.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 04:40:43 dist-test-slave-vxj2 krb5kdc[29324](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.20.240.254@KRBTEST.COM, Server not found in Kerberos database
W20260808 04:40:43.840525 29957 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 04:40:43.829638 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37578 (local address 127.20.240.254:43347)
0808 04:40:43.829791 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:43.829796 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:43.830099 (+ 303us) server_negotiation.cc:407] Connection header received
0808 04:40:43.830274 (+ 175us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:43.830278 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:43.830332 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:43.830423 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:43.831189 (+ 766us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:43.831750 (+ 561us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:43.832602 (+ 852us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:43.832852 (+ 250us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:43.832966 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:43.840387 (+ 7421us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:37578: BlockingRecv error: recv got EOF from 127.0.0.1:37578 (error 108)
Metrics: {"server-negotiator.queue_time_us":53}
Aug 08 04:40:43 dist-test-slave-vxj2 krb5kdc[29324](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164043, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.20.240.254@KRBTEST.COM
I20260808 04:40:43.851812 29957 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:43.842878 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37588 (local address 127.20.240.254:43347)
0808 04:40:43.843051 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:43.843056 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:43.843344 (+ 288us) server_negotiation.cc:407] Connection header received
0808 04:40:43.843499 (+ 155us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:43.843502 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:43.843556 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:43.843643 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:43.844268 (+ 625us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:43.844831 (+ 563us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:43.845742 (+ 911us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:43.845980 (+ 238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:43.846093 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:43.848479 (+ 2386us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:40:43.848483 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:40:43.848486 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:40:43.848520 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:40:43.850121 (+ 1601us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:43.850543 (+ 422us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:43.850547 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:43.850549 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:43.850636 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:43.850923 (+ 287us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:43.850927 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:43.850928 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:43.851120 (+ 192us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:40:43.851273 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:43.851500 (+ 227us) server_negotiation.cc:299] Negotiation successful
0808 04:40:43.851624 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":92}
I20260808 04:40:43.854626 29369 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37588:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 04:40:43.855176 29369 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 04:40:43.860360 29514 tablet_service.cc:1467] Processing CreateTablet for tablet dbfba4405e4c481b9b6e97e88b4b9667 (DEFAULT_TABLE table=test-table [id=e51ccefb770b4a22a39c6043af0d7cb6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 04:40:43.860718 29514 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dbfba4405e4c481b9b6e97e88b4b9667. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:40:43.862859 29914 tablet_bootstrap.cc:492] T dbfba4405e4c481b9b6e97e88b4b9667 P ae908af2388f439fac792d86667e0b59: Bootstrap starting.
I20260808 04:40:43.863931 29914 tablet_bootstrap.cc:654] T dbfba4405e4c481b9b6e97e88b4b9667 P ae908af2388f439fac792d86667e0b59: Neither blocks nor log segments found. Creating new log.
I20260808 04:40:43.864001 29663 tablet_service.cc:1467] Processing CreateTablet for tablet dbfba4405e4c481b9b6e97e88b4b9667 (DEFAULT_TABLE table=test-table [id=e51ccefb770b4a22a39c6043af0d7cb6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 04:40:43.864315 29663 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dbfba4405e4c481b9b6e97e88b4b9667. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:40:43.865516 29812 tablet_service.cc:1467] Processing CreateTablet for tablet dbfba4405e4c481b9b6e97e88b4b9667 (DEFAULT_TABLE table=test-table [id=e51ccefb770b4a22a39c6043af0d7cb6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 04:40:43.865806 29812 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dbfba4405e4c481b9b6e97e88b4b9667. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:40:43.868412 29915 tablet_bootstrap.cc:492] T dbfba4405e4c481b9b6e97e88b4b9667 P d01930ef1a8847ce986d5c9895b2294c: Bootstrap starting.
I20260808 04:40:43.869325 29915 tablet_bootstrap.cc:654] T dbfba4405e4c481b9b6e97e88b4b9667 P d01930ef1a8847ce986d5c9895b2294c: Neither blocks nor log segments found. Creating new log.
I20260808 04:40:43.871461 29913 tablet_bootstrap.cc:492] T dbfba4405e4c481b9b6e97e88b4b9667 P 0c816c768f7b4dc5ae2082e195d3e681: Bootstrap starting.
I20260808 04:40:43.872228 29914 tablet_bootstrap.cc:492] T dbfba4405e4c481b9b6e97e88b4b9667 P ae908af2388f439fac792d86667e0b59: No bootstrap required, opened a new log
I20260808 04:40:43.872336 29914 ts_tablet_manager.cc:1397] T dbfba4405e4c481b9b6e97e88b4b9667 P ae908af2388f439fac792d86667e0b59: Time spent bootstrapping tablet: real 0.010s user 0.001s sys 0.001s
I20260808 04:40:43.872543 29913 tablet_bootstrap.cc:654] T dbfba4405e4c481b9b6e97e88b4b9667 P 0c816c768f7b4dc5ae2082e195d3e681: Neither blocks nor log segments found. Creating new log.
I20260808 04:40:43.872783 29914 raft_consensus.cc:348] T dbfba4405e4c481b9b6e97e88b4b9667 P ae908af2388f439fac792d86667e0b59 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae908af2388f439fac792d86667e0b59" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 37241 } } peers { permanent_uuid: "0c816c768f7b4dc5ae2082e195d3e681" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 45349 } } peers { permanent_uuid: "d01930ef1a8847ce986d5c9895b2294c" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 40113 } }
I20260808 04:40:43.872920 29914 raft_consensus.cc:374] T dbfba4405e4c481b9b6e97e88b4b9667 P ae908af2388f439fac792d86667e0b59 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:40:43.872954 29914 raft_consensus.cc:729] T dbfba4405e4c481b9b6e97e88b4b9667 P ae908af2388f439fac792d86667e0b59 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae908af2388f439fac792d86667e0b59, State: Initialized, Role: FOLLOWER
I20260808 04:40:43.873077 29914 consensus_queue.cc:260] T dbfba4405e4c481b9b6e97e88b4b9667 P ae908af2388f439fac792d86667e0b59 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae908af2388f439fac792d86667e0b59" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 37241 } } peers { permanent_uuid: "0c816c768f7b4dc5ae2082e195d3e681" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 45349 } } peers { permanent_uuid: "d01930ef1a8847ce986d5c9895b2294c" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 40113 } }
I20260808 04:40:43.873348 29914 ts_tablet_manager.cc:1428] T dbfba4405e4c481b9b6e97e88b4b9667 P ae908af2388f439fac792d86667e0b59: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260808 04:40:43.874509 29915 tablet_bootstrap.cc:492] T dbfba4405e4c481b9b6e97e88b4b9667 P d01930ef1a8847ce986d5c9895b2294c: No bootstrap required, opened a new log
I20260808 04:40:43.874614 29915 ts_tablet_manager.cc:1397] T dbfba4405e4c481b9b6e97e88b4b9667 P d01930ef1a8847ce986d5c9895b2294c: Time spent bootstrapping tablet: real 0.006s user 0.001s sys 0.000s
I20260808 04:40:43.875044 29915 raft_consensus.cc:348] T dbfba4405e4c481b9b6e97e88b4b9667 P d01930ef1a8847ce986d5c9895b2294c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae908af2388f439fac792d86667e0b59" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 37241 } } peers { permanent_uuid: "0c816c768f7b4dc5ae2082e195d3e681" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 45349 } } peers { permanent_uuid: "d01930ef1a8847ce986d5c9895b2294c" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 40113 } }
I20260808 04:40:43.875165 29915 raft_consensus.cc:374] T dbfba4405e4c481b9b6e97e88b4b9667 P d01930ef1a8847ce986d5c9895b2294c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:40:43.875198 29915 raft_consensus.cc:729] T dbfba4405e4c481b9b6e97e88b4b9667 P d01930ef1a8847ce986d5c9895b2294c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d01930ef1a8847ce986d5c9895b2294c, State: Initialized, Role: FOLLOWER
I20260808 04:40:43.875314 29915 consensus_queue.cc:260] T dbfba4405e4c481b9b6e97e88b4b9667 P d01930ef1a8847ce986d5c9895b2294c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae908af2388f439fac792d86667e0b59" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 37241 } } peers { permanent_uuid: "0c816c768f7b4dc5ae2082e195d3e681" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 45349 } } peers { permanent_uuid: "d01930ef1a8847ce986d5c9895b2294c" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 40113 } }
I20260808 04:40:43.875556 29915 ts_tablet_manager.cc:1428] T dbfba4405e4c481b9b6e97e88b4b9667 P d01930ef1a8847ce986d5c9895b2294c: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260808 04:40:43.876480 29913 tablet_bootstrap.cc:492] T dbfba4405e4c481b9b6e97e88b4b9667 P 0c816c768f7b4dc5ae2082e195d3e681: No bootstrap required, opened a new log
I20260808 04:40:43.876590 29913 ts_tablet_manager.cc:1397] T dbfba4405e4c481b9b6e97e88b4b9667 P 0c816c768f7b4dc5ae2082e195d3e681: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
I20260808 04:40:43.877102 29913 raft_consensus.cc:348] T dbfba4405e4c481b9b6e97e88b4b9667 P 0c816c768f7b4dc5ae2082e195d3e681 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae908af2388f439fac792d86667e0b59" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 37241 } } peers { permanent_uuid: "0c816c768f7b4dc5ae2082e195d3e681" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 45349 } } peers { permanent_uuid: "d01930ef1a8847ce986d5c9895b2294c" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 40113 } }
I20260808 04:40:43.877246 29913 raft_consensus.cc:374] T dbfba4405e4c481b9b6e97e88b4b9667 P 0c816c768f7b4dc5ae2082e195d3e681 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:40:43.877275 29913 raft_consensus.cc:729] T dbfba4405e4c481b9b6e97e88b4b9667 P 0c816c768f7b4dc5ae2082e195d3e681 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c816c768f7b4dc5ae2082e195d3e681, State: Initialized, Role: FOLLOWER
I20260808 04:40:43.877384 29913 consensus_queue.cc:260] T dbfba4405e4c481b9b6e97e88b4b9667 P 0c816c768f7b4dc5ae2082e195d3e681 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae908af2388f439fac792d86667e0b59" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 37241 } } peers { permanent_uuid: "0c816c768f7b4dc5ae2082e195d3e681" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 45349 } } peers { permanent_uuid: "d01930ef1a8847ce986d5c9895b2294c" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 40113 } }
I20260808 04:40:43.877650 29913 ts_tablet_manager.cc:1428] T dbfba4405e4c481b9b6e97e88b4b9667 P 0c816c768f7b4dc5ae2082e195d3e681: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260808 04:40:43.890965 29920 raft_consensus.cc:482] T dbfba4405e4c481b9b6e97e88b4b9667 P 0c816c768f7b4dc5ae2082e195d3e681 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 04:40:43.891106 29920 raft_consensus.cc:504] T dbfba4405e4c481b9b6e97e88b4b9667 P 0c816c768f7b4dc5ae2082e195d3e681 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae908af2388f439fac792d86667e0b59" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 37241 } } peers { permanent_uuid: "0c816c768f7b4dc5ae2082e195d3e681" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 45349 } } peers { permanent_uuid: "d01930ef1a8847ce986d5c9895b2294c" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 40113 } }
I20260808 04:40:43.891511 29920 leader_election.cc:288] T dbfba4405e4c481b9b6e97e88b4b9667 P 0c816c768f7b4dc5ae2082e195d3e681 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae908af2388f439fac792d86667e0b59 (127.20.240.193:37241), d01930ef1a8847ce986d5c9895b2294c (127.20.240.195:40113)
I20260808 04:40:43.891916 29536 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dbfba4405e4c481b9b6e97e88b4b9667" candidate_uuid: "0c816c768f7b4dc5ae2082e195d3e681" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae908af2388f439fac792d86667e0b59" is_pre_election: true
I20260808 04:40:43.892084 29536 raft_consensus.cc:2454] T dbfba4405e4c481b9b6e97e88b4b9667 P ae908af2388f439fac792d86667e0b59 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c816c768f7b4dc5ae2082e195d3e681 in term 0.
I20260808 04:40:43.892084 29835 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dbfba4405e4c481b9b6e97e88b4b9667" candidate_uuid: "0c816c768f7b4dc5ae2082e195d3e681" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d01930ef1a8847ce986d5c9895b2294c" is_pre_election: true
I20260808 04:40:43.892220 29835 raft_consensus.cc:2454] T dbfba4405e4c481b9b6e97e88b4b9667 P d01930ef1a8847ce986d5c9895b2294c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c816c768f7b4dc5ae2082e195d3e681 in term 0.
I20260808 04:40:43.892442 29613 leader_election.cc:302] T dbfba4405e4c481b9b6e97e88b4b9667 P 0c816c768f7b4dc5ae2082e195d3e681 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c816c768f7b4dc5ae2082e195d3e681, ae908af2388f439fac792d86667e0b59; no voters:
I20260808 04:40:43.892642 29920 raft_consensus.cc:2781] T dbfba4405e4c481b9b6e97e88b4b9667 P 0c816c768f7b4dc5ae2082e195d3e681 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 04:40:43.892717 29920 raft_consensus.cc:482] T dbfba4405e4c481b9b6e97e88b4b9667 P 0c816c768f7b4dc5ae2082e195d3e681 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 04:40:43.892751 29920 raft_consensus.cc:3037] T dbfba4405e4c481b9b6e97e88b4b9667 P 0c816c768f7b4dc5ae2082e195d3e681 [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:40:43.894057 29920 raft_consensus.cc:504] T dbfba4405e4c481b9b6e97e88b4b9667 P 0c816c768f7b4dc5ae2082e195d3e681 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae908af2388f439fac792d86667e0b59" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 37241 } } peers { permanent_uuid: "0c816c768f7b4dc5ae2082e195d3e681" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 45349 } } peers { permanent_uuid: "d01930ef1a8847ce986d5c9895b2294c" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 40113 } }
I20260808 04:40:43.894421 29920 leader_election.cc:288] T dbfba4405e4c481b9b6e97e88b4b9667 P 0c816c768f7b4dc5ae2082e195d3e681 [CANDIDATE]: Term 1 election: Requested vote from peers ae908af2388f439fac792d86667e0b59 (127.20.240.193:37241), d01930ef1a8847ce986d5c9895b2294c (127.20.240.195:40113)
I20260808 04:40:43.894814 29835 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dbfba4405e4c481b9b6e97e88b4b9667" candidate_uuid: "0c816c768f7b4dc5ae2082e195d3e681" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d01930ef1a8847ce986d5c9895b2294c"
I20260808 04:40:43.894826 29536 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dbfba4405e4c481b9b6e97e88b4b9667" candidate_uuid: "0c816c768f7b4dc5ae2082e195d3e681" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae908af2388f439fac792d86667e0b59"
I20260808 04:40:43.894938 29835 raft_consensus.cc:3037] T dbfba4405e4c481b9b6e97e88b4b9667 P d01930ef1a8847ce986d5c9895b2294c [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:40:43.894975 29536 raft_consensus.cc:3037] T dbfba4405e4c481b9b6e97e88b4b9667 P ae908af2388f439fac792d86667e0b59 [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:40:43.895905 29536 raft_consensus.cc:2454] T dbfba4405e4c481b9b6e97e88b4b9667 P ae908af2388f439fac792d86667e0b59 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c816c768f7b4dc5ae2082e195d3e681 in term 1.
I20260808 04:40:43.896075 29835 raft_consensus.cc:2454] T dbfba4405e4c481b9b6e97e88b4b9667 P d01930ef1a8847ce986d5c9895b2294c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c816c768f7b4dc5ae2082e195d3e681 in term 1.
I20260808 04:40:43.896193 29613 leader_election.cc:302] T dbfba4405e4c481b9b6e97e88b4b9667 P 0c816c768f7b4dc5ae2082e195d3e681 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c816c768f7b4dc5ae2082e195d3e681, ae908af2388f439fac792d86667e0b59; no voters:
I20260808 04:40:43.896355 29920 raft_consensus.cc:2781] T dbfba4405e4c481b9b6e97e88b4b9667 P 0c816c768f7b4dc5ae2082e195d3e681 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 04:40:43.896456 29920 raft_consensus.cc:686] T dbfba4405e4c481b9b6e97e88b4b9667 P 0c816c768f7b4dc5ae2082e195d3e681 [term 1 LEADER]: Becoming Leader. State: Replica: 0c816c768f7b4dc5ae2082e195d3e681, State: Running, Role: LEADER
I20260808 04:40:43.896591 29920 consensus_queue.cc:237] T dbfba4405e4c481b9b6e97e88b4b9667 P 0c816c768f7b4dc5ae2082e195d3e681 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae908af2388f439fac792d86667e0b59" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 37241 } } peers { permanent_uuid: "0c816c768f7b4dc5ae2082e195d3e681" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 45349 } } peers { permanent_uuid: "d01930ef1a8847ce986d5c9895b2294c" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 40113 } }
I20260808 04:40:43.898581 29371 catalog_manager.cc:5495] T dbfba4405e4c481b9b6e97e88b4b9667 P 0c816c768f7b4dc5ae2082e195d3e681 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0c816c768f7b4dc5ae2082e195d3e681 (127.20.240.194). New cstate: current_term: 1 leader_uuid: "0c816c768f7b4dc5ae2082e195d3e681" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae908af2388f439fac792d86667e0b59" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 37241 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c816c768f7b4dc5ae2082e195d3e681" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 45349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d01930ef1a8847ce986d5c9895b2294c" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 40113 } health_report { overall_health: UNKNOWN } } }
I20260808 04:40:43.914208 29908 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:43.910521 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33990 (local address 127.20.240.194:45349)
0808 04:40:43.910665 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:43.910669 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:43.910682 (+ 13us) server_negotiation.cc:407] Connection header received
0808 04:40:43.910734 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:43.910736 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:43.910789 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:43.910855 (+ 66us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 04:40:43.911174 (+ 319us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:43.911685 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:43.912950 (+ 1265us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:43.913266 (+ 316us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:43.913355 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:43.913660 (+ 305us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 04:40:43.913734 (+ 74us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 04:40:43.913841 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:43.913954 (+ 113us) server_negotiation.cc:299] Negotiation successful
0808 04:40:43.914004 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260808 04:40:43.916620 29536 raft_consensus.cc:1261] T dbfba4405e4c481b9b6e97e88b4b9667 P ae908af2388f439fac792d86667e0b59 [term 1 FOLLOWER]: Refusing update from remote peer 0c816c768f7b4dc5ae2082e195d3e681: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 04:40:43.916716 29835 raft_consensus.cc:1261] T dbfba4405e4c481b9b6e97e88b4b9667 P d01930ef1a8847ce986d5c9895b2294c [term 1 FOLLOWER]: Refusing update from remote peer 0c816c768f7b4dc5ae2082e195d3e681: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 04:40:43.917086 29920 consensus_queue.cc:1035] T dbfba4405e4c481b9b6e97e88b4b9667 P 0c816c768f7b4dc5ae2082e195d3e681 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae908af2388f439fac792d86667e0b59" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 37241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 04:40:43.917271 29981 consensus_queue.cc:1035] T dbfba4405e4c481b9b6e97e88b4b9667 P 0c816c768f7b4dc5ae2082e195d3e681 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d01930ef1a8847ce986d5c9895b2294c" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 40113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 04:40:43.932606 29371 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37588:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 04:40:43.932786 29371 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37588:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 04:40:43.935171 29371 catalog_manager.cc:5782] T 00000000000000000000000000000000 P fc87c6b2494c4b6c8b57e3923aab1f25: Sending DeleteTablet for 3 replicas of tablet dbfba4405e4c481b9b6e97e88b4b9667
I20260808 04:40:43.935693 29514 tablet_service.cc:1514] Processing DeleteTablet for tablet dbfba4405e4c481b9b6e97e88b4b9667 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 04:40:43 UTC) from {username='oryx', principal='oryx/127.20.240.254@KRBTEST.COM'} at 127.0.0.1:45532
I20260808 04:40:43.935902 29991 tablet_replica.cc:330] T dbfba4405e4c481b9b6e97e88b4b9667 P ae908af2388f439fac792d86667e0b59: stopping tablet replica
I20260808 04:40:43.936048 29991 raft_consensus.cc:2229] T dbfba4405e4c481b9b6e97e88b4b9667 P ae908af2388f439fac792d86667e0b59 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 04:40:43.936199 29991 raft_consensus.cc:2258] T dbfba4405e4c481b9b6e97e88b4b9667 P ae908af2388f439fac792d86667e0b59 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 04:40:43.936278 29663 tablet_service.cc:1514] Processing DeleteTablet for tablet dbfba4405e4c481b9b6e97e88b4b9667 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 04:40:43 UTC) from {username='oryx', principal='oryx/127.20.240.254@KRBTEST.COM'} at 127.0.0.1:33970
I20260808 04:40:43.936528 29992 tablet_replica.cc:330] T dbfba4405e4c481b9b6e97e88b4b9667 P 0c816c768f7b4dc5ae2082e195d3e681: stopping tablet replica
I20260808 04:40:43.936666 29992 raft_consensus.cc:2229] T dbfba4405e4c481b9b6e97e88b4b9667 P 0c816c768f7b4dc5ae2082e195d3e681 [term 1 LEADER]: Raft consensus shutting down.
I20260808 04:40:43.936978 29992 raft_consensus.cc:2258] T dbfba4405e4c481b9b6e97e88b4b9667 P 0c816c768f7b4dc5ae2082e195d3e681 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 04:40:43.937249 29812 tablet_service.cc:1514] Processing DeleteTablet for tablet dbfba4405e4c481b9b6e97e88b4b9667 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 04:40:43 UTC) from {username='oryx', principal='oryx/127.20.240.254@KRBTEST.COM'} at 127.0.0.1:58468
I20260808 04:40:43.937477 29990 tablet_replica.cc:330] T dbfba4405e4c481b9b6e97e88b4b9667 P d01930ef1a8847ce986d5c9895b2294c: stopping tablet replica
I20260808 04:40:43.937597 29990 raft_consensus.cc:2229] T dbfba4405e4c481b9b6e97e88b4b9667 P d01930ef1a8847ce986d5c9895b2294c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 04:40:43.937747 29990 raft_consensus.cc:2258] T dbfba4405e4c481b9b6e97e88b4b9667 P d01930ef1a8847ce986d5c9895b2294c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 04:40:43.938479 29992 ts_tablet_manager.cc:1905] T dbfba4405e4c481b9b6e97e88b4b9667 P 0c816c768f7b4dc5ae2082e195d3e681: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 04:40:43.938480 29990 ts_tablet_manager.cc:1905] T dbfba4405e4c481b9b6e97e88b4b9667 P d01930ef1a8847ce986d5c9895b2294c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 04:40:43.941218 29990 ts_tablet_manager.cc:1918] T dbfba4405e4c481b9b6e97e88b4b9667 P d01930ef1a8847ce986d5c9895b2294c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 04:40:43.941218 29992 ts_tablet_manager.cc:1918] T dbfba4405e4c481b9b6e97e88b4b9667 P 0c816c768f7b4dc5ae2082e195d3e681: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 04:40:43.941318 29990 log.cc:1196] T dbfba4405e4c481b9b6e97e88b4b9667 P d01930ef1a8847ce986d5c9895b2294c: Deleting WAL directory at /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786164000593138-21443-0/minicluster-data/ts-2/wal/wals/dbfba4405e4c481b9b6e97e88b4b9667
I20260808 04:40:43.941318 29992 log.cc:1196] T dbfba4405e4c481b9b6e97e88b4b9667 P 0c816c768f7b4dc5ae2082e195d3e681: Deleting WAL directory at /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786164000593138-21443-0/minicluster-data/ts-1/wal/wals/dbfba4405e4c481b9b6e97e88b4b9667
I20260808 04:40:43.941601 29992 ts_tablet_manager.cc:1939] T dbfba4405e4c481b9b6e97e88b4b9667 P 0c816c768f7b4dc5ae2082e195d3e681: Deleting consensus metadata
I20260808 04:40:43.941601 29990 ts_tablet_manager.cc:1939] T dbfba4405e4c481b9b6e97e88b4b9667 P d01930ef1a8847ce986d5c9895b2294c: Deleting consensus metadata
I20260808 04:40:43.942399 29356 catalog_manager.cc:4841] TS 0c816c768f7b4dc5ae2082e195d3e681 (127.20.240.194:45349): tablet dbfba4405e4c481b9b6e97e88b4b9667 (table test-table [id=e51ccefb770b4a22a39c6043af0d7cb6]) successfully deleted
I20260808 04:40:43.942619 29356 catalog_manager.cc:4841] TS d01930ef1a8847ce986d5c9895b2294c (127.20.240.195:40113): tablet dbfba4405e4c481b9b6e97e88b4b9667 (table test-table [id=e51ccefb770b4a22a39c6043af0d7cb6]) successfully deleted
I20260808 04:40:43.942768 29991 ts_tablet_manager.cc:1905] T dbfba4405e4c481b9b6e97e88b4b9667 P ae908af2388f439fac792d86667e0b59: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 04:40:43.943738 29371 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37588:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 04:40:43.944223 29371 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 04:40:43.945058 29991 ts_tablet_manager.cc:1918] T dbfba4405e4c481b9b6e97e88b4b9667 P ae908af2388f439fac792d86667e0b59: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 04:40:43.945200 29991 log.cc:1196] T dbfba4405e4c481b9b6e97e88b4b9667 P ae908af2388f439fac792d86667e0b59: Deleting WAL directory at /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786164000593138-21443-0/minicluster-data/ts-0/wal/wals/dbfba4405e4c481b9b6e97e88b4b9667
I20260808 04:40:43.945472 29991 ts_tablet_manager.cc:1939] T dbfba4405e4c481b9b6e97e88b4b9667 P ae908af2388f439fac792d86667e0b59: Deleting consensus metadata
I20260808 04:40:43.946245 29356 catalog_manager.cc:4841] TS ae908af2388f439fac792d86667e0b59 (127.20.240.193:37241): tablet dbfba4405e4c481b9b6e97e88b4b9667 (table test-table [id=e51ccefb770b4a22a39c6043af0d7cb6]) successfully deleted
I20260808 04:40:43.950105 29514 tablet_service.cc:1467] Processing CreateTablet for tablet 6fc48d6a702b4e41b98fd6b6406756ea (DEFAULT_TABLE table=test-table [id=a677aa1421df41febe5683f0105475e9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 04:40:43.950259 29812 tablet_service.cc:1467] Processing CreateTablet for tablet 6fc48d6a702b4e41b98fd6b6406756ea (DEFAULT_TABLE table=test-table [id=a677aa1421df41febe5683f0105475e9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 04:40:43.950394 29514 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6fc48d6a702b4e41b98fd6b6406756ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:40:43.950568 29812 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6fc48d6a702b4e41b98fd6b6406756ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:40:43.952643 29914 tablet_bootstrap.cc:492] T 6fc48d6a702b4e41b98fd6b6406756ea P ae908af2388f439fac792d86667e0b59: Bootstrap starting.
I20260808 04:40:43.953078 29915 tablet_bootstrap.cc:492] T 6fc48d6a702b4e41b98fd6b6406756ea P d01930ef1a8847ce986d5c9895b2294c: Bootstrap starting.
I20260808 04:40:43.953354 29663 tablet_service.cc:1467] Processing CreateTablet for tablet 6fc48d6a702b4e41b98fd6b6406756ea (DEFAULT_TABLE table=test-table [id=a677aa1421df41febe5683f0105475e9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 04:40:43.953644 29663 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6fc48d6a702b4e41b98fd6b6406756ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:40:43.953687 29914 tablet_bootstrap.cc:654] T 6fc48d6a702b4e41b98fd6b6406756ea P ae908af2388f439fac792d86667e0b59: Neither blocks nor log segments found. Creating new log.
I20260808 04:40:43.953965 29915 tablet_bootstrap.cc:654] T 6fc48d6a702b4e41b98fd6b6406756ea P d01930ef1a8847ce986d5c9895b2294c: Neither blocks nor log segments found. Creating new log.
I20260808 04:40:43.955554 29915 tablet_bootstrap.cc:492] T 6fc48d6a702b4e41b98fd6b6406756ea P d01930ef1a8847ce986d5c9895b2294c: No bootstrap required, opened a new log
I20260808 04:40:43.955641 29915 ts_tablet_manager.cc:1397] T 6fc48d6a702b4e41b98fd6b6406756ea P d01930ef1a8847ce986d5c9895b2294c: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260808 04:40:43.956348 29913 tablet_bootstrap.cc:492] T 6fc48d6a702b4e41b98fd6b6406756ea P 0c816c768f7b4dc5ae2082e195d3e681: Bootstrap starting.
I20260808 04:40:43.956252 29915 raft_consensus.cc:348] T 6fc48d6a702b4e41b98fd6b6406756ea P d01930ef1a8847ce986d5c9895b2294c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae908af2388f439fac792d86667e0b59" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 37241 } } peers { permanent_uuid: "0c816c768f7b4dc5ae2082e195d3e681" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 45349 } } peers { permanent_uuid: "d01930ef1a8847ce986d5c9895b2294c" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 40113 } }
I20260808 04:40:43.956401 29915 raft_consensus.cc:374] T 6fc48d6a702b4e41b98fd6b6406756ea P d01930ef1a8847ce986d5c9895b2294c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:40:43.956440 29915 raft_consensus.cc:729] T 6fc48d6a702b4e41b98fd6b6406756ea P d01930ef1a8847ce986d5c9895b2294c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d01930ef1a8847ce986d5c9895b2294c, State: Initialized, Role: FOLLOWER
I20260808 04:40:43.956568 29915 consensus_queue.cc:260] T 6fc48d6a702b4e41b98fd6b6406756ea P d01930ef1a8847ce986d5c9895b2294c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae908af2388f439fac792d86667e0b59" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 37241 } } peers { permanent_uuid: "0c816c768f7b4dc5ae2082e195d3e681" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 45349 } } peers { permanent_uuid: "d01930ef1a8847ce986d5c9895b2294c" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 40113 } }
I20260808 04:40:43.956843 29915 ts_tablet_manager.cc:1428] T 6fc48d6a702b4e41b98fd6b6406756ea P d01930ef1a8847ce986d5c9895b2294c: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260808 04:40:43.957195 29913 tablet_bootstrap.cc:654] T 6fc48d6a702b4e41b98fd6b6406756ea P 0c816c768f7b4dc5ae2082e195d3e681: Neither blocks nor log segments found. Creating new log.
I20260808 04:40:43.959687 29913 tablet_bootstrap.cc:492] T 6fc48d6a702b4e41b98fd6b6406756ea P 0c816c768f7b4dc5ae2082e195d3e681: No bootstrap required, opened a new log
I20260808 04:40:43.959801 29913 ts_tablet_manager.cc:1397] T 6fc48d6a702b4e41b98fd6b6406756ea P 0c816c768f7b4dc5ae2082e195d3e681: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260808 04:40:43.960207 29913 raft_consensus.cc:348] T 6fc48d6a702b4e41b98fd6b6406756ea P 0c816c768f7b4dc5ae2082e195d3e681 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae908af2388f439fac792d86667e0b59" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 37241 } } peers { permanent_uuid: "0c816c768f7b4dc5ae2082e195d3e681" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 45349 } } peers { permanent_uuid: "d01930ef1a8847ce986d5c9895b2294c" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 40113 } }
I20260808 04:40:43.960345 29913 raft_consensus.cc:374] T 6fc48d6a702b4e41b98fd6b6406756ea P 0c816c768f7b4dc5ae2082e195d3e681 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:40:43.960378 29913 raft_consensus.cc:729] T 6fc48d6a702b4e41b98fd6b6406756ea P 0c816c768f7b4dc5ae2082e195d3e681 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c816c768f7b4dc5ae2082e195d3e681, State: Initialized, Role: FOLLOWER
I20260808 04:40:43.960494 29913 consensus_queue.cc:260] T 6fc48d6a702b4e41b98fd6b6406756ea P 0c816c768f7b4dc5ae2082e195d3e681 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae908af2388f439fac792d86667e0b59" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 37241 } } peers { permanent_uuid: "0c816c768f7b4dc5ae2082e195d3e681" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 45349 } } peers { permanent_uuid: "d01930ef1a8847ce986d5c9895b2294c" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 40113 } }
I20260808 04:40:43.960739 29913 ts_tablet_manager.cc:1428] T 6fc48d6a702b4e41b98fd6b6406756ea P 0c816c768f7b4dc5ae2082e195d3e681: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260808 04:40:43.962054 29914 tablet_bootstrap.cc:492] T 6fc48d6a702b4e41b98fd6b6406756ea P ae908af2388f439fac792d86667e0b59: No bootstrap required, opened a new log
I20260808 04:40:43.962162 29914 ts_tablet_manager.cc:1397] T 6fc48d6a702b4e41b98fd6b6406756ea P ae908af2388f439fac792d86667e0b59: Time spent bootstrapping tablet: real 0.010s user 0.000s sys 0.002s
I20260808 04:40:43.962674 29914 raft_consensus.cc:348] T 6fc48d6a702b4e41b98fd6b6406756ea P ae908af2388f439fac792d86667e0b59 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae908af2388f439fac792d86667e0b59" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 37241 } } peers { permanent_uuid: "0c816c768f7b4dc5ae2082e195d3e681" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 45349 } } peers { permanent_uuid: "d01930ef1a8847ce986d5c9895b2294c" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 40113 } }
I20260808 04:40:43.962801 29914 raft_consensus.cc:374] T 6fc48d6a702b4e41b98fd6b6406756ea P ae908af2388f439fac792d86667e0b59 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:40:43.962837 29914 raft_consensus.cc:729] T 6fc48d6a702b4e41b98fd6b6406756ea P ae908af2388f439fac792d86667e0b59 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae908af2388f439fac792d86667e0b59, State: Initialized, Role: FOLLOWER
I20260808 04:40:43.962975 29914 consensus_queue.cc:260] T 6fc48d6a702b4e41b98fd6b6406756ea P ae908af2388f439fac792d86667e0b59 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae908af2388f439fac792d86667e0b59" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 37241 } } peers { permanent_uuid: "0c816c768f7b4dc5ae2082e195d3e681" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 45349 } } peers { permanent_uuid: "d01930ef1a8847ce986d5c9895b2294c" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 40113 } }
I20260808 04:40:43.963269 29914 ts_tablet_manager.cc:1428] T 6fc48d6a702b4e41b98fd6b6406756ea P ae908af2388f439fac792d86667e0b59: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260808 04:40:44.110272 29920 raft_consensus.cc:482] T 6fc48d6a702b4e41b98fd6b6406756ea P 0c816c768f7b4dc5ae2082e195d3e681 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 04:40:44.110459 29920 raft_consensus.cc:504] T 6fc48d6a702b4e41b98fd6b6406756ea P 0c816c768f7b4dc5ae2082e195d3e681 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae908af2388f439fac792d86667e0b59" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 37241 } } peers { permanent_uuid: "0c816c768f7b4dc5ae2082e195d3e681" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 45349 } } peers { permanent_uuid: "d01930ef1a8847ce986d5c9895b2294c" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 40113 } }
I20260808 04:40:44.110971 29920 leader_election.cc:288] T 6fc48d6a702b4e41b98fd6b6406756ea P 0c816c768f7b4dc5ae2082e195d3e681 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae908af2388f439fac792d86667e0b59 (127.20.240.193:37241), d01930ef1a8847ce986d5c9895b2294c (127.20.240.195:40113)
I20260808 04:40:44.111649 29835 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6fc48d6a702b4e41b98fd6b6406756ea" candidate_uuid: "0c816c768f7b4dc5ae2082e195d3e681" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d01930ef1a8847ce986d5c9895b2294c" is_pre_election: true
I20260808 04:40:44.111649 29536 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6fc48d6a702b4e41b98fd6b6406756ea" candidate_uuid: "0c816c768f7b4dc5ae2082e195d3e681" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae908af2388f439fac792d86667e0b59" is_pre_election: true
I20260808 04:40:44.111901 29835 raft_consensus.cc:2454] T 6fc48d6a702b4e41b98fd6b6406756ea P d01930ef1a8847ce986d5c9895b2294c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c816c768f7b4dc5ae2082e195d3e681 in term 0.
I20260808 04:40:44.111868 29536 raft_consensus.cc:2454] T 6fc48d6a702b4e41b98fd6b6406756ea P ae908af2388f439fac792d86667e0b59 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c816c768f7b4dc5ae2082e195d3e681 in term 0.
I20260808 04:40:44.112351 29613 leader_election.cc:302] T 6fc48d6a702b4e41b98fd6b6406756ea P 0c816c768f7b4dc5ae2082e195d3e681 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c816c768f7b4dc5ae2082e195d3e681, ae908af2388f439fac792d86667e0b59; no voters:
I20260808 04:40:44.112543 29920 raft_consensus.cc:2781] T 6fc48d6a702b4e41b98fd6b6406756ea P 0c816c768f7b4dc5ae2082e195d3e681 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 04:40:44.112609 29920 raft_consensus.cc:482] T 6fc48d6a702b4e41b98fd6b6406756ea P 0c816c768f7b4dc5ae2082e195d3e681 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 04:40:44.112650 29920 raft_consensus.cc:3037] T 6fc48d6a702b4e41b98fd6b6406756ea P 0c816c768f7b4dc5ae2082e195d3e681 [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:40:44.113741 29920 raft_consensus.cc:504] T 6fc48d6a702b4e41b98fd6b6406756ea P 0c816c768f7b4dc5ae2082e195d3e681 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae908af2388f439fac792d86667e0b59" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 37241 } } peers { permanent_uuid: "0c816c768f7b4dc5ae2082e195d3e681" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 45349 } } peers { permanent_uuid: "d01930ef1a8847ce986d5c9895b2294c" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 40113 } }
I20260808 04:40:44.114096 29920 leader_election.cc:288] T 6fc48d6a702b4e41b98fd6b6406756ea P 0c816c768f7b4dc5ae2082e195d3e681 [CANDIDATE]: Term 1 election: Requested vote from peers ae908af2388f439fac792d86667e0b59 (127.20.240.193:37241), d01930ef1a8847ce986d5c9895b2294c (127.20.240.195:40113)
I20260808 04:40:44.114513 29835 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6fc48d6a702b4e41b98fd6b6406756ea" candidate_uuid: "0c816c768f7b4dc5ae2082e195d3e681" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d01930ef1a8847ce986d5c9895b2294c"
I20260808 04:40:44.114565 29536 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6fc48d6a702b4e41b98fd6b6406756ea" candidate_uuid: "0c816c768f7b4dc5ae2082e195d3e681" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae908af2388f439fac792d86667e0b59"
I20260808 04:40:44.114674 29835 raft_consensus.cc:3037] T 6fc48d6a702b4e41b98fd6b6406756ea P d01930ef1a8847ce986d5c9895b2294c [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:40:44.114754 29536 raft_consensus.cc:3037] T 6fc48d6a702b4e41b98fd6b6406756ea P ae908af2388f439fac792d86667e0b59 [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:40:44.115748 29835 raft_consensus.cc:2454] T 6fc48d6a702b4e41b98fd6b6406756ea P d01930ef1a8847ce986d5c9895b2294c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c816c768f7b4dc5ae2082e195d3e681 in term 1.
I20260808 04:40:44.116101 29536 raft_consensus.cc:2454] T 6fc48d6a702b4e41b98fd6b6406756ea P ae908af2388f439fac792d86667e0b59 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c816c768f7b4dc5ae2082e195d3e681 in term 1.
I20260808 04:40:44.116153 29613 leader_election.cc:302] T 6fc48d6a702b4e41b98fd6b6406756ea P 0c816c768f7b4dc5ae2082e195d3e681 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c816c768f7b4dc5ae2082e195d3e681, d01930ef1a8847ce986d5c9895b2294c; no voters:
I20260808 04:40:44.116415 29920 raft_consensus.cc:2781] T 6fc48d6a702b4e41b98fd6b6406756ea P 0c816c768f7b4dc5ae2082e195d3e681 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 04:40:44.116539 29920 raft_consensus.cc:686] T 6fc48d6a702b4e41b98fd6b6406756ea P 0c816c768f7b4dc5ae2082e195d3e681 [term 1 LEADER]: Becoming Leader. State: Replica: 0c816c768f7b4dc5ae2082e195d3e681, State: Running, Role: LEADER
I20260808 04:40:44.116683 29920 consensus_queue.cc:237] T 6fc48d6a702b4e41b98fd6b6406756ea P 0c816c768f7b4dc5ae2082e195d3e681 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae908af2388f439fac792d86667e0b59" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 37241 } } peers { permanent_uuid: "0c816c768f7b4dc5ae2082e195d3e681" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 45349 } } peers { permanent_uuid: "d01930ef1a8847ce986d5c9895b2294c" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 40113 } }
I20260808 04:40:44.118649 29371 catalog_manager.cc:5495] T 6fc48d6a702b4e41b98fd6b6406756ea P 0c816c768f7b4dc5ae2082e195d3e681 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0c816c768f7b4dc5ae2082e195d3e681 (127.20.240.194). New cstate: current_term: 1 leader_uuid: "0c816c768f7b4dc5ae2082e195d3e681" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae908af2388f439fac792d86667e0b59" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 37241 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c816c768f7b4dc5ae2082e195d3e681" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 45349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d01930ef1a8847ce986d5c9895b2294c" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 40113 } health_report { overall_health: UNKNOWN } } }
I20260808 04:40:44.172487 29908 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:44.169493 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.240.194:39325 (local address 127.20.240.194:45349)
0808 04:40:44.169588 (+ 95us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:44.169592 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:44.169606 (+ 14us) server_negotiation.cc:407] Connection header received
0808 04:40:44.169710 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:44.169713 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:44.169757 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:44.169837 (+ 80us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 04:40:44.170062 (+ 225us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:44.170560 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:44.171402 (+ 842us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:44.171645 (+ 243us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:44.171761 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:44.172030 (+ 269us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 04:40:44.172115 (+ 85us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 04:40:44.172190 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:44.172281 (+ 91us) server_negotiation.cc:299] Negotiation successful
0808 04:40:44.172328 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":58,"server-negotiator.queue_time_us":32}
I20260808 04:40:44.172487 29985 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:44.169358 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.194:45349 (local address 127.20.240.194:39325)
0808 04:40:44.169513 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:44.169530 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:44.169628 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:44.169845 (+ 217us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:44.169848 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:44.169854 (+ 6us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 04:40:44.169980 (+ 126us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:44.169987 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:44.170680 (+ 693us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:44.170683 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:44.171268 (+ 585us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:44.171276 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:44.171760 (+ 484us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:44.171764 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:44.171874 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:44.171902 (+ 28us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 04:40:44.172204 (+ 302us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 04:40:44.172213 (+ 9us) client_negotiation.cc:769] Sending connection context
0808 04:40:44.172274 (+ 61us) client_negotiation.cc:240] Negotiation successful
0808 04:40:44.172363 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":54,"mutex_wait_us":4}
I20260808 04:40:44.178793 29835 raft_consensus.cc:1261] T 6fc48d6a702b4e41b98fd6b6406756ea P d01930ef1a8847ce986d5c9895b2294c [term 1 FOLLOWER]: Refusing update from remote peer 0c816c768f7b4dc5ae2082e195d3e681: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 04:40:44.178846 29536 raft_consensus.cc:1261] T 6fc48d6a702b4e41b98fd6b6406756ea P ae908af2388f439fac792d86667e0b59 [term 1 FOLLOWER]: Refusing update from remote peer 0c816c768f7b4dc5ae2082e195d3e681: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 04:40:44.179289 29981 consensus_queue.cc:1035] T 6fc48d6a702b4e41b98fd6b6406756ea P 0c816c768f7b4dc5ae2082e195d3e681 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d01930ef1a8847ce986d5c9895b2294c" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 40113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 04:40:44.179454 29961 consensus_queue.cc:1035] T 6fc48d6a702b4e41b98fd6b6406756ea P 0c816c768f7b4dc5ae2082e195d3e681 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae908af2388f439fac792d86667e0b59" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 37241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 04:40:44.211124 29371 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37588:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 04:40:44.211282 29371 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37588:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 04:40:44.213479 29371 catalog_manager.cc:5782] T 00000000000000000000000000000000 P fc87c6b2494c4b6c8b57e3923aab1f25: Sending DeleteTablet for 3 replicas of tablet 6fc48d6a702b4e41b98fd6b6406756ea
I20260808 04:40:44.214112 29663 tablet_service.cc:1514] Processing DeleteTablet for tablet 6fc48d6a702b4e41b98fd6b6406756ea with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 04:40:44 UTC) from {username='oryx', principal='oryx/127.20.240.254@KRBTEST.COM'} at 127.0.0.1:33970
I20260808 04:40:44.214114 29514 tablet_service.cc:1514] Processing DeleteTablet for tablet 6fc48d6a702b4e41b98fd6b6406756ea with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 04:40:44 UTC) from {username='oryx', principal='oryx/127.20.240.254@KRBTEST.COM'} at 127.0.0.1:45532
I20260808 04:40:44.214311 29992 tablet_replica.cc:330] T 6fc48d6a702b4e41b98fd6b6406756ea P 0c816c768f7b4dc5ae2082e195d3e681: stopping tablet replica
I20260808 04:40:44.214354 29812 tablet_service.cc:1514] Processing DeleteTablet for tablet 6fc48d6a702b4e41b98fd6b6406756ea with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 04:40:44 UTC) from {username='oryx', principal='oryx/127.20.240.254@KRBTEST.COM'} at 127.0.0.1:58468
I20260808 04:40:44.214443 29992 raft_consensus.cc:2229] T 6fc48d6a702b4e41b98fd6b6406756ea P 0c816c768f7b4dc5ae2082e195d3e681 [term 1 LEADER]: Raft consensus shutting down.
I20260808 04:40:44.214563 29991 tablet_replica.cc:330] T 6fc48d6a702b4e41b98fd6b6406756ea P ae908af2388f439fac792d86667e0b59: stopping tablet replica
I20260808 04:40:44.214663 29992 raft_consensus.cc:2258] T 6fc48d6a702b4e41b98fd6b6406756ea P 0c816c768f7b4dc5ae2082e195d3e681 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 04:40:44.214722 29991 raft_consensus.cc:2229] T 6fc48d6a702b4e41b98fd6b6406756ea P ae908af2388f439fac792d86667e0b59 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 04:40:44.214855 29991 raft_consensus.cc:2258] T 6fc48d6a702b4e41b98fd6b6406756ea P ae908af2388f439fac792d86667e0b59 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 04:40:44.215090 29990 tablet_replica.cc:330] T 6fc48d6a702b4e41b98fd6b6406756ea P d01930ef1a8847ce986d5c9895b2294c: stopping tablet replica
I20260808 04:40:44.215230 29990 raft_consensus.cc:2229] T 6fc48d6a702b4e41b98fd6b6406756ea P d01930ef1a8847ce986d5c9895b2294c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 04:40:44.215369 29990 raft_consensus.cc:2258] T 6fc48d6a702b4e41b98fd6b6406756ea P d01930ef1a8847ce986d5c9895b2294c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 04:40:44.215596 29992 ts_tablet_manager.cc:1905] T 6fc48d6a702b4e41b98fd6b6406756ea P 0c816c768f7b4dc5ae2082e195d3e681: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 04:40:44.215678 21443 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu with pid 29446
I20260808 04:40:44.218891 29992 ts_tablet_manager.cc:1918] T 6fc48d6a702b4e41b98fd6b6406756ea P 0c816c768f7b4dc5ae2082e195d3e681: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 04:40:44.218967 29992 log.cc:1196] T 6fc48d6a702b4e41b98fd6b6406756ea P 0c816c768f7b4dc5ae2082e195d3e681: Deleting WAL directory at /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786164000593138-21443-0/minicluster-data/ts-1/wal/wals/6fc48d6a702b4e41b98fd6b6406756ea
I20260808 04:40:44.219238 29992 ts_tablet_manager.cc:1939] T 6fc48d6a702b4e41b98fd6b6406756ea P 0c816c768f7b4dc5ae2082e195d3e681: Deleting consensus metadata
I20260808 04:40:44.220013 29356 catalog_manager.cc:4841] TS 0c816c768f7b4dc5ae2082e195d3e681 (127.20.240.194:45349): tablet 6fc48d6a702b4e41b98fd6b6406756ea (table test-table [id=a677aa1421df41febe5683f0105475e9]) successfully deleted
I20260808 04:40:44.221729 29990 ts_tablet_manager.cc:1905] T 6fc48d6a702b4e41b98fd6b6406756ea P d01930ef1a8847ce986d5c9895b2294c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 04:40:44.223879 29990 ts_tablet_manager.cc:1918] T 6fc48d6a702b4e41b98fd6b6406756ea P d01930ef1a8847ce986d5c9895b2294c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 04:40:44.223956 29990 log.cc:1196] T 6fc48d6a702b4e41b98fd6b6406756ea P d01930ef1a8847ce986d5c9895b2294c: Deleting WAL directory at /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786164000593138-21443-0/minicluster-data/ts-2/wal/wals/6fc48d6a702b4e41b98fd6b6406756ea
I20260808 04:40:44.224207 29990 ts_tablet_manager.cc:1939] T 6fc48d6a702b4e41b98fd6b6406756ea P d01930ef1a8847ce986d5c9895b2294c: Deleting consensus metadata
I20260808 04:40:44.225371 29356 catalog_manager.cc:4841] TS d01930ef1a8847ce986d5c9895b2294c (127.20.240.195:40113): tablet 6fc48d6a702b4e41b98fd6b6406756ea (table test-table [id=a677aa1421df41febe5683f0105475e9]) successfully deleted
W20260808 04:40:44.225694 29356 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.20.240.193:37241 (error 108)
I20260808 04:40:44.225872 21443 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu with pid 29595
I20260808 04:40:44.229380 30021 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:44.228762 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.193:37241 (local address 127.0.0.1:45548)
0808 04:40:44.229091 (+ 329us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:44.229235 (+ 144us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.240.193:37241: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":242,"thread_start_us":146,"threads_started":1}
W20260808 04:40:44.229616 29356 catalog_manager.cc:4584] TS ae908af2388f439fac792d86667e0b59 (127.20.240.193:37241): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 6fc48d6a702b4e41b98fd6b6406756ea: Network error: Client connection negotiation failed: client connection to 127.20.240.193:37241: connect: Connection refused (error 111)
I20260808 04:40:44.235833 21443 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu with pid 29744
I20260808 04:40:44.244688 21443 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu with pid 29338
2026-08-08T04:40:44Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipal (3629 ms)
[ RUN ] SecurityITest.TestNonExistentPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786164000593138-21443-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 04:40:44 dist-test-slave-vxj2 krb5kdc[30024](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 04:40:44 dist-test-slave-vxj2 krb5kdc[30024](info): set up 2 sockets
Aug 08 04:40:44 dist-test-slave-vxj2 krb5kdc[30024](info): commencing operation
krb5kdc: starting...
W20260808 04:40:45.349675 21443 mini_kdc.cc:121] Time spent starting KDC: real 1.079s user 0.005s sys 0.002s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786164000593138-21443-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786164000593138-21443-0/krb5kdc/test-user.keytab.
Aug 08 04:40:45 dist-test-slave-vxj2 krb5kdc[30024](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164045, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T04:40:45Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T04:40:45Z Disabled control of system clock
WARNING: no policy specified for kudu/127.20.240.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.240.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.240.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.254.keytab.
Entry for principal kudu/127.20.240.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.254.keytab.
I20260808 04:40:45.488268 21443 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
/tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786164000593138-21443-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786164000593138-21443-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786164000593138-21443-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786164000593138-21443-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.240.254:44617
--webserver_interface=127.20.240.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.254.keytab
--principal=kudu/127.20.240.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.240.212:40641
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.240.254:44617
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--principal=oryx with env {KRB5CCNAME=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786164000593138-21443-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786164000593138-21443-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786164000593138-21443-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 04:40:45.604578 30037 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:40:45.604874 30037 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:40:45.604918 30037 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:40:45.608963 30037 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 04:40:45.609045 30037 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:40:45.609066 30037 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:40:45.609082 30037 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 04:40:45.609098 30037 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 04:40:45.614764 30037 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.240.212:40641
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786164000593138-21443-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786164000593138-21443-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.240.254:44617
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.254.keytab
--principal=oryx
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.240.254:44617
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786164000593138-21443-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.240.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30037
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786164000593138-21443-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 04:05:18 UTC on ccycloud.quasar-drfdgt.root.comops.site
build id 4574101
I20260808 04:40:45.616030 30037 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:40:45.617043 30037 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:40:45.625999 30045 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:40:45.626053 30043 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:40:45.626147 30037 server_base.cc:1034] running on GCE node
W20260808 04:40:45.625999 30042 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:40:45.626945 30037 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:40:45.628070 30037 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:40:45.629228 30037 hybrid_clock.cc:648] HybridClock initialized: now 1786164045629205 us; error 37 us; skew 500 ppm
Runtime error: kinit failed: unable to login from keytab: Keytab contains no suitable keys for oryx@KRBTEST.COM
2026-08-08T04:40:45Z chronyd exiting
[ OK ] SecurityITest.TestNonExistentPrincipal (1388 ms)
[ RUN ] SecurityITest.TestMismatchingPrincipals
Loading random data
Initializing database '/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164000593138-21443-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 04:40:45 dist-test-slave-vxj2 krb5kdc[30050](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 04:40:45 dist-test-slave-vxj2 krb5kdc[30050](info): set up 2 sockets
Aug 08 04:40:45 dist-test-slave-vxj2 krb5kdc[30050](info): commencing operation
krb5kdc: starting...
W20260808 04:40:46.740401 21443 mini_kdc.cc:121] Time spent starting KDC: real 1.081s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164000593138-21443-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164000593138-21443-0/krb5kdc/test-user.keytab.
Aug 08 04:40:46 dist-test-slave-vxj2 krb5kdc[30050](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164046, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T04:40:46Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T04:40:46Z Disabled control of system clock
WARNING: no policy specified for kudu/127.20.240.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.240.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.240.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.254.keytab.
Entry for principal kudu/127.20.240.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.254.keytab.
I20260808 04:40:46.877307 21443 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
/tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164000593138-21443-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164000593138-21443-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164000593138-21443-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164000593138-21443-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.240.254:35557
--webserver_interface=127.20.240.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.254.keytab
--principal=kudu/127.20.240.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.240.212:39979
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.240.254:35557
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164000593138-21443-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164000593138-21443-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164000593138-21443-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 04:40:46.991349 30065 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:40:46.991657 30065 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:40:46.991701 30065 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:40:46.996013 30065 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 04:40:46.996093 30065 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:40:46.996114 30065 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:40:46.996131 30065 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 04:40:46.996146 30065 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 04:40:47.001747 30065 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.240.212:39979
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164000593138-21443-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164000593138-21443-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.240.254:35557
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.254.keytab
--principal=kudu/127.20.240.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.240.254:35557
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164000593138-21443-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.240.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30065
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164000593138-21443-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 04:05:18 UTC on ccycloud.quasar-drfdgt.root.comops.site
build id 4574101
I20260808 04:40:47.002950 30065 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:40:47.004081 30065 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260808 04:40:47.012972 30065 server_base.cc:1034] running on GCE node
W20260808 04:40:47.012924 30071 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:40:47.012931 30070 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:40:47.012928 30073 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:40:47.013882 30065 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:40:47.015074 30065 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:40:47.016252 30065 hybrid_clock.cc:648] HybridClock initialized: now 1786164047016225 us; error 42 us; skew 500 ppm
Aug 08 04:40:47 dist-test-slave-vxj2 krb5kdc[30050](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164047, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.240.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:40:47.019130 30065 init.cc:377] Logged in from keytab as kudu/127.20.240.254@KRBTEST.COM (short username kudu)
I20260808 04:40:47.020145 30065 webserver.cc:460] Webserver started at http://127.20.240.254:44597/ using document root <none> and password file <none>
I20260808 04:40:47.020750 30065 fs_manager.cc:359] Metadata directory not provided
I20260808 04:40:47.020818 30065 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:40:47.021049 30065 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 04:40:47.023238 30065 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164000593138-21443-0/minicluster-data/master-0/data/instance:
uuid: "b3376cd20837427eb9f02068281f1c47"
format_stamp: "Formatted at 2026-08-08 04:40:47 on dist-test-slave-vxj2"
server_key: "395fed731074538da09a1823b849edfe"
server_key_iv: "cb7db6039f4f8f8ebda7c40634d8baa3"
server_key_version: "encryptionkey@0"
I20260808 04:40:47.023867 30065 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164000593138-21443-0/minicluster-data/master-0/wal/instance:
uuid: "b3376cd20837427eb9f02068281f1c47"
format_stamp: "Formatted at 2026-08-08 04:40:47 on dist-test-slave-vxj2"
server_key: "395fed731074538da09a1823b849edfe"
server_key_iv: "cb7db6039f4f8f8ebda7c40634d8baa3"
server_key_version: "encryptionkey@0"
I20260808 04:40:47.027849 30065 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.004s
I20260808 04:40:47.030507 30080 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:47.031876 30065 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260808 04:40:47.032050 30065 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164000593138-21443-0/minicluster-data/master-0/data,/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164000593138-21443-0/minicluster-data/master-0/wal
uuid: "b3376cd20837427eb9f02068281f1c47"
format_stamp: "Formatted at 2026-08-08 04:40:47 on dist-test-slave-vxj2"
server_key: "395fed731074538da09a1823b849edfe"
server_key_iv: "cb7db6039f4f8f8ebda7c40634d8baa3"
server_key_version: "encryptionkey@0"
I20260808 04:40:47.032178 30065 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164000593138-21443-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164000593138-21443-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164000593138-21443-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:40:47.047317 30065 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:40:47.051047 30065 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:40:47.051296 30065 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:40:47.058866 30065 rpc_server.cc:307] RPC server started. Bound to: 127.20.240.254:35557
I20260808 04:40:47.058948 30136 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.240.254:35557 every 8 connection(s)
I20260808 04:40:47.059998 30065 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164000593138-21443-0/minicluster-data/master-0/data/info.pb
I20260808 04:40:47.063035 30137 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:40:47.064553 21443 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu as pid 30065
I20260808 04:40:47.064697 21443 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164000593138-21443-0/minicluster-data/master-0/wal/instance
I20260808 04:40:47.065042 21443 external_mini_cluster.cc:1428] Setting key 1375c7593a5e79a78ab032099263c7d4
I20260808 04:40:47.070538 30137 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b3376cd20837427eb9f02068281f1c47: Bootstrap starting.
I20260808 04:40:47.073376 30137 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b3376cd20837427eb9f02068281f1c47: Neither blocks nor log segments found. Creating new log.
I20260808 04:40:47.074424 30137 log.cc:824] T 00000000000000000000000000000000 P b3376cd20837427eb9f02068281f1c47: Log is configured to *not* fsync() on all Append() calls
Aug 08 04:40:47 dist-test-slave-vxj2 krb5kdc[30050](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164046, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.240.254@KRBTEST.COM
I20260808 04:40:47.077244 30137 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b3376cd20837427eb9f02068281f1c47: No bootstrap required, opened a new log
I20260808 04:40:47.080999 30137 raft_consensus.cc:348] T 00000000000000000000000000000000 P b3376cd20837427eb9f02068281f1c47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b3376cd20837427eb9f02068281f1c47" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 35557 } }
I20260808 04:40:47.081333 30137 raft_consensus.cc:374] T 00000000000000000000000000000000 P b3376cd20837427eb9f02068281f1c47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:40:47.081408 30137 raft_consensus.cc:729] T 00000000000000000000000000000000 P b3376cd20837427eb9f02068281f1c47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3376cd20837427eb9f02068281f1c47, State: Initialized, Role: FOLLOWER
I20260808 04:40:47.081478 30140 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:47.066580 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56310 (local address 127.20.240.254:35557)
0808 04:40:47.067047 (+ 467us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:47.067068 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:47.067114 (+ 46us) server_negotiation.cc:407] Connection header received
0808 04:40:47.067965 (+ 851us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:47.067989 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:47.068446 (+ 457us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:47.068830 (+ 384us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:47.069661 (+ 831us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:47.071090 (+ 1429us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:47.071966 (+ 876us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:47.072663 (+ 697us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:47.072834 (+ 171us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:47.076087 (+ 3253us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:40:47.076093 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:40:47.076112 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:40:47.076145 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:40:47.078302 (+ 2157us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:47.078828 (+ 526us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:47.078834 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:47.078839 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:47.078960 (+ 121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:47.079287 (+ 327us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:47.079291 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:47.079296 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:47.079722 (+ 426us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:40:47.079965 (+ 243us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:47.080243 (+ 278us) server_negotiation.cc:299] Negotiation successful
0808 04:40:47.080558 (+ 315us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":310,"thread_start_us":128,"threads_started":1}
I20260808 04:40:47.081954 30137 consensus_queue.cc:260] T 00000000000000000000000000000000 P b3376cd20837427eb9f02068281f1c47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b3376cd20837427eb9f02068281f1c47" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 35557 } }
I20260808 04:40:47.082125 30137 raft_consensus.cc:388] T 00000000000000000000000000000000 P b3376cd20837427eb9f02068281f1c47 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 04:40:47.082194 30137 raft_consensus.cc:482] T 00000000000000000000000000000000 P b3376cd20837427eb9f02068281f1c47 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 04:40:47.082288 30137 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b3376cd20837427eb9f02068281f1c47 [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:40:47.083330 30137 raft_consensus.cc:504] T 00000000000000000000000000000000 P b3376cd20837427eb9f02068281f1c47 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b3376cd20837427eb9f02068281f1c47" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 35557 } }
I20260808 04:40:47.083707 30137 leader_election.cc:302] T 00000000000000000000000000000000 P b3376cd20837427eb9f02068281f1c47 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b3376cd20837427eb9f02068281f1c47; no voters:
I20260808 04:40:47.084123 30137 leader_election.cc:288] T 00000000000000000000000000000000 P b3376cd20837427eb9f02068281f1c47 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 04:40:47.084241 30142 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b3376cd20837427eb9f02068281f1c47 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 04:40:47.084527 30142 raft_consensus.cc:686] T 00000000000000000000000000000000 P b3376cd20837427eb9f02068281f1c47 [term 1 LEADER]: Becoming Leader. State: Replica: b3376cd20837427eb9f02068281f1c47, State: Running, Role: LEADER
I20260808 04:40:47.084880 30142 consensus_queue.cc:237] T 00000000000000000000000000000000 P b3376cd20837427eb9f02068281f1c47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b3376cd20837427eb9f02068281f1c47" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 35557 } }
I20260808 04:40:47.085456 30137 sys_catalog.cc:564] T 00000000000000000000000000000000 P b3376cd20837427eb9f02068281f1c47 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 04:40:47.086730 30144 sys_catalog.cc:455] T 00000000000000000000000000000000 P b3376cd20837427eb9f02068281f1c47 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b3376cd20837427eb9f02068281f1c47. Latest consensus state: current_term: 1 leader_uuid: "b3376cd20837427eb9f02068281f1c47" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b3376cd20837427eb9f02068281f1c47" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 35557 } } }
I20260808 04:40:47.086724 30143 sys_catalog.cc:455] T 00000000000000000000000000000000 P b3376cd20837427eb9f02068281f1c47 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b3376cd20837427eb9f02068281f1c47" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b3376cd20837427eb9f02068281f1c47" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 35557 } } }
I20260808 04:40:47.086884 30144 sys_catalog.cc:458] T 00000000000000000000000000000000 P b3376cd20837427eb9f02068281f1c47 [sys.catalog]: This master's current role is: LEADER
I20260808 04:40:47.086884 30143 sys_catalog.cc:458] T 00000000000000000000000000000000 P b3376cd20837427eb9f02068281f1c47 [sys.catalog]: This master's current role is: LEADER
I20260808 04:40:47.087319 30153 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 04:40:47.090655 30153 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 04:40:47.097344 30153 catalog_manager.cc:1347] Generated new cluster ID: 71a48c1528364cc48a49c6d3bb01b7ae
I20260808 04:40:47.097445 30153 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 04:40:47.104934 30153 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 04:40:47.105994 30153 catalog_manager.cc:1504] Loading token signing keys...
I20260808 04:40:47.117440 30153 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b3376cd20837427eb9f02068281f1c47: Generated new TSK 0
I20260808 04:40:47.118237 30153 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.20.240.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.240.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.240.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.193.keytab.
Entry for principal kudu/127.20.240.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.193.keytab.
I20260808 04:40:47.154603 21443 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
/tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164000593138-21443-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164000593138-21443-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164000593138-21443-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164000593138-21443-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.240.193:0
--local_ip_for_outbound_sockets=127.20.240.193
--webserver_interface=127.20.240.193
--webserver_port=0
--tserver_master_addrs=127.20.240.254:35557
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.193.keytab
--principal=kudu/127.20.240.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.240.212:39979
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164000593138-21443-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164000593138-21443-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164000593138-21443-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 04:40:47.278147 30165 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:40:47.278501 30165 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:40:47.278584 30165 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:40:47.282944 30165 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:40:47.283053 30165 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:40:47.283152 30165 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.240.193
I20260808 04:40:47.289108 30165 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.240.212:39979
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164000593138-21443-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164000593138-21443-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.193.keytab
--principal=kudu/127.20.240.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.240.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164000593138-21443-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.240.193
--webserver_port=0
--tserver_master_addrs=127.20.240.254:35557
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30165
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.240.193
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164000593138-21443-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 04:05:18 UTC on ccycloud.quasar-drfdgt.root.comops.site
build id 4574101
I20260808 04:40:47.290361 30165 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:40:47.291412 30165 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260808 04:40:47.301299 30165 server_base.cc:1034] running on GCE node
W20260808 04:40:47.301260 30171 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:40:47.301261 30173 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:40:47.301261 30170 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:40:47.302073 30165 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:40:47.302781 30165 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:40:47.303987 30165 hybrid_clock.cc:648] HybridClock initialized: now 1786164047303959 us; error 40 us; skew 500 ppm
Aug 08 04:40:47 dist-test-slave-vxj2 krb5kdc[30050](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164047, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.240.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:40:47.307111 30165 init.cc:377] Logged in from keytab as kudu/127.20.240.193@KRBTEST.COM (short username kudu)
I20260808 04:40:47.308104 30165 webserver.cc:460] Webserver started at http://127.20.240.193:42511/ using document root <none> and password file <none>
I20260808 04:40:47.308693 30165 fs_manager.cc:359] Metadata directory not provided
I20260808 04:40:47.308789 30165 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:40:47.309041 30165 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 04:40:47.311195 30165 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164000593138-21443-0/minicluster-data/ts-0/data/instance:
uuid: "2f37d9c2d426430290a3eeeb8fdb5021"
format_stamp: "Formatted at 2026-08-08 04:40:47 on dist-test-slave-vxj2"
server_key: "3e83707f6eed11ec536b73f0b7f4e663"
server_key_iv: "5faca8813ec2c0ed76cc89564660e8d4"
server_key_version: "encryptionkey@0"
I20260808 04:40:47.311769 30165 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164000593138-21443-0/minicluster-data/ts-0/wal/instance:
uuid: "2f37d9c2d426430290a3eeeb8fdb5021"
format_stamp: "Formatted at 2026-08-08 04:40:47 on dist-test-slave-vxj2"
server_key: "3e83707f6eed11ec536b73f0b7f4e663"
server_key_iv: "5faca8813ec2c0ed76cc89564660e8d4"
server_key_version: "encryptionkey@0"
I20260808 04:40:47.315786 30165 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260808 04:40:47.318466 30180 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:47.319785 30165 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260808 04:40:47.319983 30165 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164000593138-21443-0/minicluster-data/ts-0/data,/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164000593138-21443-0/minicluster-data/ts-0/wal
uuid: "2f37d9c2d426430290a3eeeb8fdb5021"
format_stamp: "Formatted at 2026-08-08 04:40:47 on dist-test-slave-vxj2"
server_key: "3e83707f6eed11ec536b73f0b7f4e663"
server_key_iv: "5faca8813ec2c0ed76cc89564660e8d4"
server_key_version: "encryptionkey@0"
I20260808 04:40:47.320114 30165 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164000593138-21443-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164000593138-21443-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164000593138-21443-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:40:47.349619 30165 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:40:47.353366 30165 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:40:47.353595 30165 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:40:47.354265 30165 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 04:40:47.355123 30165 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 04:40:47.355196 30165 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:47.355276 30165 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 04:40:47.355319 30165 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:47.364632 30165 rpc_server.cc:307] RPC server started. Bound to: 127.20.240.193:38657
I20260808 04:40:47.364658 30296 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.240.193:38657 every 8 connection(s)
I20260808 04:40:47.365603 30165 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164000593138-21443-0/minicluster-data/ts-0/data/info.pb
I20260808 04:40:47.374377 21443 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu as pid 30165
I20260808 04:40:47.374545 21443 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164000593138-21443-0/minicluster-data/ts-0/wal/instance
I20260808 04:40:47.374945 21443 external_mini_cluster.cc:1428] Setting key 14a95a5544c73bc6794159da9ddecc49
Aug 08 04:40:47 dist-test-slave-vxj2 krb5kdc[30050](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164047, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.240.193@KRBTEST.COM for kudu/127.20.240.254@KRBTEST.COM
I20260808 04:40:47.382012 30140 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:47.367478 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.240.193:47631 (local address 127.20.240.254:35557)
0808 04:40:47.367655 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:47.367660 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:47.368891 (+ 1231us) server_negotiation.cc:407] Connection header received
0808 04:40:47.369905 (+ 1014us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:47.369908 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:47.369957 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:47.370039 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:47.371354 (+ 1315us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:47.372164 (+ 810us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:47.373603 (+ 1439us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:47.373880 (+ 277us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:47.373973 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:47.377212 (+ 3239us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:40:47.377219 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:40:47.377224 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:40:47.377258 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:40:47.378982 (+ 1724us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:47.379739 (+ 757us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:47.379742 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:47.379743 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:47.379858 (+ 115us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:47.380384 (+ 526us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:47.380388 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:47.380389 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:47.380661 (+ 272us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:40:47.380780 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:47.381603 (+ 823us) server_negotiation.cc:299] Negotiation successful
0808 04:40:47.381769 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260808 04:40:47.383325 30300 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:47.367933 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:35557 (local address 127.20.240.193:47631)
0808 04:40:47.368667 (+ 734us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:47.368712 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:47.369685 (+ 973us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:47.370217 (+ 532us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:47.370224 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:47.370622 (+ 398us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:40:47.371187 (+ 565us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:47.371202 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:47.372318 (+ 1116us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:47.372321 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:47.373480 (+ 1159us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:47.373492 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:47.374081 (+ 589us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:47.374089 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:47.374320 (+ 231us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:47.374990 (+ 670us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:40:47.375015 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:40:47.376996 (+ 1981us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:40:47.379120 (+ 2124us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:47.379127 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:47.379150 (+ 23us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:47.379621 (+ 471us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:47.379991 (+ 370us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:47.379998 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:47.380003 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:47.380221 (+ 218us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:47.380801 (+ 580us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:40:47.380812 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:40:47.381258 (+ 446us) client_negotiation.cc:769] Sending connection context
0808 04:40:47.381538 (+ 280us) client_negotiation.cc:240] Negotiation successful
0808 04:40:47.381981 (+ 443us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":537,"thread_start_us":114,"threads_started":1}
I20260808 04:40:47.384981 30298 heartbeater.cc:347] Connected to a master server at 127.20.240.254:35557
I20260808 04:40:47.385358 30298 heartbeater.cc:464] Registering TS with master...
I20260808 04:40:47.386144 30298 heartbeater.cc:511] Master 127.20.240.254:35557 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.20.240.194@KRBTEST.COM; defaulting to no policy
I20260808 04:40:47.388342 30098 ts_manager.cc:194] Registered new tserver with Master: 2f37d9c2d426430290a3eeeb8fdb5021 (127.20.240.193:38657)
I20260808 04:40:47.390028 30098 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.240.193@KRBTEST.COM'} at 127.20.240.193:47631
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.240.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.240.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.194.keytab.
Entry for principal kudu/127.20.240.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.194.keytab.
I20260808 04:40:47.408596 21443 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
/tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164000593138-21443-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164000593138-21443-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164000593138-21443-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164000593138-21443-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.240.194:0
--local_ip_for_outbound_sockets=127.20.240.194
--webserver_interface=127.20.240.194
--webserver_port=0
--tserver_master_addrs=127.20.240.254:35557
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.194.keytab
--principal=kudu/127.20.240.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.240.212:39979
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164000593138-21443-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164000593138-21443-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164000593138-21443-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 04:40:47.522081 30303 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:40:47.522410 30303 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:40:47.522487 30303 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:40:47.526741 30303 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:40:47.526846 30303 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:40:47.526943 30303 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.240.194
I20260808 04:40:47.532574 30303 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.240.212:39979
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164000593138-21443-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164000593138-21443-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.194.keytab
--principal=kudu/127.20.240.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.240.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164000593138-21443-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.240.194
--webserver_port=0
--tserver_master_addrs=127.20.240.254:35557
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30303
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.240.194
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164000593138-21443-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 04:05:18 UTC on ccycloud.quasar-drfdgt.root.comops.site
build id 4574101
I20260808 04:40:47.533766 30303 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:40:47.534883 30303 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:40:47.544991 30311 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:40:47.545008 30308 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:40:47.545063 30303 server_base.cc:1034] running on GCE node
W20260808 04:40:47.545017 30309 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:40:47.545696 30303 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:40:47.546440 30303 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:40:47.547650 30303 hybrid_clock.cc:648] HybridClock initialized: now 1786164047547633 us; error 32 us; skew 500 ppm
Aug 08 04:40:47 dist-test-slave-vxj2 krb5kdc[30050](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164047, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.240.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:40:47.550554 30303 init.cc:377] Logged in from keytab as kudu/127.20.240.194@KRBTEST.COM (short username kudu)
I20260808 04:40:47.551508 30303 webserver.cc:460] Webserver started at http://127.20.240.194:45719/ using document root <none> and password file <none>
I20260808 04:40:47.552091 30303 fs_manager.cc:359] Metadata directory not provided
I20260808 04:40:47.552188 30303 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:40:47.552436 30303 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 04:40:47.554692 30303 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164000593138-21443-0/minicluster-data/ts-1/data/instance:
uuid: "a7614e97d2c944c1907feb23e232f95e"
format_stamp: "Formatted at 2026-08-08 04:40:47 on dist-test-slave-vxj2"
server_key: "aa6fb2c8bbee8c1569cc27e7b4b192f7"
server_key_iv: "311aac873bfe954ab56e068053db5c96"
server_key_version: "encryptionkey@0"
I20260808 04:40:47.555339 30303 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164000593138-21443-0/minicluster-data/ts-1/wal/instance:
uuid: "a7614e97d2c944c1907feb23e232f95e"
format_stamp: "Formatted at 2026-08-08 04:40:47 on dist-test-slave-vxj2"
server_key: "aa6fb2c8bbee8c1569cc27e7b4b192f7"
server_key_iv: "311aac873bfe954ab56e068053db5c96"
server_key_version: "encryptionkey@0"
I20260808 04:40:47.559181 30303 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260808 04:40:47.561692 30318 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:47.563067 30303 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 04:40:47.563234 30303 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164000593138-21443-0/minicluster-data/ts-1/data,/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164000593138-21443-0/minicluster-data/ts-1/wal
uuid: "a7614e97d2c944c1907feb23e232f95e"
format_stamp: "Formatted at 2026-08-08 04:40:47 on dist-test-slave-vxj2"
server_key: "aa6fb2c8bbee8c1569cc27e7b4b192f7"
server_key_iv: "311aac873bfe954ab56e068053db5c96"
server_key_version: "encryptionkey@0"
I20260808 04:40:47.563364 30303 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164000593138-21443-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164000593138-21443-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164000593138-21443-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:40:47.604135 30303 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:40:47.607467 30303 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:40:47.607698 30303 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:40:47.608357 30303 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 04:40:47.609325 30303 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 04:40:47.609404 30303 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:47.609476 30303 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 04:40:47.609530 30303 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:47.619349 30303 rpc_server.cc:307] RPC server started. Bound to: 127.20.240.194:33069
I20260808 04:40:47.619376 30436 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.240.194:33069 every 8 connection(s)
I20260808 04:40:47.620316 30303 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164000593138-21443-0/minicluster-data/ts-1/data/info.pb
I20260808 04:40:47.626302 21443 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu as pid 30303
I20260808 04:40:47.626453 21443 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164000593138-21443-0/minicluster-data/ts-1/wal/instance
I20260808 04:40:47.626780 21443 external_mini_cluster.cc:1428] Setting key 804598e291c4a63f43e60dcd9e9bb8dd
Aug 08 04:40:47 dist-test-slave-vxj2 krb5kdc[30050](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164047, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.240.194@KRBTEST.COM for kudu/127.20.240.254@KRBTEST.COM
I20260808 04:40:47.635774 30140 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:47.622298 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.240.194:48101 (local address 127.20.240.254:35557)
0808 04:40:47.622485 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:47.622490 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:47.623671 (+ 1181us) server_negotiation.cc:407] Connection header received
0808 04:40:47.624676 (+ 1005us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:47.624680 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:47.624746 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:47.624845 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:47.626174 (+ 1329us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:47.627032 (+ 858us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:47.628401 (+ 1369us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:47.628731 (+ 330us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:47.628947 (+ 216us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:47.631702 (+ 2755us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:40:47.631705 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:40:47.631707 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:40:47.631733 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:40:47.633365 (+ 1632us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:47.633915 (+ 550us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:47.633920 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:47.633922 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:47.634008 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:47.634405 (+ 397us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:47.634409 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:47.634411 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:47.634613 (+ 202us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:40:47.634726 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:47.635447 (+ 721us) server_negotiation.cc:299] Negotiation successful
0808 04:40:47.635585 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260808 04:40:47.636659 30440 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:47.622713 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:35557 (local address 127.20.240.194:48101)
0808 04:40:47.623520 (+ 807us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:47.623565 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:47.624409 (+ 844us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:47.625032 (+ 623us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:47.625039 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:47.625493 (+ 454us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:40:47.626008 (+ 515us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:47.626021 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:47.627215 (+ 1194us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:47.627219 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:47.628259 (+ 1040us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:47.628271 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:47.628975 (+ 704us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:47.628978 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:47.629129 (+ 151us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:47.629952 (+ 823us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:40:47.629970 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:40:47.631514 (+ 1544us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:40:47.633489 (+ 1975us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:47.633495 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:47.633512 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:47.633797 (+ 285us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:47.634128 (+ 331us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:47.634133 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:47.634137 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:47.634293 (+ 156us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:47.634748 (+ 455us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:40:47.634755 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:40:47.635142 (+ 387us) client_negotiation.cc:769] Sending connection context
0808 04:40:47.635367 (+ 225us) client_negotiation.cc:240] Negotiation successful
0808 04:40:47.635789 (+ 422us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":568,"thread_start_us":159,"threads_started":1}
I20260808 04:40:47.638208 30438 heartbeater.cc:347] Connected to a master server at 127.20.240.254:35557
WARNING: no policy specified for kudu/127.20.240.195@KRBTEST.COM; defaulting to no policy
I20260808 04:40:47.638481 30438 heartbeater.cc:464] Registering TS with master...
I20260808 04:40:47.639015 30438 heartbeater.cc:511] Master 127.20.240.254:35557 requested a full tablet report, sending...
I20260808 04:40:47.640287 30098 ts_manager.cc:194] Registered new tserver with Master: a7614e97d2c944c1907feb23e232f95e (127.20.240.194:33069)
I20260808 04:40:47.641006 30098 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.240.194@KRBTEST.COM'} at 127.20.240.194:48101
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.240.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.240.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.195.keytab.
Entry for principal kudu/127.20.240.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.195.keytab.
I20260808 04:40:47.658157 21443 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
/tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164000593138-21443-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164000593138-21443-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164000593138-21443-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164000593138-21443-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.240.195:0
--local_ip_for_outbound_sockets=127.20.240.195
--webserver_interface=127.20.240.195
--webserver_port=0
--tserver_master_addrs=127.20.240.254:35557
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.195.keytab
--principal=kudu/127.20.240.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.240.212:39979
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164000593138-21443-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164000593138-21443-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164000593138-21443-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 04:40:47.772928 30443 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:40:47.773307 30443 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:40:47.773383 30443 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:40:47.777608 30443 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:40:47.777678 30443 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:40:47.777761 30443 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.240.195
I20260808 04:40:47.784315 30443 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.240.212:39979
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164000593138-21443-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164000593138-21443-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.195.keytab
--principal=kudu/127.20.240.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.240.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164000593138-21443-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.240.195
--webserver_port=0
--tserver_master_addrs=127.20.240.254:35557
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30443
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.240.195
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164000593138-21443-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 04:05:18 UTC on ccycloud.quasar-drfdgt.root.comops.site
build id 4574101
I20260808 04:40:47.785657 30443 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:40:47.786836 30443 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:40:47.796805 30449 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:40:47.796816 30452 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:40:47.796875 30450 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:40:47.797008 30443 server_base.cc:1034] running on GCE node
I20260808 04:40:47.797549 30443 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:40:47.798204 30443 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:40:47.799376 30443 hybrid_clock.cc:648] HybridClock initialized: now 1786164047799360 us; error 26 us; skew 500 ppm
Aug 08 04:40:47 dist-test-slave-vxj2 krb5kdc[30050](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164047, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.240.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:40:47.802431 30443 init.cc:377] Logged in from keytab as kudu/127.20.240.195@KRBTEST.COM (short username kudu)
I20260808 04:40:47.803447 30443 webserver.cc:460] Webserver started at http://127.20.240.195:42671/ using document root <none> and password file <none>
I20260808 04:40:47.804162 30443 fs_manager.cc:359] Metadata directory not provided
I20260808 04:40:47.804237 30443 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:40:47.804482 30443 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 04:40:47.806924 30443 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164000593138-21443-0/minicluster-data/ts-2/data/instance:
uuid: "014ef11b52c94317b74b4c93408ad46e"
format_stamp: "Formatted at 2026-08-08 04:40:47 on dist-test-slave-vxj2"
server_key: "09dbdb326a03db5698aa9338fb7e8753"
server_key_iv: "ccbb0a10ceedece9b7ed17de7da8518b"
server_key_version: "encryptionkey@0"
I20260808 04:40:47.807657 30443 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164000593138-21443-0/minicluster-data/ts-2/wal/instance:
uuid: "014ef11b52c94317b74b4c93408ad46e"
format_stamp: "Formatted at 2026-08-08 04:40:47 on dist-test-slave-vxj2"
server_key: "09dbdb326a03db5698aa9338fb7e8753"
server_key_iv: "ccbb0a10ceedece9b7ed17de7da8518b"
server_key_version: "encryptionkey@0"
I20260808 04:40:47.812007 30443 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260808 04:40:47.814818 30463 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:47.816167 30443 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260808 04:40:47.816287 30443 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164000593138-21443-0/minicluster-data/ts-2/data,/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164000593138-21443-0/minicluster-data/ts-2/wal
uuid: "014ef11b52c94317b74b4c93408ad46e"
format_stamp: "Formatted at 2026-08-08 04:40:47 on dist-test-slave-vxj2"
server_key: "09dbdb326a03db5698aa9338fb7e8753"
server_key_iv: "ccbb0a10ceedece9b7ed17de7da8518b"
server_key_version: "encryptionkey@0"
I20260808 04:40:47.816493 30443 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164000593138-21443-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164000593138-21443-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164000593138-21443-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:40:47.841326 30443 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:40:47.844798 30443 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:40:47.845049 30443 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:40:47.845743 30443 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 04:40:47.846669 30443 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 04:40:47.846745 30443 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:47.846822 30443 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 04:40:47.846865 30443 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:47.856216 30443 rpc_server.cc:307] RPC server started. Bound to: 127.20.240.195:38761
I20260808 04:40:47.856243 30583 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.240.195:38761 every 8 connection(s)
I20260808 04:40:47.857201 30443 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164000593138-21443-0/minicluster-data/ts-2/data/info.pb
I20260808 04:40:47.865828 21443 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu as pid 30443
I20260808 04:40:47.866019 21443 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164000593138-21443-0/minicluster-data/ts-2/wal/instance
I20260808 04:40:47.866436 21443 external_mini_cluster.cc:1428] Setting key 23f1f1184029f17cb280b912d154ad79
Aug 08 04:40:47 dist-test-slave-vxj2 krb5kdc[30050](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164047, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.240.195@KRBTEST.COM for kudu/127.20.240.254@KRBTEST.COM
I20260808 04:40:47.871371 30140 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:47.859113 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.240.195:34087 (local address 127.20.240.254:35557)
0808 04:40:47.859262 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:47.859266 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:47.860317 (+ 1051us) server_negotiation.cc:407] Connection header received
0808 04:40:47.861285 (+ 968us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:47.861289 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:47.861351 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:47.861438 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:47.862625 (+ 1187us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:47.863173 (+ 548us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:47.864313 (+ 1140us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:47.864550 (+ 237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:47.864668 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:47.867707 (+ 3039us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:40:47.867711 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:40:47.867714 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:40:47.867746 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:40:47.869486 (+ 1740us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:47.870024 (+ 538us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:47.870026 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:47.870028 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:47.870102 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:47.870405 (+ 303us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:47.870407 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:47.870408 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:47.870583 (+ 175us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:40:47.870656 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:47.871148 (+ 492us) server_negotiation.cc:299] Negotiation successful
0808 04:40:47.871250 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260808 04:40:47.872372 30586 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:47.859504 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:35557 (local address 127.20.240.195:34087)
0808 04:40:47.860161 (+ 657us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:47.860203 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:47.861012 (+ 809us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:47.861622 (+ 610us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:47.861629 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:47.861987 (+ 358us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:40:47.862474 (+ 487us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:47.862487 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:47.863308 (+ 821us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:47.863311 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:47.864180 (+ 869us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:47.864189 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:47.864712 (+ 523us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:47.864716 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:47.864888 (+ 172us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:47.865509 (+ 621us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:40:47.865525 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:40:47.867493 (+ 1968us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:40:47.869620 (+ 2127us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:47.869626 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:47.869639 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:47.869929 (+ 290us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:47.870181 (+ 252us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:47.870183 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:47.870185 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:47.870324 (+ 139us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:47.870667 (+ 343us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:40:47.870672 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:40:47.870921 (+ 249us) client_negotiation.cc:769] Sending connection context
0808 04:40:47.871084 (+ 163us) client_negotiation.cc:240] Negotiation successful
0808 04:40:47.871477 (+ 393us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":475,"thread_start_us":111,"threads_started":1}
I20260808 04:40:47.873672 30584 heartbeater.cc:347] Connected to a master server at 127.20.240.254:35557
I20260808 04:40:47.873929 30584 heartbeater.cc:464] Registering TS with master...
I20260808 04:40:47.874451 30584 heartbeater.cc:511] Master 127.20.240.254:35557 requested a full tablet report, sending...
I20260808 04:40:47.875572 30098 ts_manager.cc:194] Registered new tserver with Master: 014ef11b52c94317b74b4c93408ad46e (127.20.240.195:38761)
I20260808 04:40:47.876183 30098 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.240.195@KRBTEST.COM'} at 127.20.240.195:34087
I20260808 04:40:47.880784 21443 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.20.240.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.20.240.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.20.240.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164000593138-21443-0/krb5kdc/oryx_127.20.240.193.keytab.
Entry for principal oryx/127.20.240.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164000593138-21443-0/krb5kdc/oryx_127.20.240.193.keytab.
WARNING: no policy specified for oryx/127.20.240.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.20.240.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.20.240.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164000593138-21443-0/krb5kdc/oryx_127.20.240.194.keytab.
Entry for principal oryx/127.20.240.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164000593138-21443-0/krb5kdc/oryx_127.20.240.194.keytab.
WARNING: no policy specified for oryx/127.20.240.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.20.240.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.20.240.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164000593138-21443-0/krb5kdc/oryx_127.20.240.195.keytab.
Entry for principal oryx/127.20.240.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164000593138-21443-0/krb5kdc/oryx_127.20.240.195.keytab.
I20260808 04:40:47.968693 21443 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu with pid 30165
I20260808 04:40:47.975585 21443 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu with pid 30303
I20260808 04:40:47.982291 21443 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu with pid 30443
I20260808 04:40:47.991037 21443 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu with pid 30065
I20260808 04:40:47.999670 21443 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
/tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164000593138-21443-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164000593138-21443-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164000593138-21443-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164000593138-21443-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.240.254:35557
--webserver_interface=127.20.240.254
--webserver_port=44597
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.254.keytab
--principal=kudu/127.20.240.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.240.212:39979
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.240.254:35557
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164000593138-21443-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164000593138-21443-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164000593138-21443-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 04:40:48.117035 30593 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:40:48.117410 30593 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:40:48.117499 30593 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:40:48.121724 30593 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 04:40:48.121820 30593 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:40:48.121860 30593 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:40:48.121899 30593 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 04:40:48.121938 30593 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 04:40:48.127532 30593 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.240.212:39979
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164000593138-21443-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164000593138-21443-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.240.254:35557
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.254.keytab
--principal=kudu/127.20.240.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.240.254:35557
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164000593138-21443-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.240.254
--webserver_port=44597
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30593
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164000593138-21443-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 04:05:18 UTC on ccycloud.quasar-drfdgt.root.comops.site
build id 4574101
I20260808 04:40:48.128726 30593 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:40:48.129892 30593 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:40:48.138762 30602 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:40:48.138899 30593 server_base.cc:1034] running on GCE node
W20260808 04:40:48.138787 30604 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:40:48.139094 30601 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:40:48.139736 30593 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:40:48.141311 30593 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:40:48.142532 30593 hybrid_clock.cc:648] HybridClock initialized: now 1786164048142512 us; error 36 us; skew 500 ppm
Aug 08 04:40:48 dist-test-slave-vxj2 krb5kdc[30050](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164048, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.240.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:40:48.145479 30593 init.cc:377] Logged in from keytab as kudu/127.20.240.254@KRBTEST.COM (short username kudu)
I20260808 04:40:48.146552 30593 webserver.cc:460] Webserver started at http://127.20.240.254:44597/ using document root <none> and password file <none>
I20260808 04:40:48.147130 30593 fs_manager.cc:359] Metadata directory not provided
I20260808 04:40:48.147248 30593 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:40:48.151273 30593 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260808 04:40:48.153595 30611 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:48.154940 30593 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 04:40:48.155105 30593 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164000593138-21443-0/minicluster-data/master-0/data,/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164000593138-21443-0/minicluster-data/master-0/wal
uuid: "b3376cd20837427eb9f02068281f1c47"
format_stamp: "Formatted at 2026-08-08 04:40:47 on dist-test-slave-vxj2"
server_key: "395fed731074538da09a1823b849edfe"
server_key_iv: "cb7db6039f4f8f8ebda7c40634d8baa3"
server_key_version: "encryptionkey@0"
I20260808 04:40:48.155674 30593 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164000593138-21443-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164000593138-21443-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164000593138-21443-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:40:48.171291 30593 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:40:48.175161 30593 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:40:48.175436 30593 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:40:48.183887 30593 rpc_server.cc:307] RPC server started. Bound to: 127.20.240.254:35557
I20260808 04:40:48.183955 30664 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.240.254:35557 every 8 connection(s)
I20260808 04:40:48.184998 30593 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164000593138-21443-0/minicluster-data/master-0/data/info.pb
I20260808 04:40:48.186718 21443 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu as pid 30593
I20260808 04:40:48.187232 21443 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
/tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164000593138-21443-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164000593138-21443-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164000593138-21443-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164000593138-21443-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.240.193:38657
--local_ip_for_outbound_sockets=127.20.240.193
--tserver_master_addrs=127.20.240.254:35557
--webserver_port=42511
--webserver_interface=127.20.240.193
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.193.keytab
--principal=kudu/127.20.240.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.240.212:39979
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.20.240.193
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164000593138-21443-0/krb5kdc/oryx_127.20.240.193.keytab with env {KRB5CCNAME=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164000593138-21443-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164000593138-21443-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164000593138-21443-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 04:40:48.190508 30665 sys_catalog.cc:263] Verifying existing consensus state
I20260808 04:40:48.193411 30665 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b3376cd20837427eb9f02068281f1c47: Bootstrap starting.
I20260808 04:40:48.216789 30665 log.cc:824] T 00000000000000000000000000000000 P b3376cd20837427eb9f02068281f1c47: Log is configured to *not* fsync() on all Append() calls
I20260808 04:40:48.224126 30665 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b3376cd20837427eb9f02068281f1c47: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 04:40:48.224591 30665 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b3376cd20837427eb9f02068281f1c47: Bootstrap complete.
I20260808 04:40:48.229570 30665 raft_consensus.cc:348] T 00000000000000000000000000000000 P b3376cd20837427eb9f02068281f1c47 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b3376cd20837427eb9f02068281f1c47" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 35557 } }
I20260808 04:40:48.230022 30665 raft_consensus.cc:729] T 00000000000000000000000000000000 P b3376cd20837427eb9f02068281f1c47 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3376cd20837427eb9f02068281f1c47, State: Initialized, Role: FOLLOWER
I20260808 04:40:48.230638 30665 consensus_queue.cc:260] T 00000000000000000000000000000000 P b3376cd20837427eb9f02068281f1c47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b3376cd20837427eb9f02068281f1c47" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 35557 } }
I20260808 04:40:48.230765 30665 raft_consensus.cc:388] T 00000000000000000000000000000000 P b3376cd20837427eb9f02068281f1c47 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 04:40:48.230859 30665 raft_consensus.cc:482] T 00000000000000000000000000000000 P b3376cd20837427eb9f02068281f1c47 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 04:40:48.230966 30665 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b3376cd20837427eb9f02068281f1c47 [term 1 FOLLOWER]: Advancing to term 2
I20260808 04:40:48.233031 30665 raft_consensus.cc:504] T 00000000000000000000000000000000 P b3376cd20837427eb9f02068281f1c47 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b3376cd20837427eb9f02068281f1c47" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 35557 } }
I20260808 04:40:48.233417 30665 leader_election.cc:302] T 00000000000000000000000000000000 P b3376cd20837427eb9f02068281f1c47 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b3376cd20837427eb9f02068281f1c47; no voters:
I20260808 04:40:48.233809 30665 leader_election.cc:288] T 00000000000000000000000000000000 P b3376cd20837427eb9f02068281f1c47 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260808 04:40:48.233916 30669 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b3376cd20837427eb9f02068281f1c47 [term 2 FOLLOWER]: Leader election won for term 2
I20260808 04:40:48.234156 30669 raft_consensus.cc:686] T 00000000000000000000000000000000 P b3376cd20837427eb9f02068281f1c47 [term 2 LEADER]: Becoming Leader. State: Replica: b3376cd20837427eb9f02068281f1c47, State: Running, Role: LEADER
I20260808 04:40:48.234508 30669 consensus_queue.cc:237] T 00000000000000000000000000000000 P b3376cd20837427eb9f02068281f1c47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b3376cd20837427eb9f02068281f1c47" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 35557 } }
I20260808 04:40:48.235194 30665 sys_catalog.cc:564] T 00000000000000000000000000000000 P b3376cd20837427eb9f02068281f1c47 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 04:40:48.235946 30670 sys_catalog.cc:455] T 00000000000000000000000000000000 P b3376cd20837427eb9f02068281f1c47 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "b3376cd20837427eb9f02068281f1c47" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b3376cd20837427eb9f02068281f1c47" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 35557 } } }
I20260808 04:40:48.236094 30670 sys_catalog.cc:458] T 00000000000000000000000000000000 P b3376cd20837427eb9f02068281f1c47 [sys.catalog]: This master's current role is: LEADER
I20260808 04:40:48.236510 30671 sys_catalog.cc:455] T 00000000000000000000000000000000 P b3376cd20837427eb9f02068281f1c47 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b3376cd20837427eb9f02068281f1c47. Latest consensus state: current_term: 2 leader_uuid: "b3376cd20837427eb9f02068281f1c47" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b3376cd20837427eb9f02068281f1c47" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 35557 } } }
I20260808 04:40:48.236626 30671 sys_catalog.cc:458] T 00000000000000000000000000000000 P b3376cd20837427eb9f02068281f1c47 [sys.catalog]: This master's current role is: LEADER
I20260808 04:40:48.237103 30677 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 04:40:48.240553 30677 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 04:40:48.241528 30677 catalog_manager.cc:1259] Loaded cluster ID: 71a48c1528364cc48a49c6d3bb01b7ae
I20260808 04:40:48.241595 30677 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 04:40:48.244201 30677 catalog_manager.cc:1504] Loading token signing keys...
I20260808 04:40:48.245052 30677 catalog_manager.cc:5879] T 00000000000000000000000000000000 P b3376cd20837427eb9f02068281f1c47: Loaded TSK: 0
I20260808 04:40:48.246376 30677 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260808 04:40:48.315713 30667 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:40:48.315995 30667 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:40:48.316043 30667 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:40:48.320144 30667 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:40:48.320214 30667 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:40:48.320274 30667 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.240.193
I20260808 04:40:48.325587 30667 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.240.212:39979
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164000593138-21443-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164000593138-21443-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164000593138-21443-0/krb5kdc/oryx_127.20.240.193.keytab
--principal=oryx/127.20.240.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.240.193:38657
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164000593138-21443-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.240.193
--webserver_port=42511
--tserver_master_addrs=127.20.240.254:35557
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30667
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.240.193
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164000593138-21443-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 04:05:18 UTC on ccycloud.quasar-drfdgt.root.comops.site
build id 4574101
I20260808 04:40:48.326659 30667 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:40:48.327667 30667 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:40:48.337896 30694 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:40:48.337896 30692 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:40:48.337899 30696 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:40:48.338538 30667 server_base.cc:1034] running on GCE node
I20260808 04:40:48.339066 30667 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:40:48.339928 30667 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:40:48.341169 30667 hybrid_clock.cc:648] HybridClock initialized: now 1786164048341103 us; error 57 us; skew 500 ppm
Aug 08 04:40:48 dist-test-slave-vxj2 krb5kdc[30050](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164048, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.240.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:40:48.344936 30667 init.cc:377] Logged in from keytab as oryx/127.20.240.193@KRBTEST.COM (short username oryx)
I20260808 04:40:48.346143 30667 webserver.cc:460] Webserver started at http://127.20.240.193:42511/ using document root <none> and password file <none>
I20260808 04:40:48.346894 30667 fs_manager.cc:359] Metadata directory not provided
I20260808 04:40:48.347013 30667 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:40:48.352396 30667 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.005s sys 0.000s
I20260808 04:40:48.355386 30704 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:48.357088 30667 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260808 04:40:48.357264 30667 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164000593138-21443-0/minicluster-data/ts-0/data,/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164000593138-21443-0/minicluster-data/ts-0/wal
uuid: "2f37d9c2d426430290a3eeeb8fdb5021"
format_stamp: "Formatted at 2026-08-08 04:40:47 on dist-test-slave-vxj2"
server_key: "3e83707f6eed11ec536b73f0b7f4e663"
server_key_iv: "5faca8813ec2c0ed76cc89564660e8d4"
server_key_version: "encryptionkey@0"
I20260808 04:40:48.358029 30667 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164000593138-21443-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164000593138-21443-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164000593138-21443-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:40:48.396205 30667 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:40:48.400363 30667 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:40:48.400578 30667 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:40:48.401379 30667 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 04:40:48.402262 30667 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 04:40:48.402310 30667 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:48.402352 30667 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 04:40:48.402367 30667 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:48.412271 30667 rpc_server.cc:307] RPC server started. Bound to: 127.20.240.193:38657
I20260808 04:40:48.412288 30825 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.240.193:38657 every 8 connection(s)
I20260808 04:40:48.413426 30667 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164000593138-21443-0/minicluster-data/ts-0/data/info.pb
I20260808 04:40:48.416198 21443 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu as pid 30667
I20260808 04:40:48.416718 21443 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
/tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164000593138-21443-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164000593138-21443-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164000593138-21443-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164000593138-21443-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.240.194:33069
--local_ip_for_outbound_sockets=127.20.240.194
--tserver_master_addrs=127.20.240.254:35557
--webserver_port=45719
--webserver_interface=127.20.240.194
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.194.keytab
--principal=kudu/127.20.240.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.240.212:39979
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.20.240.194
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164000593138-21443-0/krb5kdc/oryx_127.20.240.194.keytab with env {KRB5CCNAME=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164000593138-21443-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164000593138-21443-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164000593138-21443-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 08 04:40:48 dist-test-slave-vxj2 krb5kdc[30050](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.240.193@KRBTEST.COM for oryx/127.20.240.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 04:40:48 dist-test-slave-vxj2 krb5kdc[30050](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.240.193@KRBTEST.COM for oryx/127.20.240.254@KRBTEST.COM, Server not found in Kerberos database
W20260808 04:40:48.427723 30830 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 04:40:48.415663 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.240.193:39191 (local address 127.20.240.254:35557)
0808 04:40:48.416494 (+ 831us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:48.416516 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:48.416780 (+ 264us) server_negotiation.cc:407] Connection header received
0808 04:40:48.418063 (+ 1283us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:48.418073 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:48.418374 (+ 301us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:48.418703 (+ 329us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:48.419888 (+ 1185us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:48.420906 (+ 1018us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:48.422151 (+ 1245us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:48.422623 (+ 472us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:48.422818 (+ 195us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:48.426744 (+ 3926us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.240.193:39191: BlockingRecv error: recv got EOF from 127.20.240.193:39191 (error 108)
Metrics: {"server-negotiator.queue_time_us":638,"thread_start_us":148,"threads_started":1}
I20260808 04:40:48.427760 30829 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:48.415712 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:35557 (local address 127.20.240.193:39191)
0808 04:40:48.416603 (+ 891us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:48.416648 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:48.417622 (+ 974us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:48.418779 (+ 1157us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:48.418787 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:48.419237 (+ 450us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:40:48.419694 (+ 457us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:48.419707 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:48.421058 (+ 1351us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:48.421062 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:48.422011 (+ 949us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:48.422021 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:48.422800 (+ 779us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:48.422805 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:48.422990 (+ 185us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:48.423677 (+ 687us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:40:48.423694 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:40:48.426532 (+ 2838us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.240.254:35557: Server oryx/127.20.240.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":668,"thread_start_us":164,"threads_started":1}
W20260808 04:40:48.428437 30827 heartbeater.cc:644] Failed to heartbeat to 127.20.240.254:35557 (0 consecutive failures): Not authorized: Failed to ping master at 127.20.240.254:35557: Client connection negotiation failed: client connection to 127.20.240.254:35557: Server oryx/127.20.240.254@KRBTEST.COM not found in Kerberos database
Aug 08 04:40:48 dist-test-slave-vxj2 krb5kdc[30050](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.240.193@KRBTEST.COM for oryx/127.20.240.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 04:40:48 dist-test-slave-vxj2 krb5kdc[30050](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.240.193@KRBTEST.COM for oryx/127.20.240.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 04:40:48.435655 30829 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:48.428940 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:35557 (local address 127.20.240.193:40485)
0808 04:40:48.429092 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:48.429116 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:48.429239 (+ 123us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:48.429535 (+ 296us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:48.429538 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:48.429677 (+ 139us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:40:48.429777 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:48.429783 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:48.430907 (+ 1124us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:48.430910 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:48.431493 (+ 583us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:48.431502 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:48.432084 (+ 582us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:48.432086 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:48.432160 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:48.432723 (+ 563us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:40:48.432737 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:40:48.435547 (+ 2810us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.240.254:35557: Server oryx/127.20.240.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":65}
W20260808 04:40:48.435863 30830 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 04:40:48.429038 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.240.193:40485 (local address 127.20.240.254:35557)
0808 04:40:48.429183 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:48.429188 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:48.429204 (+ 16us) server_negotiation.cc:407] Connection header received
0808 04:40:48.429358 (+ 154us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:48.429361 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:48.429424 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:48.429511 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:48.429892 (+ 381us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:48.430775 (+ 883us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:48.431615 (+ 840us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:48.431969 (+ 354us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:48.432071 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:48.435729 (+ 3658us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.240.193:40485: BlockingRecv error: recv got EOF from 127.20.240.193:40485 (error 108)
Metrics: {"server-negotiator.queue_time_us":37}
Aug 08 04:40:48 dist-test-slave-vxj2 krb5kdc[30050](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.240.193@KRBTEST.COM for oryx/127.20.240.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 04:40:48 dist-test-slave-vxj2 krb5kdc[30050](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.240.193@KRBTEST.COM for oryx/127.20.240.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 04:40:48.442534 30829 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:48.436294 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:35557 (local address 127.20.240.193:37113)
0808 04:40:48.436520 (+ 226us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:48.436535 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:48.436624 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:48.437062 (+ 438us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:48.437065 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:48.437287 (+ 222us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:40:48.437404 (+ 117us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:48.437411 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:48.438245 (+ 834us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:48.438248 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:48.439135 (+ 887us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:48.439145 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:48.439633 (+ 488us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:48.439638 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:48.439723 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:48.440216 (+ 493us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:40:48.440231 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:40:48.442403 (+ 2172us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.240.254:35557: Server oryx/127.20.240.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":112}
W20260808 04:40:48.442714 30830 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 04:40:48.436366 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.240.193:37113 (local address 127.20.240.254:35557)
0808 04:40:48.436509 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:48.436515 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:48.436730 (+ 215us) server_negotiation.cc:407] Connection header received
0808 04:40:48.436832 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:48.436835 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:48.436915 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:48.437010 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:48.437525 (+ 515us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:48.438130 (+ 605us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:48.439260 (+ 1130us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:48.439508 (+ 248us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:48.439597 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:48.442544 (+ 2947us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.240.193:37113: BlockingRecv error: recv got EOF from 127.20.240.193:37113 (error 108)
Metrics: {"server-negotiator.queue_time_us":43}
W20260808 04:40:48.442770 30827 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260808 04:40:48.540346 30831 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:40:48.540645 30831 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:40:48.540691 30831 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:40:48.545027 30831 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:40:48.545101 30831 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:40:48.545229 30831 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.240.194
I20260808 04:40:48.550799 30831 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.240.212:39979
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164000593138-21443-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164000593138-21443-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164000593138-21443-0/krb5kdc/oryx_127.20.240.194.keytab
--principal=oryx/127.20.240.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.240.194:33069
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164000593138-21443-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.240.194
--webserver_port=45719
--tserver_master_addrs=127.20.240.254:35557
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30831
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.240.194
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164000593138-21443-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 04:05:18 UTC on ccycloud.quasar-drfdgt.root.comops.site
build id 4574101
I20260808 04:40:48.551911 30831 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:40:48.552938 30831 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:40:48.563019 30836 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:40:48.563143 30831 server_base.cc:1034] running on GCE node
W20260808 04:40:48.563041 30839 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:40:48.563325 30837 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:40:48.563815 30831 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:40:48.564481 30831 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:40:48.565652 30831 hybrid_clock.cc:648] HybridClock initialized: now 1786164048565600 us; error 67 us; skew 500 ppm
Aug 08 04:40:48 dist-test-slave-vxj2 krb5kdc[30050](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164048, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.240.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:40:48.568588 30831 init.cc:377] Logged in from keytab as oryx/127.20.240.194@KRBTEST.COM (short username oryx)
I20260808 04:40:48.569658 30831 webserver.cc:460] Webserver started at http://127.20.240.194:45719/ using document root <none> and password file <none>
I20260808 04:40:48.570261 30831 fs_manager.cc:359] Metadata directory not provided
I20260808 04:40:48.570377 30831 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:40:48.574658 30831 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260808 04:40:48.576958 30846 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:48.578375 30831 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 04:40:48.578541 30831 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164000593138-21443-0/minicluster-data/ts-1/data,/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164000593138-21443-0/minicluster-data/ts-1/wal
uuid: "a7614e97d2c944c1907feb23e232f95e"
format_stamp: "Formatted at 2026-08-08 04:40:47 on dist-test-slave-vxj2"
server_key: "aa6fb2c8bbee8c1569cc27e7b4b192f7"
server_key_iv: "311aac873bfe954ab56e068053db5c96"
server_key_version: "encryptionkey@0"
I20260808 04:40:48.579164 30831 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164000593138-21443-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164000593138-21443-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164000593138-21443-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:40:48.595034 30831 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:40:48.598446 30831 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:40:48.598694 30831 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:40:48.599375 30831 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 04:40:48.600307 30831 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 04:40:48.600382 30831 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:48.600468 30831 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 04:40:48.600512 30831 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:48.610239 30831 rpc_server.cc:307] RPC server started. Bound to: 127.20.240.194:33069
I20260808 04:40:48.610265 30964 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.240.194:33069 every 8 connection(s)
I20260808 04:40:48.611344 30831 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164000593138-21443-0/minicluster-data/ts-1/data/info.pb
I20260808 04:40:48.614392 21443 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu as pid 30831
I20260808 04:40:48.614917 21443 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
/tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164000593138-21443-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164000593138-21443-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164000593138-21443-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164000593138-21443-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.240.195:38761
--local_ip_for_outbound_sockets=127.20.240.195
--tserver_master_addrs=127.20.240.254:35557
--webserver_port=42671
--webserver_interface=127.20.240.195
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.195.keytab
--principal=kudu/127.20.240.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.240.212:39979
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.20.240.195
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164000593138-21443-0/krb5kdc/oryx_127.20.240.195.keytab with env {KRB5CCNAME=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164000593138-21443-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164000593138-21443-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164000593138-21443-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 08 04:40:48 dist-test-slave-vxj2 krb5kdc[30050](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.240.194@KRBTEST.COM for oryx/127.20.240.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 04:40:48 dist-test-slave-vxj2 krb5kdc[30050](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.240.194@KRBTEST.COM for oryx/127.20.240.254@KRBTEST.COM, Server not found in Kerberos database
W20260808 04:40:48.624574 30830 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 04:40:48.613487 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.240.194:35261 (local address 127.20.240.254:35557)
0808 04:40:48.613641 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:48.613645 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:48.614851 (+ 1206us) server_negotiation.cc:407] Connection header received
0808 04:40:48.615944 (+ 1093us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:48.615948 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:48.616016 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:48.616134 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:48.617539 (+ 1405us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:48.618429 (+ 890us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:48.619743 (+ 1314us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:48.620174 (+ 431us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:48.620318 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:48.624379 (+ 4061us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.240.194:35261: BlockingRecv error: recv got EOF from 127.20.240.194:35261 (error 108)
Metrics: {"server-negotiator.queue_time_us":59}
I20260808 04:40:48.625115 30967 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:48.613831 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:35557 (local address 127.20.240.194:35261)
0808 04:40:48.614674 (+ 843us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:48.614719 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:48.615633 (+ 914us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:48.616394 (+ 761us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:48.616402 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:48.616770 (+ 368us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:40:48.617362 (+ 592us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:48.617380 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:48.618568 (+ 1188us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:48.618570 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:48.619587 (+ 1017us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:48.619599 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:48.620348 (+ 749us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:48.620351 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:48.620513 (+ 162us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:48.621254 (+ 741us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:40:48.621272 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:40:48.624129 (+ 2857us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.240.254:35557: Server oryx/127.20.240.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":574,"thread_start_us":158,"threads_started":1}
W20260808 04:40:48.625873 30965 heartbeater.cc:644] Failed to heartbeat to 127.20.240.254:35557 (0 consecutive failures): Not authorized: Failed to ping master at 127.20.240.254:35557: Client connection negotiation failed: client connection to 127.20.240.254:35557: Server oryx/127.20.240.254@KRBTEST.COM not found in Kerberos database
Aug 08 04:40:48 dist-test-slave-vxj2 krb5kdc[30050](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.240.194@KRBTEST.COM for oryx/127.20.240.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 04:40:48 dist-test-slave-vxj2 krb5kdc[30050](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.240.194@KRBTEST.COM for oryx/127.20.240.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 04:40:48.632261 30967 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:48.626371 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:35557 (local address 127.20.240.194:49957)
0808 04:40:48.626665 (+ 294us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:48.626679 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:48.626758 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:48.627043 (+ 285us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:48.627045 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:48.627200 (+ 155us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:40:48.627305 (+ 105us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:48.627309 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:48.628382 (+ 1073us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:48.628384 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:48.628929 (+ 545us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:48.628937 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:48.629546 (+ 609us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:48.629548 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:48.629626 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:48.630153 (+ 527us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:40:48.630164 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:40:48.632117 (+ 1953us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.240.254:35557: Server oryx/127.20.240.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":216}
W20260808 04:40:48.632521 30830 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 04:40:48.626528 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.240.194:49957 (local address 127.20.240.254:35557)
0808 04:40:48.626699 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:48.626706 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:48.626725 (+ 19us) server_negotiation.cc:407] Connection header received
0808 04:40:48.626846 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:48.626851 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:48.626915 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:48.627020 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:48.627422 (+ 402us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:48.628250 (+ 828us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:48.629063 (+ 813us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:48.629435 (+ 372us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:48.629538 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:48.632266 (+ 2728us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.240.194:49957: BlockingRecv error: recv got EOF from 127.20.240.194:49957 (error 108)
Metrics: {"server-negotiator.queue_time_us":56}
Aug 08 04:40:48 dist-test-slave-vxj2 krb5kdc[30050](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.240.194@KRBTEST.COM for oryx/127.20.240.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 04:40:48 dist-test-slave-vxj2 krb5kdc[30050](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.240.194@KRBTEST.COM for oryx/127.20.240.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 04:40:48.638422 30967 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:48.632924 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:35557 (local address 127.20.240.194:35705)
0808 04:40:48.633213 (+ 289us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:48.633228 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:48.633320 (+ 92us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:48.633577 (+ 257us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:48.633580 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:48.633747 (+ 167us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:40:48.633820 (+ 73us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:48.633825 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:48.634610 (+ 785us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:48.634615 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:48.635236 (+ 621us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:48.635249 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:48.635696 (+ 447us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:48.635700 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:48.635781 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:48.636349 (+ 568us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:40:48.636364 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:40:48.638261 (+ 1897us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.240.254:35557: Server oryx/127.20.240.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":196}
W20260808 04:40:48.638645 30830 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 04:40:48.633058 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.240.194:35705 (local address 127.20.240.254:35557)
0808 04:40:48.633214 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:48.633220 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:48.633272 (+ 52us) server_negotiation.cc:407] Connection header received
0808 04:40:48.633423 (+ 151us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:48.633430 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:48.633477 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:48.633560 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:48.633936 (+ 376us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:48.634495 (+ 559us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:48.635364 (+ 869us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:48.635585 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:48.635693 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:48.638386 (+ 2693us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.240.194:35705: BlockingRecv error: recv got EOF from 127.20.240.194:35705 (error 108)
Metrics: {"server-negotiator.queue_time_us":53}
W20260808 04:40:48.638671 30965 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260808 04:40:48.753098 30968 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:40:48.753443 30968 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:40:48.753525 30968 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:40:48.757543 30968 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:40:48.757620 30968 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:40:48.757702 30968 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.240.195
I20260808 04:40:48.763402 30968 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.240.212:39979
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164000593138-21443-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164000593138-21443-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164000593138-21443-0/krb5kdc/oryx_127.20.240.195.keytab
--principal=oryx/127.20.240.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.240.195:38761
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164000593138-21443-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.240.195
--webserver_port=42671
--tserver_master_addrs=127.20.240.254:35557
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30968
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.240.195
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164000593138-21443-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 04:05:18 UTC on ccycloud.quasar-drfdgt.root.comops.site
build id 4574101
I20260808 04:40:48.764644 30968 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:40:48.765830 30968 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:40:48.776556 30977 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:40:48.776577 30975 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:40:48.776551 30974 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:40:48.776918 30968 server_base.cc:1034] running on GCE node
I20260808 04:40:48.777488 30968 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:40:48.778281 30968 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:40:48.779508 30968 hybrid_clock.cc:648] HybridClock initialized: now 1786164048779489 us; error 35 us; skew 500 ppm
Aug 08 04:40:48 dist-test-slave-vxj2 krb5kdc[30050](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164048, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.240.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:40:48.782840 30968 init.cc:377] Logged in from keytab as oryx/127.20.240.195@KRBTEST.COM (short username oryx)
I20260808 04:40:48.783991 30968 webserver.cc:460] Webserver started at http://127.20.240.195:42671/ using document root <none> and password file <none>
I20260808 04:40:48.784601 30968 fs_manager.cc:359] Metadata directory not provided
I20260808 04:40:48.784726 30968 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:40:48.790473 30968 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260808 04:40:48.792932 30985 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:48.794486 30968 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.003s
I20260808 04:40:48.794678 30968 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164000593138-21443-0/minicluster-data/ts-2/data,/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164000593138-21443-0/minicluster-data/ts-2/wal
uuid: "014ef11b52c94317b74b4c93408ad46e"
format_stamp: "Formatted at 2026-08-08 04:40:47 on dist-test-slave-vxj2"
server_key: "09dbdb326a03db5698aa9338fb7e8753"
server_key_iv: "ccbb0a10ceedece9b7ed17de7da8518b"
server_key_version: "encryptionkey@0"
I20260808 04:40:48.795303 30968 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164000593138-21443-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164000593138-21443-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164000593138-21443-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:40:48.833889 30968 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:40:48.837635 30968 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:40:48.837854 30968 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:40:48.838492 30968 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 04:40:48.839337 30968 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 04:40:48.839407 30968 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:48.839474 30968 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 04:40:48.839524 30968 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:48.849391 30968 rpc_server.cc:307] RPC server started. Bound to: 127.20.240.195:38761
I20260808 04:40:48.849416 31103 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.240.195:38761 every 8 connection(s)
I20260808 04:40:48.850481 30968 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164000593138-21443-0/minicluster-data/ts-2/data/info.pb
I20260808 04:40:48.853225 21443 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu as pid 30968
Aug 08 04:40:48 dist-test-slave-vxj2 krb5kdc[30050](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.240.195@KRBTEST.COM for oryx/127.20.240.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 04:40:48 dist-test-slave-vxj2 krb5kdc[30050](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.240.195@KRBTEST.COM for oryx/127.20.240.254@KRBTEST.COM, Server not found in Kerberos database
W20260808 04:40:48.865842 30830 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 04:40:48.852467 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.240.195:51379 (local address 127.20.240.254:35557)
0808 04:40:48.852618 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:48.852622 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:48.853794 (+ 1172us) server_negotiation.cc:407] Connection header received
0808 04:40:48.855023 (+ 1229us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:48.855025 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:48.855072 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:48.855127 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:48.856608 (+ 1481us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:48.857267 (+ 659us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:48.858811 (+ 1544us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:48.859068 (+ 257us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:48.859171 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:48.865672 (+ 6501us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.240.195:51379: BlockingRecv error: recv got EOF from 127.20.240.195:51379 (error 108)
Metrics: {"server-negotiator.queue_time_us":63}
I20260808 04:40:48.866720 31107 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:48.852874 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:35557 (local address 127.20.240.195:51379)
0808 04:40:48.853633 (+ 759us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:48.853690 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:48.854791 (+ 1101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:48.855347 (+ 556us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:48.855359 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:48.855897 (+ 538us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:40:48.856432 (+ 535us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:48.856447 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:48.857398 (+ 951us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:48.857401 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:48.858662 (+ 1261us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:48.858675 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:48.859276 (+ 601us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:48.859281 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:48.859487 (+ 206us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:48.862386 (+ 2899us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:40:48.862407 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:40:48.865500 (+ 3093us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.240.254:35557: Server oryx/127.20.240.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":553,"thread_start_us":140,"threads_started":1}
W20260808 04:40:48.867338 31105 heartbeater.cc:644] Failed to heartbeat to 127.20.240.254:35557 (0 consecutive failures): Not authorized: Failed to ping master at 127.20.240.254:35557: Client connection negotiation failed: client connection to 127.20.240.254:35557: Server oryx/127.20.240.254@KRBTEST.COM not found in Kerberos database
I20260808 04:40:48.868323 31109 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:48.854290 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56318 (local address 127.20.240.254:35557)
0808 04:40:48.854526 (+ 236us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:48.854529 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:48.854543 (+ 14us) server_negotiation.cc:407] Connection header received
0808 04:40:48.854585 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:48.854587 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:48.854669 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:48.854858 (+ 189us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:48.855971 (+ 1113us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:48.856621 (+ 650us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:48.857709 (+ 1088us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:48.857968 (+ 259us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:48.858048 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:48.863232 (+ 5184us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:40:48.863239 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:40:48.863256 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:40:48.863286 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:40:48.865660 (+ 2374us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:48.866259 (+ 599us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:48.866265 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:48.866270 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:48.866395 (+ 125us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:48.866745 (+ 350us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:48.866747 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:48.866748 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:48.867309 (+ 561us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:40:48.867527 (+ 218us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:48.867859 (+ 332us) server_negotiation.cc:299] Negotiation successful
0808 04:40:48.868130 (+ 271us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":167,"thread_start_us":102,"threads_started":1}
Aug 08 04:40:48 dist-test-slave-vxj2 krb5kdc[30050](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.240.195@KRBTEST.COM for oryx/127.20.240.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 04:40:48 dist-test-slave-vxj2 krb5kdc[30050](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.240.195@KRBTEST.COM for oryx/127.20.240.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 04:40:48.873628 31107 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:48.867887 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:35557 (local address 127.20.240.195:58475)
0808 04:40:48.868075 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:48.868091 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:48.868170 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:48.868446 (+ 276us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:48.868449 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:48.868621 (+ 172us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:40:48.868768 (+ 147us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:48.868775 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:48.869694 (+ 919us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:48.869698 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:48.870481 (+ 783us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:48.870492 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:48.870980 (+ 488us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:48.870984 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:48.871106 (+ 122us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:48.871555 (+ 449us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:40:48.871567 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:40:48.873479 (+ 1912us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.240.254:35557: Server oryx/127.20.240.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":118}
W20260808 04:40:48.873714 30830 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 04:40:48.867997 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.240.195:58475 (local address 127.20.240.254:35557)
0808 04:40:48.868129 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:48.868134 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:48.868150 (+ 16us) server_negotiation.cc:407] Connection header received
0808 04:40:48.868281 (+ 131us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:48.868283 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:48.868323 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:48.868426 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:48.868899 (+ 473us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:48.869571 (+ 672us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:48.870605 (+ 1034us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:48.870850 (+ 245us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:48.870965 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:48.873598 (+ 2633us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.240.195:58475: BlockingRecv error: recv got EOF from 127.20.240.195:58475 (error 108)
Metrics: {"server-negotiator.queue_time_us":53}
Aug 08 04:40:48 dist-test-slave-vxj2 krb5kdc[30050](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.240.195@KRBTEST.COM for oryx/127.20.240.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 04:40:48 dist-test-slave-vxj2 krb5kdc[30050](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.240.195@KRBTEST.COM for oryx/127.20.240.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 04:40:48.879170 31107 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:48.874296 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:35557 (local address 127.20.240.195:46261)
0808 04:40:48.874426 (+ 130us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:48.874443 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:48.874532 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:48.874817 (+ 285us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:48.874819 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:48.874945 (+ 126us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:40:48.875036 (+ 91us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:48.875041 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:48.875753 (+ 712us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:48.875755 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:48.876273 (+ 518us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:48.876280 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:48.876738 (+ 458us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:48.876740 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:48.876795 (+ 55us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:48.877300 (+ 505us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:40:48.877312 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:40:48.879070 (+ 1758us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.240.254:35557: Server oryx/127.20.240.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":52}
W20260808 04:40:48.879398 31105 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260808 04:40:48.879577 30830 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 04:40:48.874408 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.240.195:46261 (local address 127.20.240.254:35557)
0808 04:40:48.874608 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:48.874612 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:48.874626 (+ 14us) server_negotiation.cc:407] Connection header received
0808 04:40:48.874661 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:48.874663 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:48.874707 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:48.874793 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:48.875166 (+ 373us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:48.875659 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:48.876400 (+ 741us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:48.876633 (+ 233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:48.876781 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:48.879193 (+ 2412us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.240.195:46261: BlockingRecv error: recv got EOF from 127.20.240.195:46261 (error 108)
Metrics: {"server-negotiator.queue_time_us":126}
Aug 08 04:40:49 dist-test-slave-vxj2 krb5kdc[30050](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.240.193@KRBTEST.COM for oryx/127.20.240.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 04:40:49 dist-test-slave-vxj2 krb5kdc[30050](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.240.193@KRBTEST.COM for oryx/127.20.240.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 04:40:49.449749 31111 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:49.443626 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:35557 (local address 127.20.240.193:46711)
0808 04:40:49.443992 (+ 366us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:49.444007 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:49.444121 (+ 114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:49.444393 (+ 272us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:49.444395 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:49.444577 (+ 182us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:40:49.444701 (+ 124us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:49.444706 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:49.445714 (+ 1008us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:49.445720 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:49.446421 (+ 701us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:49.446432 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:49.446928 (+ 496us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:49.446931 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:49.447037 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:49.447572 (+ 535us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:40:49.447585 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:40:49.449571 (+ 1986us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.240.254:35557: Server oryx/127.20.240.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":263,"thread_start_us":157,"threads_started":1}
W20260808 04:40:49.449869 31110 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 04:40:49.443676 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.240.193:46711 (local address 127.20.240.254:35557)
0808 04:40:49.443992 (+ 316us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:49.443996 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:49.444108 (+ 112us) server_negotiation.cc:407] Connection header received
0808 04:40:49.444195 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:49.444197 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:49.444266 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:49.444354 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:49.444840 (+ 486us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:49.445594 (+ 754us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:49.446563 (+ 969us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:49.446806 (+ 243us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:49.446923 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:49.449729 (+ 2806us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.240.193:46711: BlockingRecv error: recv got EOF from 127.20.240.193:46711 (error 108)
Metrics: {"server-negotiator.queue_time_us":207,"thread_start_us":80,"threads_started":1}
Aug 08 04:40:49 dist-test-slave-vxj2 krb5kdc[30050](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.240.194@KRBTEST.COM for oryx/127.20.240.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 04:40:49 dist-test-slave-vxj2 krb5kdc[30050](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.240.194@KRBTEST.COM for oryx/127.20.240.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 04:40:49.645355 31112 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:49.639591 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:35557 (local address 127.20.240.194:34815)
0808 04:40:49.639919 (+ 328us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:49.639932 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:49.640070 (+ 138us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:49.640359 (+ 289us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:49.640362 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:49.640574 (+ 212us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:40:49.640668 (+ 94us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:49.640674 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:49.641525 (+ 851us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:49.641530 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:49.642102 (+ 572us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:49.642109 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:49.642579 (+ 470us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:49.642583 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:49.642672 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:49.643247 (+ 575us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:40:49.643261 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:40:49.645141 (+ 1880us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.240.254:35557: Server oryx/127.20.240.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":258,"thread_start_us":91,"threads_started":1}
W20260808 04:40:49.645462 31110 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 04:40:49.639661 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.240.194:34815 (local address 127.20.240.254:35557)
0808 04:40:49.639807 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:49.639813 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:49.640014 (+ 201us) server_negotiation.cc:407] Connection header received
0808 04:40:49.640172 (+ 158us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:49.640176 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:49.640227 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:49.640336 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:49.640793 (+ 457us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:49.641418 (+ 625us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:49.642225 (+ 807us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:49.642464 (+ 239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:49.642576 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:49.645346 (+ 2770us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.240.194:34815: BlockingRecv error: recv got EOF from 127.20.240.194:34815 (error 108)
Metrics: {"server-negotiator.queue_time_us":50}
Aug 08 04:40:49 dist-test-slave-vxj2 krb5kdc[30050](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.240.195@KRBTEST.COM for oryx/127.20.240.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 04:40:49 dist-test-slave-vxj2 krb5kdc[30050](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.240.195@KRBTEST.COM for oryx/127.20.240.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 04:40:49.886004 31113 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:49.880089 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:35557 (local address 127.20.240.195:50399)
0808 04:40:49.880480 (+ 391us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:49.880496 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:49.880616 (+ 120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:49.880918 (+ 302us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:49.880920 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:49.881113 (+ 193us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:40:49.881262 (+ 149us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:49.881267 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:49.882109 (+ 842us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:49.882112 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:49.882757 (+ 645us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:49.882769 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:49.883247 (+ 478us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:49.883249 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:49.883318 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:49.883879 (+ 561us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:40:49.883892 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:40:49.885822 (+ 1930us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.240.254:35557: Server oryx/127.20.240.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":303,"thread_start_us":124,"threads_started":1}
W20260808 04:40:49.886129 31110 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 04:40:49.880158 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.240.195:50399 (local address 127.20.240.254:35557)
0808 04:40:49.880315 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:49.880320 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:49.880603 (+ 283us) server_negotiation.cc:407] Connection header received
0808 04:40:49.880741 (+ 138us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:49.880744 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:49.880797 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:49.880882 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:49.881373 (+ 491us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:49.882004 (+ 631us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:49.882901 (+ 897us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:49.883136 (+ 235us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:49.883221 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:49.886018 (+ 2797us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.240.195:50399: BlockingRecv error: recv got EOF from 127.20.240.195:50399 (error 108)
Metrics: {"server-negotiator.queue_time_us":62}
Aug 08 04:40:50 dist-test-slave-vxj2 krb5kdc[30050](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.240.193@KRBTEST.COM for oryx/127.20.240.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 04:40:50 dist-test-slave-vxj2 krb5kdc[30050](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.240.193@KRBTEST.COM for oryx/127.20.240.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 04:40:50.456797 31114 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:50.450811 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:35557 (local address 127.20.240.193:57611)
0808 04:40:50.451128 (+ 317us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:50.451148 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:50.451274 (+ 126us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:50.451610 (+ 336us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:50.451613 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:50.451853 (+ 240us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:40:50.451958 (+ 105us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:50.451964 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:50.452877 (+ 913us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:50.452882 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:50.453512 (+ 630us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:50.453522 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:50.454027 (+ 505us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:50.454030 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:50.454119 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:50.454662 (+ 543us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:40:50.454685 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:40:50.456596 (+ 1911us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.240.254:35557: Server oryx/127.20.240.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":218,"thread_start_us":85,"threads_started":1}
W20260808 04:40:50.456877 31115 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 04:40:50.450990 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.240.193:57611 (local address 127.20.240.254:35557)
0808 04:40:50.451324 (+ 334us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:50.451328 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:50.451344 (+ 16us) server_negotiation.cc:407] Connection header received
0808 04:40:50.451393 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:50.451396 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:50.451441 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:50.451552 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:50.452104 (+ 552us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:50.452759 (+ 655us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:50.453646 (+ 887us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:50.453897 (+ 251us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:50.454021 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:50.456742 (+ 2721us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.240.193:57611: BlockingRecv error: recv got EOF from 127.20.240.193:57611 (error 108)
Metrics: {"server-negotiator.queue_time_us":244,"thread_start_us":118,"threads_started":1}
Aug 08 04:40:50 dist-test-slave-vxj2 krb5kdc[30050](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.240.194@KRBTEST.COM for oryx/127.20.240.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 04:40:50 dist-test-slave-vxj2 krb5kdc[30050](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.240.194@KRBTEST.COM for oryx/127.20.240.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 04:40:50.651742 31117 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:50.646259 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:35557 (local address 127.20.240.194:37151)
0808 04:40:50.646547 (+ 288us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:50.646563 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:50.646667 (+ 104us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:50.646942 (+ 275us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:50.646944 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:50.647147 (+ 203us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:40:50.647242 (+ 95us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:50.647247 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:50.648064 (+ 817us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:50.648068 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:50.648616 (+ 548us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:50.648624 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:50.649071 (+ 447us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:50.649074 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:50.649136 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:50.649678 (+ 542us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:40:50.649689 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:40:50.651594 (+ 1905us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.240.254:35557: Server oryx/127.20.240.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":210,"thread_start_us":121,"threads_started":1}
W20260808 04:40:50.651907 31115 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 04:40:50.646318 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.240.194:37151 (local address 127.20.240.254:35557)
0808 04:40:50.646499 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:50.646503 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:50.646666 (+ 163us) server_negotiation.cc:407] Connection header received
0808 04:40:50.646751 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:50.646754 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:50.646808 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:50.646885 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:50.647348 (+ 463us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:50.647909 (+ 561us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:50.648728 (+ 819us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:50.648971 (+ 243us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:50.649053 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:50.651764 (+ 2711us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.240.194:37151: BlockingRecv error: recv got EOF from 127.20.240.194:37151 (error 108)
Metrics: {"server-negotiator.queue_time_us":78}
Aug 08 04:40:50 dist-test-slave-vxj2 krb5kdc[30050](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.240.195@KRBTEST.COM for oryx/127.20.240.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 04:40:50 dist-test-slave-vxj2 krb5kdc[30050](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.240.195@KRBTEST.COM for oryx/127.20.240.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 04:40:50.893503 31118 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:50.886914 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:35557 (local address 127.20.240.195:56951)
0808 04:40:50.887304 (+ 390us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:50.887329 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:50.887457 (+ 128us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:50.887803 (+ 346us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:50.887807 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:50.888055 (+ 248us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:40:50.888212 (+ 157us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:50.888220 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:50.889282 (+ 1062us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:50.889286 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:50.889977 (+ 691us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:50.889987 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:50.890499 (+ 512us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:50.890503 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:50.890576 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:50.891115 (+ 539us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:40:50.891128 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:40:50.893342 (+ 2214us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.240.254:35557: Server oryx/127.20.240.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":294,"thread_start_us":205,"threads_started":1}
W20260808 04:40:50.893638 31115 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 04:40:50.887083 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.240.195:56951 (local address 127.20.240.254:35557)
0808 04:40:50.887228 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:50.887231 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:50.887440 (+ 209us) server_negotiation.cc:407] Connection header received
0808 04:40:50.887554 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:50.887558 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:50.887618 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:50.887739 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:50.888365 (+ 626us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:50.889118 (+ 753us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:50.890128 (+ 1010us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:50.890356 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:50.890452 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:50.893512 (+ 3060us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.240.195:56951: BlockingRecv error: recv got EOF from 127.20.240.195:56951 (error 108)
Metrics: {"server-negotiator.queue_time_us":55}
Aug 08 04:40:51 dist-test-slave-vxj2 krb5kdc[30050](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.240.193@KRBTEST.COM for oryx/127.20.240.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 04:40:51 dist-test-slave-vxj2 krb5kdc[30050](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.240.193@KRBTEST.COM for oryx/127.20.240.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 04:40:51.463477 31119 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:51.457638 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:35557 (local address 127.20.240.193:43453)
0808 04:40:51.457986 (+ 348us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:51.458009 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:51.458112 (+ 103us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:51.458534 (+ 422us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:51.458536 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:51.458786 (+ 250us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:40:51.458921 (+ 135us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:51.458927 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:51.459683 (+ 756us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:51.459685 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:51.460403 (+ 718us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:51.460413 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:51.460851 (+ 438us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:51.460853 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:51.460917 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:51.461477 (+ 560us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:40:51.461491 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:40:51.463316 (+ 1825us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.240.254:35557: Server oryx/127.20.240.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":211,"thread_start_us":117,"threads_started":1}
W20260808 04:40:51.463809 31120 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 04:40:51.457750 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.240.193:43453 (local address 127.20.240.254:35557)
0808 04:40:51.458010 (+ 260us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:51.458013 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:51.458076 (+ 63us) server_negotiation.cc:407] Connection header received
0808 04:40:51.458364 (+ 288us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:51.458366 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:51.458416 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:51.458493 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:51.459030 (+ 537us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:51.459575 (+ 545us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:51.460517 (+ 942us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:51.460744 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:51.460848 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:51.463519 (+ 2671us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.240.193:43453: BlockingRecv error: recv got EOF from 127.20.240.193:43453 (error 108)
Metrics: {"server-negotiator.queue_time_us":183,"thread_start_us":104,"threads_started":1}
Aug 08 04:40:51 dist-test-slave-vxj2 krb5kdc[30050](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.240.194@KRBTEST.COM for oryx/127.20.240.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 04:40:51 dist-test-slave-vxj2 krb5kdc[30050](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.240.194@KRBTEST.COM for oryx/127.20.240.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 04:40:51.658704 31121 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:51.652623 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:35557 (local address 127.20.240.194:46493)
0808 04:40:51.652986 (+ 363us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:51.653001 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:51.653149 (+ 148us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:51.653467 (+ 318us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:51.653470 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:51.653685 (+ 215us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:40:51.653781 (+ 96us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:51.653786 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:51.654626 (+ 840us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:51.654631 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:51.655199 (+ 568us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:51.655206 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:51.655685 (+ 479us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:51.655689 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:51.655776 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:51.656316 (+ 540us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:40:51.656353 (+ 37us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:40:51.658532 (+ 2179us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.240.254:35557: Server oryx/127.20.240.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":281,"thread_start_us":112,"threads_started":1}
W20260808 04:40:51.658773 31120 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 04:40:51.652757 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.240.194:46493 (local address 127.20.240.254:35557)
0808 04:40:51.652954 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:51.652959 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:51.653094 (+ 135us) server_negotiation.cc:407] Connection header received
0808 04:40:51.653288 (+ 194us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:51.653291 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:51.653350 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:51.653442 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:51.653946 (+ 504us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:51.654507 (+ 561us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:51.655331 (+ 824us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:51.655561 (+ 230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:51.655669 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:51.658664 (+ 2995us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.240.194:46493: BlockingRecv error: recv got EOF from 127.20.240.194:46493 (error 108)
Metrics: {"server-negotiator.queue_time_us":91}
Aug 08 04:40:51 dist-test-slave-vxj2 krb5kdc[30050](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.240.195@KRBTEST.COM for oryx/127.20.240.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 04:40:51 dist-test-slave-vxj2 krb5kdc[30050](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.240.195@KRBTEST.COM for oryx/127.20.240.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 04:40:51.900568 31123 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:51.894453 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:35557 (local address 127.20.240.195:37929)
0808 04:40:51.894749 (+ 296us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:51.894764 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:51.894867 (+ 103us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:51.895107 (+ 240us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:51.895109 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:51.895298 (+ 189us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:40:51.895409 (+ 111us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:51.895415 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:51.896480 (+ 1065us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:51.896483 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:51.897267 (+ 784us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:51.897278 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:51.897795 (+ 517us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:51.897798 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:51.897860 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:51.898500 (+ 640us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:40:51.898513 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:40:51.900435 (+ 1922us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.240.254:35557: Server oryx/127.20.240.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":207,"thread_start_us":86,"threads_started":1}
W20260808 04:40:51.900746 31120 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 04:40:51.894616 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.240.195:37929 (local address 127.20.240.254:35557)
0808 04:40:51.894815 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:51.894819 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:51.894835 (+ 16us) server_negotiation.cc:407] Connection header received
0808 04:40:51.894942 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:51.894944 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:51.894991 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:51.895064 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:51.895526 (+ 462us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:51.896253 (+ 727us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:51.897376 (+ 1123us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:51.897691 (+ 315us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:51.897773 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:51.900584 (+ 2811us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.240.195:37929: BlockingRecv error: recv got EOF from 127.20.240.195:37929 (error 108)
Metrics: {"server-negotiator.queue_time_us":94}
Aug 08 04:40:52 dist-test-slave-vxj2 krb5kdc[30050](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.240.193@KRBTEST.COM for oryx/127.20.240.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 04:40:52 dist-test-slave-vxj2 krb5kdc[30050](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.240.193@KRBTEST.COM for oryx/127.20.240.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 04:40:52.470521 31124 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:52.464373 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:35557 (local address 127.20.240.193:54953)
0808 04:40:52.464701 (+ 328us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:52.464719 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:52.464913 (+ 194us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:52.465380 (+ 467us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:52.465385 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:52.465624 (+ 239us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:40:52.465780 (+ 156us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:52.465788 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:52.466860 (+ 1072us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:52.466863 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:52.467413 (+ 550us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:52.467420 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:52.468019 (+ 599us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:52.468022 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:52.468081 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:52.468570 (+ 489us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:40:52.468582 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:40:52.470406 (+ 1824us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.240.254:35557: Server oryx/127.20.240.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":228,"thread_start_us":87,"threads_started":1}
W20260808 04:40:52.470700 31125 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 04:40:52.464453 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.240.193:54953 (local address 127.20.240.254:35557)
0808 04:40:52.464701 (+ 248us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:52.464707 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:52.464809 (+ 102us) server_negotiation.cc:407] Connection header received
0808 04:40:52.465075 (+ 266us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:52.465078 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:52.465204 (+ 126us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:52.465331 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:52.465912 (+ 581us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:52.466705 (+ 793us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:52.467523 (+ 818us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:52.467898 (+ 375us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:52.468000 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:52.470552 (+ 2552us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.240.193:54953: BlockingRecv error: recv got EOF from 127.20.240.193:54953 (error 108)
Metrics: {"server-negotiator.queue_time_us":165,"thread_start_us":63,"threads_started":1}
Aug 08 04:40:52 dist-test-slave-vxj2 krb5kdc[30050](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.240.194@KRBTEST.COM for oryx/127.20.240.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 04:40:52 dist-test-slave-vxj2 krb5kdc[30050](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.240.194@KRBTEST.COM for oryx/127.20.240.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 04:40:52.665401 31126 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:52.659567 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:35557 (local address 127.20.240.194:33205)
0808 04:40:52.659840 (+ 273us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:52.659856 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:52.660001 (+ 145us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:52.660292 (+ 291us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:52.660295 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:52.660503 (+ 208us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:40:52.660596 (+ 93us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:52.660603 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:52.661478 (+ 875us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:52.661483 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:52.662039 (+ 556us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:52.662047 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:52.662510 (+ 463us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:52.662513 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:52.662599 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:52.663155 (+ 556us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:40:52.663167 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:40:52.665227 (+ 2060us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.240.254:35557: Server oryx/127.20.240.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":196,"thread_start_us":87,"threads_started":1}
W20260808 04:40:52.665463 31125 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 04:40:52.659627 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.240.194:33205 (local address 127.20.240.254:35557)
0808 04:40:52.659809 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:52.659813 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:52.659941 (+ 128us) server_negotiation.cc:407] Connection header received
0808 04:40:52.660102 (+ 161us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:52.660105 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:52.660162 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:52.660259 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:52.660727 (+ 468us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:52.661369 (+ 642us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:52.662161 (+ 792us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:52.662396 (+ 235us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:52.662508 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:52.665354 (+ 2846us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.240.194:33205: BlockingRecv error: recv got EOF from 127.20.240.194:33205 (error 108)
Metrics: {"server-negotiator.queue_time_us":77}
Aug 08 04:40:52 dist-test-slave-vxj2 krb5kdc[30050](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.240.195@KRBTEST.COM for oryx/127.20.240.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 04:40:52 dist-test-slave-vxj2 krb5kdc[30050](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.240.195@KRBTEST.COM for oryx/127.20.240.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 04:40:52.907577 31127 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:52.901415 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:35557 (local address 127.20.240.195:37619)
0808 04:40:52.901742 (+ 327us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:52.901768 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:52.901921 (+ 153us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:52.902208 (+ 287us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:52.902211 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:52.902434 (+ 223us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:40:52.902555 (+ 121us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:52.902562 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:52.903547 (+ 985us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:52.903552 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:52.904108 (+ 556us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:52.904117 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:52.904596 (+ 479us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:52.904600 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:52.904687 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:52.905300 (+ 613us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:40:52.905313 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:40:52.907440 (+ 2127us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.240.254:35557: Server oryx/127.20.240.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":256,"thread_start_us":90,"threads_started":1}
W20260808 04:40:52.907797 31125 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 04:40:52.901567 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.240.195:37619 (local address 127.20.240.254:35557)
0808 04:40:52.901742 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:52.901748 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:52.901857 (+ 109us) server_negotiation.cc:407] Connection header received
0808 04:40:52.902027 (+ 170us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:52.902030 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:52.902088 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:52.902181 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:52.902680 (+ 499us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:52.903403 (+ 723us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:52.904238 (+ 835us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:52.904473 (+ 235us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:52.904588 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:52.907680 (+ 3092us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.240.195:37619: BlockingRecv error: recv got EOF from 127.20.240.195:37619 (error 108)
Metrics: {"server-negotiator.queue_time_us":76}
Aug 08 04:40:53 dist-test-slave-vxj2 krb5kdc[30050](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.240.193@KRBTEST.COM for oryx/127.20.240.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 04:40:53 dist-test-slave-vxj2 krb5kdc[30050](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.240.193@KRBTEST.COM for oryx/127.20.240.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 04:40:53.477896 31128 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:53.471440 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:35557 (local address 127.20.240.193:46275)
0808 04:40:53.471822 (+ 382us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:53.471838 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:53.471947 (+ 109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:53.472232 (+ 285us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:53.472239 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:53.472448 (+ 209us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:40:53.472552 (+ 104us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:53.472557 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:53.473459 (+ 902us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:53.473462 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:53.474160 (+ 698us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:53.474170 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:53.474789 (+ 619us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:53.474793 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:53.474890 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:53.475537 (+ 647us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:40:53.475551 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:40:53.477727 (+ 2176us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.240.254:35557: Server oryx/127.20.240.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":223,"thread_start_us":96,"threads_started":1}
W20260808 04:40:53.478060 31129 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 04:40:53.471582 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.240.193:46275 (local address 127.20.240.254:35557)
0808 04:40:53.471852 (+ 270us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:53.471855 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:53.471915 (+ 60us) server_negotiation.cc:407] Connection header received
0808 04:40:53.472048 (+ 133us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:53.472050 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:53.472098 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:53.472178 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:53.472672 (+ 494us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:53.473332 (+ 660us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:53.474304 (+ 972us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:53.474628 (+ 324us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:53.474718 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:53.477884 (+ 3166us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.240.193:46275: BlockingRecv error: recv got EOF from 127.20.240.193:46275 (error 108)
Metrics: {"server-negotiator.queue_time_us":183,"thread_start_us":72,"threads_started":1}
Aug 08 04:40:53 dist-test-slave-vxj2 krb5kdc[30050](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.240.194@KRBTEST.COM for oryx/127.20.240.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 04:40:53 dist-test-slave-vxj2 krb5kdc[30050](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.240.194@KRBTEST.COM for oryx/127.20.240.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 04:40:53.673136 31130 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:53.666386 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:35557 (local address 127.20.240.194:49811)
0808 04:40:53.666688 (+ 302us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:53.666703 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:53.666795 (+ 92us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:53.667068 (+ 273us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:53.667071 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:53.667262 (+ 191us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:40:53.667360 (+ 98us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:53.667366 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:53.668378 (+ 1012us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:53.668381 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:53.669276 (+ 895us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:53.669289 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:53.669880 (+ 591us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:53.669885 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:53.669991 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:53.670660 (+ 669us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:40:53.670673 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:40:53.672953 (+ 2280us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.240.254:35557: Server oryx/127.20.240.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":211,"thread_start_us":119,"threads_started":1}
W20260808 04:40:53.673247 31129 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 04:40:53.666591 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.240.194:49811 (local address 127.20.240.254:35557)
0808 04:40:53.666747 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:53.666751 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:53.666765 (+ 14us) server_negotiation.cc:407] Connection header received
0808 04:40:53.666896 (+ 131us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:53.666899 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:53.666946 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:53.667026 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:53.667511 (+ 485us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:53.668233 (+ 722us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:53.669405 (+ 1172us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:53.669623 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:53.669708 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:53.673092 (+ 3384us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.240.194:49811: BlockingRecv error: recv got EOF from 127.20.240.194:49811 (error 108)
Metrics: {"server-negotiator.queue_time_us":61}
Aug 08 04:40:53 dist-test-slave-vxj2 krb5kdc[30050](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.240.195@KRBTEST.COM for oryx/127.20.240.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 04:40:53 dist-test-slave-vxj2 krb5kdc[30050](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.240.195@KRBTEST.COM for oryx/127.20.240.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 04:40:53.921260 31131 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:53.908579 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:35557 (local address 127.20.240.195:40817)
0808 04:40:53.908927 (+ 348us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:53.908943 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:53.909056 (+ 113us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:53.909412 (+ 356us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:53.909415 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:53.909613 (+ 198us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:40:53.909725 (+ 112us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:53.909731 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:53.910795 (+ 1064us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:53.910799 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:53.911653 (+ 854us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:53.911686 (+ 33us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:53.912276 (+ 590us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:53.912279 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:53.912351 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:53.918798 (+ 6447us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:40:53.918814 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:40:53.921059 (+ 2245us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.240.254:35557: Server oryx/127.20.240.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":254,"thread_start_us":152,"threads_started":1}
W20260808 04:40:53.921553 31129 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 04:40:53.908757 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.240.195:40817 (local address 127.20.240.254:35557)
0808 04:40:53.908916 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:53.908919 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:53.909027 (+ 108us) server_negotiation.cc:407] Connection header received
0808 04:40:53.909171 (+ 144us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:53.909174 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:53.909230 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:53.909312 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:53.909955 (+ 643us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:53.910614 (+ 659us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:53.911832 (+ 1218us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:53.912152 (+ 320us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:53.912256 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:53.921419 (+ 9163us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.240.195:40817: BlockingRecv error: recv got EOF from 127.20.240.195:40817 (error 108)
Metrics: {"server-negotiator.queue_time_us":62}
Aug 08 04:40:54 dist-test-slave-vxj2 krb5kdc[30050](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.240.193@KRBTEST.COM for oryx/127.20.240.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 04:40:54 dist-test-slave-vxj2 krb5kdc[30050](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.240.193@KRBTEST.COM for oryx/127.20.240.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 04:40:54.484704 31132 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:54.478826 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:35557 (local address 127.20.240.193:56569)
0808 04:40:54.479140 (+ 314us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:54.479154 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:54.479266 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:54.479534 (+ 268us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:54.479536 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:54.479724 (+ 188us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:40:54.479834 (+ 110us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:54.479840 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:54.480605 (+ 765us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:54.480607 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:54.481227 (+ 620us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:54.481240 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:54.481735 (+ 495us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:54.481737 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:54.481808 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:54.482406 (+ 598us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:40:54.482418 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:40:54.484516 (+ 2098us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.240.254:35557: Server oryx/127.20.240.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":225,"thread_start_us":126,"threads_started":1}
W20260808 04:40:54.484783 31133 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 04:40:54.478895 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.240.193:56569 (local address 127.20.240.254:35557)
0808 04:40:54.479155 (+ 260us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:54.479158 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:54.479209 (+ 51us) server_negotiation.cc:407] Connection header received
0808 04:40:54.479363 (+ 154us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:54.479366 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:54.479411 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:54.479482 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:54.479956 (+ 474us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:54.480509 (+ 553us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:54.481380 (+ 871us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:54.481621 (+ 241us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:54.481709 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:54.484655 (+ 2946us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.240.193:56569: BlockingRecv error: recv got EOF from 127.20.240.193:56569 (error 108)
Metrics: {"server-negotiator.queue_time_us":192,"thread_start_us":95,"threads_started":1}
Aug 08 04:40:54 dist-test-slave-vxj2 krb5kdc[30050](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.240.194@KRBTEST.COM for oryx/127.20.240.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 04:40:54 dist-test-slave-vxj2 krb5kdc[30050](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.240.194@KRBTEST.COM for oryx/127.20.240.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 04:40:54.679991 31134 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:54.673994 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:35557 (local address 127.20.240.194:43581)
0808 04:40:54.674275 (+ 281us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:54.674290 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:54.674389 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:54.674748 (+ 359us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:54.674751 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:54.674954 (+ 203us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:40:54.675056 (+ 102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:54.675062 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:54.675937 (+ 875us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:54.675940 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:54.676509 (+ 569us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:54.676518 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:54.677070 (+ 552us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:54.677073 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:54.677138 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:54.677741 (+ 603us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:40:54.677756 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:40:54.679865 (+ 2109us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.240.254:35557: Server oryx/127.20.240.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":175,"thread_start_us":73,"threads_started":1}
W20260808 04:40:54.680223 31133 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 04:40:54.674145 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.240.194:43581 (local address 127.20.240.254:35557)
0808 04:40:54.674333 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:54.674337 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:54.674352 (+ 15us) server_negotiation.cc:407] Connection header received
0808 04:40:54.674532 (+ 180us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:54.674535 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:54.674589 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:54.674674 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:54.675210 (+ 536us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:54.675808 (+ 598us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:54.676653 (+ 845us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:54.676948 (+ 295us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:54.677042 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:54.680033 (+ 2991us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.240.194:43581: BlockingRecv error: recv got EOF from 127.20.240.194:43581 (error 108)
Metrics: {"server-negotiator.queue_time_us":87}
Aug 08 04:40:54 dist-test-slave-vxj2 krb5kdc[30050](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.240.195@KRBTEST.COM for oryx/127.20.240.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 04:40:54 dist-test-slave-vxj2 krb5kdc[30050](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.240.195@KRBTEST.COM for oryx/127.20.240.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 04:40:54.928073 31135 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:54.922152 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:35557 (local address 127.20.240.195:33823)
0808 04:40:54.922438 (+ 286us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:54.922455 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:54.922594 (+ 139us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:54.922940 (+ 346us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:54.922946 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:54.923156 (+ 210us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:40:54.923251 (+ 95us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:54.923257 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:54.924042 (+ 785us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:54.924047 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:54.924632 (+ 585us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:54.924640 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:54.925122 (+ 482us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:54.925125 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:54.925248 (+ 123us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:54.925798 (+ 550us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:40:54.925810 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:40:54.927951 (+ 2141us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.240.254:35557: Server oryx/127.20.240.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":203,"thread_start_us":103,"threads_started":1}
W20260808 04:40:54.928301 31133 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 04:40:54.922229 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.240.195:33823 (local address 127.20.240.254:35557)
0808 04:40:54.922382 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:54.922387 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:54.922543 (+ 156us) server_negotiation.cc:407] Connection header received
0808 04:40:54.922704 (+ 161us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:54.922708 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:54.922765 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:54.922850 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:54.923393 (+ 543us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:54.923930 (+ 537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:54.924761 (+ 831us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:54.924999 (+ 238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:54.925109 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:54.928144 (+ 3035us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.240.195:33823: BlockingRecv error: recv got EOF from 127.20.240.195:33823 (error 108)
Metrics: {"server-negotiator.queue_time_us":40}
Aug 08 04:40:55 dist-test-slave-vxj2 krb5kdc[30050](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.240.193@KRBTEST.COM for oryx/127.20.240.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 04:40:55 dist-test-slave-vxj2 krb5kdc[30050](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.240.193@KRBTEST.COM for oryx/127.20.240.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 04:40:55.492015 31136 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:55.485699 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:35557 (local address 127.20.240.193:46737)
0808 04:40:55.486065 (+ 366us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:55.486079 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:55.486183 (+ 104us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:55.486490 (+ 307us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:55.486493 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:55.486685 (+ 192us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:40:55.486805 (+ 120us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:55.486811 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:55.487630 (+ 819us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:55.487633 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:55.488345 (+ 712us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:55.488356 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:55.488944 (+ 588us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:55.488948 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:55.489020 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:55.489659 (+ 639us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:40:55.489673 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:40:55.491822 (+ 2149us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.240.254:35557: Server oryx/127.20.240.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":278,"thread_start_us":109,"threads_started":1}
W20260808 04:40:55.492055 31137 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 04:40:55.485780 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.240.193:46737 (local address 127.20.240.254:35557)
0808 04:40:55.486055 (+ 275us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:55.486059 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:55.486153 (+ 94us) server_negotiation.cc:407] Connection header received
0808 04:40:55.486271 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:55.486273 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:55.486319 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:55.486404 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:55.486937 (+ 533us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:55.487483 (+ 546us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:55.488479 (+ 996us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:55.488711 (+ 232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:55.488796 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:55.491940 (+ 3144us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.240.193:46737: BlockingRecv error: recv got EOF from 127.20.240.193:46737 (error 108)
Metrics: {"server-negotiator.queue_time_us":194,"thread_start_us":109,"threads_started":1}
Aug 08 04:40:55 dist-test-slave-vxj2 krb5kdc[30050](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.240.194@KRBTEST.COM for oryx/127.20.240.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 04:40:55 dist-test-slave-vxj2 krb5kdc[30050](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.240.194@KRBTEST.COM for oryx/127.20.240.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 04:40:55.687188 31138 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:55.680884 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:35557 (local address 127.20.240.194:49725)
0808 04:40:55.681262 (+ 378us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:55.681293 (+ 31us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:55.681405 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:55.681666 (+ 261us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:55.681668 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:55.681894 (+ 226us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:40:55.682004 (+ 110us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:55.682010 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:55.682832 (+ 822us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:55.682836 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:55.683565 (+ 729us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:55.683576 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:55.684052 (+ 476us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:55.684055 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:55.684124 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:55.684688 (+ 564us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:40:55.684701 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:40:55.687007 (+ 2306us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.240.254:35557: Server oryx/127.20.240.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":286,"thread_start_us":82,"threads_started":1}
W20260808 04:40:55.687352 31137 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 04:40:55.681089 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.240.194:49725 (local address 127.20.240.254:35557)
0808 04:40:55.681302 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:55.681306 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:55.681357 (+ 51us) server_negotiation.cc:407] Connection header received
0808 04:40:55.681498 (+ 141us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:55.681501 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:55.681548 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:55.681625 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:55.682158 (+ 533us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:55.682693 (+ 535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:55.683692 (+ 999us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:55.683938 (+ 246us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:55.684023 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:55.687189 (+ 3166us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.240.194:49725: BlockingRecv error: recv got EOF from 127.20.240.194:49725 (error 108)
Metrics: {"server-negotiator.queue_time_us":108}
Aug 08 04:40:55 dist-test-slave-vxj2 krb5kdc[30050](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.240.195@KRBTEST.COM for oryx/127.20.240.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 04:40:55 dist-test-slave-vxj2 krb5kdc[30050](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.240.195@KRBTEST.COM for oryx/127.20.240.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 04:40:55.934676 31139 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:55.928988 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:35557 (local address 127.20.240.195:46219)
0808 04:40:55.929331 (+ 343us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:55.929345 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:55.929444 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:55.929681 (+ 237us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:55.929684 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:55.929875 (+ 191us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:40:55.929973 (+ 98us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:55.929978 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:55.930793 (+ 815us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:55.930833 (+ 40us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:55.931382 (+ 549us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:55.931390 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:55.931896 (+ 506us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:55.931899 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:55.931964 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:55.932483 (+ 519us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:40:55.932494 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:40:55.934551 (+ 2057us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.240.254:35557: Server oryx/127.20.240.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":257,"thread_start_us":75,"threads_started":1}
W20260808 04:40:55.934849 31137 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 04:40:55.929113 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.240.195:46219 (local address 127.20.240.254:35557)
0808 04:40:55.929332 (+ 219us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:55.929337 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:55.929416 (+ 79us) server_negotiation.cc:407] Connection header received
0808 04:40:55.929526 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:55.929529 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:55.929576 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:55.929641 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:55.930078 (+ 437us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:55.930687 (+ 609us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:55.931509 (+ 822us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:55.931754 (+ 245us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:55.931853 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:55.934688 (+ 2835us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.240.195:46219: BlockingRecv error: recv got EOF from 127.20.240.195:46219 (error 108)
Metrics: {"server-negotiator.queue_time_us":105}
Aug 08 04:40:56 dist-test-slave-vxj2 krb5kdc[30050](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.240.193@KRBTEST.COM for oryx/127.20.240.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 04:40:56 dist-test-slave-vxj2 krb5kdc[30050](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.240.193@KRBTEST.COM for oryx/127.20.240.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 04:40:56.499588 31140 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:56.493235 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:35557 (local address 127.20.240.193:52339)
0808 04:40:56.493579 (+ 344us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:56.493596 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:56.493712 (+ 116us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:56.494000 (+ 288us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:56.494003 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:56.494231 (+ 228us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:40:56.494353 (+ 122us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:56.494360 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:56.495202 (+ 842us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:56.495205 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:56.495798 (+ 593us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:56.495810 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:56.496304 (+ 494us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:56.496307 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:56.496372 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:56.497032 (+ 660us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:40:56.497052 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:40:56.499470 (+ 2418us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.240.254:35557: Server oryx/127.20.240.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":231,"thread_start_us":121,"threads_started":1}
W20260808 04:40:56.499747 31141 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 04:40:56.493483 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.240.193:52339 (local address 127.20.240.254:35557)
0808 04:40:56.493738 (+ 255us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:56.493742 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:56.493761 (+ 19us) server_negotiation.cc:407] Connection header received
0808 04:40:56.493806 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:56.493808 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:56.493851 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:56.493952 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:56.494492 (+ 540us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:56.495066 (+ 574us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:56.495947 (+ 881us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:56.496176 (+ 229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:56.496256 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:56.499609 (+ 3353us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.240.193:52339: BlockingRecv error: recv got EOF from 127.20.240.193:52339 (error 108)
Metrics: {"server-negotiator.queue_time_us":186,"thread_start_us":91,"threads_started":1}
Aug 08 04:40:56 dist-test-slave-vxj2 krb5kdc[30050](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.240.194@KRBTEST.COM for oryx/127.20.240.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 04:40:56 dist-test-slave-vxj2 krb5kdc[30050](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.240.194@KRBTEST.COM for oryx/127.20.240.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 04:40:56.695214 31142 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:56.688177 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:35557 (local address 127.20.240.194:59487)
0808 04:40:56.688605 (+ 428us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:56.688622 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:56.688834 (+ 212us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:56.689228 (+ 394us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:56.689231 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:56.689438 (+ 207us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:40:56.689562 (+ 124us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:56.689568 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:56.690626 (+ 1058us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:56.690630 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:56.691345 (+ 715us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:56.691359 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:56.691877 (+ 518us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:56.691881 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:56.691959 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:56.692563 (+ 604us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:40:56.692577 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:40:56.695034 (+ 2457us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.240.254:35557: Server oryx/127.20.240.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":319,"thread_start_us":82,"threads_started":1}
W20260808 04:40:56.695302 31141 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 04:40:56.688432 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.240.194:59487 (local address 127.20.240.254:35557)
0808 04:40:56.688611 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:56.688615 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:56.688746 (+ 131us) server_negotiation.cc:407] Connection header received
0808 04:40:56.688961 (+ 215us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:56.688965 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:56.689026 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:56.689130 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:56.689722 (+ 592us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:56.690457 (+ 735us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:56.691492 (+ 1035us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:56.691737 (+ 245us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:56.691839 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:56.695175 (+ 3336us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.240.194:59487: BlockingRecv error: recv got EOF from 127.20.240.194:59487 (error 108)
Metrics: {"server-negotiator.queue_time_us":74}
Aug 08 04:40:56 dist-test-slave-vxj2 krb5kdc[30050](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.240.195@KRBTEST.COM for oryx/127.20.240.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 04:40:56 dist-test-slave-vxj2 krb5kdc[30050](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.240.195@KRBTEST.COM for oryx/127.20.240.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 04:40:56.941709 31143 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:56.935632 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:35557 (local address 127.20.240.195:34841)
0808 04:40:56.935955 (+ 323us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:56.935969 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:56.936152 (+ 183us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:56.936420 (+ 268us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:56.936423 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:56.936629 (+ 206us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:40:56.936729 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:56.936734 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:56.937567 (+ 833us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:56.937570 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:56.938149 (+ 579us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:56.938157 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:56.938732 (+ 575us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:56.938735 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:56.938861 (+ 126us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:56.939520 (+ 659us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:40:56.939532 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:40:56.941533 (+ 2001us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.240.254:35557: Server oryx/127.20.240.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":218,"thread_start_us":75,"threads_started":1}
W20260808 04:40:56.941789 31141 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 04:40:56.935836 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.240.195:34841 (local address 127.20.240.254:35557)
0808 04:40:56.936010 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:56.936016 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:56.936055 (+ 39us) server_negotiation.cc:407] Connection header received
0808 04:40:56.936255 (+ 200us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:56.936257 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:56.936306 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:56.936377 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:56.936837 (+ 460us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:56.937465 (+ 628us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:56.938275 (+ 810us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:56.938569 (+ 294us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:56.938701 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:56.941674 (+ 2973us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.240.195:34841: BlockingRecv error: recv got EOF from 127.20.240.195:34841 (error 108)
Metrics: {"server-negotiator.queue_time_us":43}
Aug 08 04:40:57 dist-test-slave-vxj2 krb5kdc[30050](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.240.193@KRBTEST.COM for oryx/127.20.240.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 04:40:57 dist-test-slave-vxj2 krb5kdc[30050](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.240.193@KRBTEST.COM for oryx/127.20.240.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 04:40:57.506325 31144 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:57.500520 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:35557 (local address 127.20.240.193:39125)
0808 04:40:57.500799 (+ 279us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:57.500812 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:57.500901 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:57.501212 (+ 311us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:57.501214 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:57.501397 (+ 183us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:40:57.501494 (+ 97us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:57.501499 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:57.502449 (+ 950us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:57.502451 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:57.503002 (+ 551us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:57.503009 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:57.503516 (+ 507us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:57.503518 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:57.503579 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:57.504110 (+ 531us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:40:57.504122 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:40:57.506198 (+ 2076us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.240.254:35557: Server oryx/127.20.240.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":199,"thread_start_us":95,"threads_started":1}
W20260808 04:40:57.506690 31145 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 04:40:57.500590 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.240.193:39125 (local address 127.20.240.254:35557)
0808 04:40:57.500885 (+ 295us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:57.500889 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:57.500904 (+ 15us) server_negotiation.cc:407] Connection header received
0808 04:40:57.501041 (+ 137us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:57.501044 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:57.501090 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:57.501198 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:57.501649 (+ 451us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:57.502336 (+ 687us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:57.503129 (+ 793us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:57.503401 (+ 272us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:57.503503 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:57.506509 (+ 3006us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.240.193:39125: BlockingRecv error: recv got EOF from 127.20.240.193:39125 (error 108)
Metrics: {"server-negotiator.queue_time_us":180,"thread_start_us":74,"threads_started":1}
Aug 08 04:40:57 dist-test-slave-vxj2 krb5kdc[30050](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.240.194@KRBTEST.COM for oryx/127.20.240.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 04:40:57 dist-test-slave-vxj2 krb5kdc[30050](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.240.194@KRBTEST.COM for oryx/127.20.240.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 04:40:57.702602 31146 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:57.696243 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:35557 (local address 127.20.240.194:59101)
0808 04:40:57.696533 (+ 290us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:57.696553 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:57.696649 (+ 96us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:57.697043 (+ 394us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:57.697046 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:57.697266 (+ 220us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:40:57.697373 (+ 107us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:57.697380 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:57.698228 (+ 848us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:57.698232 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:57.698792 (+ 560us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:57.698802 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:57.699378 (+ 576us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:57.699381 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:57.699454 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:57.699973 (+ 519us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:40:57.699985 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:40:57.702386 (+ 2401us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.240.254:35557: Server oryx/127.20.240.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":200,"thread_start_us":104,"threads_started":1}
W20260808 04:40:57.702713 31145 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 04:40:57.696395 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.240.194:59101 (local address 127.20.240.254:35557)
0808 04:40:57.696587 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:57.696592 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:57.696610 (+ 18us) server_negotiation.cc:407] Connection header received
0808 04:40:57.696746 (+ 136us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:57.696749 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:57.696810 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:57.696921 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:57.697521 (+ 600us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:57.698090 (+ 569us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:57.698983 (+ 893us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:57.699246 (+ 263us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:57.699337 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:57.702577 (+ 3240us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.240.194:59101: BlockingRecv error: recv got EOF from 127.20.240.194:59101 (error 108)
Metrics: {"server-negotiator.queue_time_us":80}
Aug 08 04:40:57 dist-test-slave-vxj2 krb5kdc[30050](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.240.195@KRBTEST.COM for oryx/127.20.240.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 04:40:57 dist-test-slave-vxj2 krb5kdc[30050](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.240.195@KRBTEST.COM for oryx/127.20.240.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 04:40:57.949007 31147 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:57.942620 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:35557 (local address 127.20.240.195:43255)
0808 04:40:57.942907 (+ 287us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:57.942921 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:57.943037 (+ 116us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:57.943279 (+ 242us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:57.943281 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:57.943459 (+ 178us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:40:57.943560 (+ 101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:57.943565 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:57.944481 (+ 916us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:57.944484 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:57.945050 (+ 566us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:57.945058 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:57.945590 (+ 532us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:57.945593 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:57.945659 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:57.946338 (+ 679us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:40:57.946358 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:40:57.948873 (+ 2515us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.240.254:35557: Server oryx/127.20.240.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":197,"thread_start_us":75,"threads_started":1}
W20260808 04:40:57.949158 31145 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 04:40:57.942724 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.240.195:43255 (local address 127.20.240.254:35557)
0808 04:40:57.942903 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:57.942908 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:57.942986 (+ 78us) server_negotiation.cc:407] Connection header received
0808 04:40:57.943115 (+ 129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:57.943117 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:57.943169 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:57.943245 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:57.943681 (+ 436us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:57.944344 (+ 663us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:57.945219 (+ 875us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:57.945476 (+ 257us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:57.945565 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:57.949022 (+ 3457us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.240.195:43255: BlockingRecv error: recv got EOF from 127.20.240.195:43255 (error 108)
Metrics: {"server-negotiator.queue_time_us":68}
Aug 08 04:40:58 dist-test-slave-vxj2 krb5kdc[30050](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.240.193@KRBTEST.COM for oryx/127.20.240.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 04:40:58 dist-test-slave-vxj2 krb5kdc[30050](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.240.193@KRBTEST.COM for oryx/127.20.240.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 04:40:58.516974 31148 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:58.507297 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:35557 (local address 127.20.240.193:56697)
0808 04:40:58.507658 (+ 361us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:58.507681 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:58.507880 (+ 199us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:58.508205 (+ 325us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:58.508208 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:58.508410 (+ 202us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:40:58.508559 (+ 149us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:58.508565 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:58.509419 (+ 854us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:58.509422 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:58.510039 (+ 617us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:58.510053 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:58.510686 (+ 633us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:58.510690 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:58.510784 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:58.514617 (+ 3833us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:40:58.514635 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:40:58.516758 (+ 2123us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.240.254:35557: Server oryx/127.20.240.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":220,"thread_start_us":78,"threads_started":1}
W20260808 04:40:58.517182 31149 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 04:40:58.507505 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.240.193:56697 (local address 127.20.240.254:35557)
0808 04:40:58.507816 (+ 311us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:58.507820 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:58.507835 (+ 15us) server_negotiation.cc:407] Connection header received
0808 04:40:58.507988 (+ 153us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:58.507990 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:58.508036 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:58.508121 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:58.508695 (+ 574us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:58.509283 (+ 588us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:58.510206 (+ 923us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:58.510540 (+ 334us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:58.510666 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:58.517001 (+ 6335us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.240.193:56697: BlockingRecv error: recv got EOF from 127.20.240.193:56697 (error 108)
Metrics: {"server-negotiator.queue_time_us":230,"thread_start_us":112,"threads_started":1}
Aug 08 04:40:58 dist-test-slave-vxj2 krb5kdc[30050](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.240.194@KRBTEST.COM for oryx/127.20.240.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 04:40:58 dist-test-slave-vxj2 krb5kdc[30050](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.240.194@KRBTEST.COM for oryx/127.20.240.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 04:40:58.710728 31150 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:58.703853 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:35557 (local address 127.20.240.194:57471)
0808 04:40:58.704231 (+ 378us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:58.704245 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:58.704380 (+ 135us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:58.704761 (+ 381us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:58.704764 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:58.704968 (+ 204us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:40:58.705071 (+ 103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:58.705077 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:58.706089 (+ 1012us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:58.706092 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:58.706900 (+ 808us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:58.706913 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:58.707566 (+ 653us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:58.707571 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:58.707679 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:58.708456 (+ 777us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:40:58.708471 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:40:58.710598 (+ 2127us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.240.254:35557: Server oryx/127.20.240.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":300,"thread_start_us":151,"threads_started":1}
W20260808 04:40:58.710925 31149 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 04:40:58.703958 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.240.194:57471 (local address 127.20.240.254:35557)
0808 04:40:58.704200 (+ 242us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:58.704206 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:58.704338 (+ 132us) server_negotiation.cc:407] Connection header received
0808 04:40:58.704533 (+ 195us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:58.704536 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:58.704589 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:58.704673 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:58.705242 (+ 569us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:58.705795 (+ 553us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:58.707054 (+ 1259us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:58.707416 (+ 362us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:58.707560 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:58.710758 (+ 3198us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.240.194:57471: BlockingRecv error: recv got EOF from 127.20.240.194:57471 (error 108)
Metrics: {"server-negotiator.queue_time_us":104}
Aug 08 04:40:58 dist-test-slave-vxj2 krb5kdc[30050](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.240.195@KRBTEST.COM for oryx/127.20.240.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 04:40:58 dist-test-slave-vxj2 krb5kdc[30050](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.240.195@KRBTEST.COM for oryx/127.20.240.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 04:40:58.961133 31151 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:58.950185 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:35557 (local address 127.20.240.195:48125)
0808 04:40:58.950486 (+ 301us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:58.950503 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:58.950647 (+ 144us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:58.951041 (+ 394us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:58.951047 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:58.951306 (+ 259us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:40:58.951434 (+ 128us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:58.951441 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:58.952248 (+ 807us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:58.952251 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:58.952873 (+ 622us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:58.952883 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:58.953630 (+ 747us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:58.953633 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:58.953725 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:58.958512 (+ 4787us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:40:58.958529 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:40:58.960973 (+ 2444us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.240.254:35557: Server oryx/127.20.240.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":214,"thread_start_us":124,"threads_started":1}
W20260808 04:40:58.961505 31149 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 04:40:58.950364 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.240.195:48125 (local address 127.20.240.254:35557)
0808 04:40:58.950496 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:58.950503 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:58.950588 (+ 85us) server_negotiation.cc:407] Connection header received
0808 04:40:58.950816 (+ 228us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:58.950818 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:58.950899 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:58.950989 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:58.951542 (+ 553us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:58.952130 (+ 588us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:58.953231 (+ 1101us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:58.953495 (+ 264us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:58.953598 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:58.961208 (+ 7610us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.240.195:48125: BlockingRecv error: recv got EOF from 127.20.240.195:48125 (error 108)
Metrics: {"server-negotiator.queue_time_us":66}
Aug 08 04:40:59 dist-test-slave-vxj2 krb5kdc[30050](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.240.193@KRBTEST.COM for oryx/127.20.240.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 04:40:59 dist-test-slave-vxj2 krb5kdc[30050](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.240.193@KRBTEST.COM for oryx/127.20.240.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 04:40:59.523970 31152 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:59.517933 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:35557 (local address 127.20.240.193:57243)
0808 04:40:59.518337 (+ 404us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:59.518358 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:59.518457 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:59.518756 (+ 299us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:59.518759 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:59.519021 (+ 262us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:40:59.519153 (+ 132us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:59.519160 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:59.519948 (+ 788us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:59.519954 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:59.520520 (+ 566us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:59.520528 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:59.521012 (+ 484us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:59.521015 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:59.521101 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:59.521726 (+ 625us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:40:59.521742 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:40:59.523846 (+ 2104us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.240.254:35557: Server oryx/127.20.240.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":318,"thread_start_us":92,"threads_started":1}
W20260808 04:40:59.524140 31153 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 04:40:59.518003 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.240.193:57243 (local address 127.20.240.254:35557)
0808 04:40:59.518308 (+ 305us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:59.518313 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:59.518435 (+ 122us) server_negotiation.cc:407] Connection header received
0808 04:40:59.518571 (+ 136us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:59.518573 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:59.518617 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:59.518725 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:59.519277 (+ 552us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:59.519834 (+ 557us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:59.520643 (+ 809us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:59.520887 (+ 244us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:59.520996 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:59.523970 (+ 2974us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.240.193:57243: BlockingRecv error: recv got EOF from 127.20.240.193:57243 (error 108)
Metrics: {"server-negotiator.queue_time_us":185,"thread_start_us":105,"threads_started":1}
Aug 08 04:40:59 dist-test-slave-vxj2 krb5kdc[30050](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.240.194@KRBTEST.COM for oryx/127.20.240.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 04:40:59 dist-test-slave-vxj2 krb5kdc[30050](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.240.194@KRBTEST.COM for oryx/127.20.240.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 04:40:59.717288 31154 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:59.711610 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:35557 (local address 127.20.240.194:55025)
0808 04:40:59.711943 (+ 333us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:59.711957 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:59.712062 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:59.712395 (+ 333us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:59.712397 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:59.712585 (+ 188us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:40:59.712685 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:59.712690 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:59.713515 (+ 825us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:59.713518 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:59.714111 (+ 593us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:59.714121 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:59.714641 (+ 520us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:59.714644 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:59.714714 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:59.715242 (+ 528us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:40:59.715255 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:40:59.717100 (+ 1845us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.240.254:35557: Server oryx/127.20.240.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":257,"thread_start_us":76,"threads_started":1}
W20260808 04:40:59.717520 31153 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 04:40:59.711695 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.240.194:55025 (local address 127.20.240.254:35557)
0808 04:40:59.711893 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:59.711898 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:59.712031 (+ 133us) server_negotiation.cc:407] Connection header received
0808 04:40:59.712187 (+ 156us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:59.712190 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:59.712240 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:59.712346 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:59.712825 (+ 479us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:59.713391 (+ 566us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:59.714263 (+ 872us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:59.714499 (+ 236us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:59.714596 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:59.717393 (+ 2797us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.240.194:55025: BlockingRecv error: recv got EOF from 127.20.240.194:55025 (error 108)
Metrics: {"server-negotiator.queue_time_us":92}
Aug 08 04:40:59 dist-test-slave-vxj2 krb5kdc[30050](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.240.195@KRBTEST.COM for oryx/127.20.240.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 04:40:59 dist-test-slave-vxj2 krb5kdc[30050](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.240.195@KRBTEST.COM for oryx/127.20.240.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 04:40:59.968216 31155 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:59.962110 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:35557 (local address 127.20.240.195:50223)
0808 04:40:59.962464 (+ 354us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:59.962481 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:59.962612 (+ 131us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:59.962946 (+ 334us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:59.962949 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:59.963190 (+ 241us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:40:59.963315 (+ 125us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:59.963323 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:59.964193 (+ 870us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:59.964198 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:59.964861 (+ 663us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:59.964870 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:59.965407 (+ 537us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:59.965411 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:59.965498 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:59.966042 (+ 544us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:40:59.966058 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:40:59.968028 (+ 1970us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.240.254:35557: Server oryx/127.20.240.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":254,"thread_start_us":82,"threads_started":1}
W20260808 04:40:59.968281 31153 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 04:40:59.962235 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.240.195:50223 (local address 127.20.240.254:35557)
0808 04:40:59.962406 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:59.962410 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:59.962582 (+ 172us) server_negotiation.cc:407] Connection header received
0808 04:40:59.962732 (+ 150us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:59.962736 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:59.962793 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:59.962881 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:59.963486 (+ 605us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:59.964084 (+ 598us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:59.964992 (+ 908us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:59.965293 (+ 301us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:59.965408 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:59.968164 (+ 2756us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.240.195:50223: BlockingRecv error: recv got EOF from 127.20.240.195:50223 (error 108)
Metrics: {"server-negotiator.queue_time_us":62}
Aug 08 04:41:00 dist-test-slave-vxj2 krb5kdc[30050](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.240.193@KRBTEST.COM for oryx/127.20.240.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 04:41:00 dist-test-slave-vxj2 krb5kdc[30050](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.240.193@KRBTEST.COM for oryx/127.20.240.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 04:41:00.530867 31156 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:41:00.524845 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:35557 (local address 127.20.240.193:36639)
0808 04:41:00.525225 (+ 380us) negotiation.cc:107] Waiting for socket to connect
0808 04:41:00.525250 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0808 04:41:00.525365 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:41:00.525602 (+ 237us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:41:00.525604 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:41:00.525794 (+ 190us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:41:00.525896 (+ 102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:41:00.525901 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:41:00.526689 (+ 788us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:41:00.526692 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:41:00.527287 (+ 595us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:41:00.527296 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:41:00.527784 (+ 488us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:41:00.527787 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:41:00.527859 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:41:00.528440 (+ 581us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:41:00.528451 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:41:00.530682 (+ 2231us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.240.254:35557: Server oryx/127.20.240.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":248,"thread_start_us":79,"threads_started":1}
W20260808 04:41:00.531095 31157 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 04:41:00.525037 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.240.193:36639 (local address 127.20.240.254:35557)
0808 04:41:00.525336 (+ 299us) server_negotiation.cc:206] Beginning negotiation
0808 04:41:00.525340 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:41:00.525355 (+ 15us) server_negotiation.cc:407] Connection header received
0808 04:41:00.525440 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:41:00.525442 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:41:00.525484 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:41:00.525560 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:41:00.526011 (+ 451us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:41:00.526571 (+ 560us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:41:00.527423 (+ 852us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:41:00.527657 (+ 234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:41:00.527755 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:41:00.530828 (+ 3073us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.240.193:36639: BlockingRecv error: recv got EOF from 127.20.240.193:36639 (error 108)
Metrics: {"server-negotiator.queue_time_us":224,"thread_start_us":110,"threads_started":1}
Aug 08 04:41:00 dist-test-slave-vxj2 krb5kdc[30050](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.240.194@KRBTEST.COM for oryx/127.20.240.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 04:41:00 dist-test-slave-vxj2 krb5kdc[30050](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.240.194@KRBTEST.COM for oryx/127.20.240.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 04:41:00.723883 31158 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:41:00.718164 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:35557 (local address 127.20.240.194:35749)
0808 04:41:00.718558 (+ 394us) negotiation.cc:107] Waiting for socket to connect
0808 04:41:00.718581 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0808 04:41:00.718728 (+ 147us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:41:00.719013 (+ 285us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:41:00.719016 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:41:00.719243 (+ 227us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:41:00.719338 (+ 95us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:41:00.719344 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:41:00.720135 (+ 791us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:41:00.720140 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:41:00.720703 (+ 563us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:41:00.720711 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:41:00.721211 (+ 500us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:41:00.721214 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:41:00.721305 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:41:00.721826 (+ 521us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:41:00.721841 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:41:00.723758 (+ 1917us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.240.254:35557: Server oryx/127.20.240.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":311,"thread_start_us":92,"threads_started":1}
W20260808 04:41:00.724035 31157 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 04:41:00.718308 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.240.194:35749 (local address 127.20.240.254:35557)
0808 04:41:00.718517 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0808 04:41:00.718522 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 04:41:00.718667 (+ 145us) server_negotiation.cc:407] Connection header received
0808 04:41:00.718835 (+ 168us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:41:00.718839 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:41:00.718894 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:41:00.718991 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:41:00.719461 (+ 470us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:41:00.720018 (+ 557us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:41:00.720826 (+ 808us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:41:00.721054 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:41:00.721193 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:41:00.723910 (+ 2717us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.240.194:35749: BlockingRecv error: recv got EOF from 127.20.240.194:35749 (error 108)
Metrics: {"server-negotiator.queue_time_us":91}
Aug 08 04:41:00 dist-test-slave-vxj2 krb5kdc[30050](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.240.195@KRBTEST.COM for oryx/127.20.240.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 04:41:00 dist-test-slave-vxj2 krb5kdc[30050](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.240.195@KRBTEST.COM for oryx/127.20.240.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 04:41:00.975361 31159 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:41:00.969190 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:35557 (local address 127.20.240.195:47177)
0808 04:41:00.969538 (+ 348us) negotiation.cc:107] Waiting for socket to connect
0808 04:41:00.969555 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 04:41:00.969709 (+ 154us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:41:00.970006 (+ 297us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:41:00.970009 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:41:00.970233 (+ 224us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:41:00.970331 (+ 98us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:41:00.970337 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:41:00.971135 (+ 798us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:41:00.971140 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:41:00.971703 (+ 563us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:41:00.971712 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:41:00.972278 (+ 566us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:41:00.972282 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:41:00.972371 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:41:00.972873 (+ 502us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:41:00.972885 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:41:00.975237 (+ 2352us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.240.254:35557: Server oryx/127.20.240.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":264,"thread_start_us":109,"threads_started":1}
W20260808 04:41:00.975497 31157 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 04:41:00.969335 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.240.195:47177 (local address 127.20.240.254:35557)
0808 04:41:00.969519 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0808 04:41:00.969524 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 04:41:00.969643 (+ 119us) server_negotiation.cc:407] Connection header received
0808 04:41:00.969823 (+ 180us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:41:00.969828 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:41:00.969880 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:41:00.969969 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:41:00.970488 (+ 519us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:41:00.971017 (+ 529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:41:00.971833 (+ 816us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:41:00.972140 (+ 307us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:41:00.972260 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:41:00.975376 (+ 3116us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.240.195:47177: BlockingRecv error: recv got EOF from 127.20.240.195:47177 (error 108)
Metrics: {"server-negotiator.queue_time_us":71}
Aug 08 04:41:01 dist-test-slave-vxj2 krb5kdc[30050](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.240.193@KRBTEST.COM for oryx/127.20.240.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 04:41:01 dist-test-slave-vxj2 krb5kdc[30050](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.240.193@KRBTEST.COM for oryx/127.20.240.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 04:41:01.537873 31160 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:41:01.531796 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:35557 (local address 127.20.240.193:59099)
0808 04:41:01.532091 (+ 295us) negotiation.cc:107] Waiting for socket to connect
0808 04:41:01.532108 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 04:41:01.532237 (+ 129us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:41:01.532530 (+ 293us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:41:01.532533 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:41:01.532722 (+ 189us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:41:01.532835 (+ 113us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:41:01.532841 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:41:01.533684 (+ 843us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:41:01.533687 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:41:01.534277 (+ 590us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:41:01.534286 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:41:01.534791 (+ 505us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:41:01.534795 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:41:01.534863 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:41:01.535389 (+ 526us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:41:01.535402 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:41:01.537678 (+ 2276us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.240.254:35557: Server oryx/127.20.240.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":205,"thread_start_us":106,"threads_started":1}
W20260808 04:41:01.537966 31161 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 04:41:01.531853 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.240.193:59099 (local address 127.20.240.254:35557)
0808 04:41:01.532175 (+ 322us) server_negotiation.cc:206] Beginning negotiation
0808 04:41:01.532182 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 04:41:01.532201 (+ 19us) server_negotiation.cc:407] Connection header received
0808 04:41:01.532359 (+ 158us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:41:01.532364 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:41:01.532432 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:41:01.532514 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:41:01.532942 (+ 428us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:41:01.533576 (+ 634us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:41:01.534401 (+ 825us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:41:01.534628 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:41:01.534709 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:41:01.537830 (+ 3121us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.240.193:59099: BlockingRecv error: recv got EOF from 127.20.240.193:59099 (error 108)
Metrics: {"server-negotiator.queue_time_us":227,"thread_start_us":87,"threads_started":1}
Aug 08 04:41:01 dist-test-slave-vxj2 krb5kdc[30050](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.240.194@KRBTEST.COM for oryx/127.20.240.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 04:41:01 dist-test-slave-vxj2 krb5kdc[30050](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.240.194@KRBTEST.COM for oryx/127.20.240.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 04:41:01.731184 31162 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:41:01.724874 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:35557 (local address 127.20.240.194:49153)
0808 04:41:01.725290 (+ 416us) negotiation.cc:107] Waiting for socket to connect
0808 04:41:01.725310 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0808 04:41:01.725474 (+ 164us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:41:01.725775 (+ 301us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:41:01.725778 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:41:01.726019 (+ 241us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:41:01.726120 (+ 101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:41:01.726126 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:41:01.727056 (+ 930us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:41:01.727061 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:41:01.727633 (+ 572us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:41:01.727642 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:41:01.728136 (+ 494us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:41:01.728141 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:41:01.728247 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:41:01.728824 (+ 577us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:41:01.728837 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:41:01.731000 (+ 2163us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.240.254:35557: Server oryx/127.20.240.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":313,"thread_start_us":131,"threads_started":1}
W20260808 04:41:01.731223 31161 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 04:41:01.725092 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.240.194:49153 (local address 127.20.240.254:35557)
0808 04:41:01.725289 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0808 04:41:01.725294 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 04:41:01.725407 (+ 113us) server_negotiation.cc:407] Connection header received
0808 04:41:01.725584 (+ 177us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:41:01.725589 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:41:01.725645 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:41:01.725758 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:41:01.726258 (+ 500us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:41:01.726926 (+ 668us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:41:01.727773 (+ 847us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:41:01.728009 (+ 236us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:41:01.728132 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:41:01.731123 (+ 2991us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.240.194:49153: BlockingRecv error: recv got EOF from 127.20.240.194:49153 (error 108)
Metrics: {"server-negotiator.queue_time_us":89}
Aug 08 04:41:01 dist-test-slave-vxj2 krb5kdc[30050](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.240.195@KRBTEST.COM for oryx/127.20.240.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 04:41:01 dist-test-slave-vxj2 krb5kdc[30050](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.240.195@KRBTEST.COM for oryx/127.20.240.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 04:41:01.981878 31163 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:41:01.976255 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:35557 (local address 127.20.240.195:48093)
0808 04:41:01.976547 (+ 292us) negotiation.cc:107] Waiting for socket to connect
0808 04:41:01.976561 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 04:41:01.976660 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:41:01.976926 (+ 266us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:41:01.976928 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:41:01.977122 (+ 194us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:41:01.977287 (+ 165us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:41:01.977293 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:41:01.978043 (+ 750us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:41:01.978045 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:41:01.978606 (+ 561us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:41:01.978614 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:41:01.979110 (+ 496us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:41:01.979113 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:41:01.979184 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:41:01.979766 (+ 582us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:41:01.979778 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:41:01.981746 (+ 1968us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.240.254:35557: Server oryx/127.20.240.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":217,"thread_start_us":107,"threads_started":1}
W20260808 04:41:01.982105 31161 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 04:41:01.976309 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.240.195:48093 (local address 127.20.240.254:35557)
0808 04:41:01.976460 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0808 04:41:01.976465 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 04:41:01.976633 (+ 168us) server_negotiation.cc:407] Connection header received
0808 04:41:01.976740 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:41:01.976742 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:41:01.976792 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:41:01.976851 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:41:01.977392 (+ 541us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:41:01.977916 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:41:01.978718 (+ 802us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:41:01.978964 (+ 246us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:41:01.979055 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:41:01.981967 (+ 2912us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.240.195:48093: BlockingRecv error: recv got EOF from 127.20.240.195:48093 (error 108)
Metrics: {"server-negotiator.queue_time_us":56}
Aug 08 04:41:02 dist-test-slave-vxj2 krb5kdc[30050](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.240.193@KRBTEST.COM for oryx/127.20.240.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 04:41:02 dist-test-slave-vxj2 krb5kdc[30050](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.240.193@KRBTEST.COM for oryx/127.20.240.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 04:41:02.544481 31164 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:41:02.538756 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:35557 (local address 127.20.240.193:51201)
0808 04:41:02.539055 (+ 299us) negotiation.cc:107] Waiting for socket to connect
0808 04:41:02.539068 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 04:41:02.539161 (+ 93us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:41:02.539439 (+ 278us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:41:02.539441 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:41:02.539635 (+ 194us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:41:02.539737 (+ 102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:41:02.539743 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:41:02.540546 (+ 803us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:41:02.540549 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:41:02.541144 (+ 595us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:41:02.541186 (+ 42us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:41:02.541664 (+ 478us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:41:02.541666 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:41:02.541732 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:41:02.542282 (+ 550us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:41:02.542295 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:41:02.544355 (+ 2060us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.240.254:35557: Server oryx/127.20.240.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":210,"thread_start_us":113,"threads_started":1}
W20260808 04:41:02.544690 31165 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 04:41:02.538824 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.240.193:51201 (local address 127.20.240.254:35557)
0808 04:41:02.539183 (+ 359us) server_negotiation.cc:206] Beginning negotiation
0808 04:41:02.539187 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:41:02.539205 (+ 18us) server_negotiation.cc:407] Connection header received
0808 04:41:02.539244 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:41:02.539246 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:41:02.539289 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:41:02.539384 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:41:02.539880 (+ 496us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:41:02.540434 (+ 554us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:41:02.541309 (+ 875us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:41:02.541549 (+ 240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:41:02.541633 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:41:02.544505 (+ 2872us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.240.193:51201: BlockingRecv error: recv got EOF from 127.20.240.193:51201 (error 108)
Metrics: {"server-negotiator.queue_time_us":273,"thread_start_us":93,"threads_started":1}
Aug 08 04:41:02 dist-test-slave-vxj2 krb5kdc[30050](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.240.194@KRBTEST.COM for oryx/127.20.240.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 04:41:02 dist-test-slave-vxj2 krb5kdc[30050](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.240.194@KRBTEST.COM for oryx/127.20.240.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 04:41:02.738647 31166 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:41:02.732249 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:35557 (local address 127.20.240.194:55721)
0808 04:41:02.732559 (+ 310us) negotiation.cc:107] Waiting for socket to connect
0808 04:41:02.732573 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 04:41:02.732709 (+ 136us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:41:02.732982 (+ 273us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:41:02.732984 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:41:02.733215 (+ 231us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:41:02.733316 (+ 101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:41:02.733322 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:41:02.734145 (+ 823us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:41:02.734148 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:41:02.734787 (+ 639us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:41:02.734801 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:41:02.735375 (+ 574us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:41:02.735379 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:41:02.735500 (+ 121us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:41:02.736115 (+ 615us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:41:02.736130 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:41:02.738500 (+ 2370us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.240.254:35557: Server oryx/127.20.240.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":213,"thread_start_us":94,"threads_started":1}
W20260808 04:41:02.738822 31165 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 04:41:02.732426 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.240.194:55721 (local address 127.20.240.254:35557)
0808 04:41:02.732620 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0808 04:41:02.732624 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:41:02.732641 (+ 17us) server_negotiation.cc:407] Connection header received
0808 04:41:02.732807 (+ 166us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:41:02.732810 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:41:02.732863 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:41:02.732936 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:41:02.733435 (+ 499us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:41:02.734014 (+ 579us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:41:02.734964 (+ 950us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:41:02.735234 (+ 270us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:41:02.735360 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:41:02.738657 (+ 3297us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.240.194:55721: BlockingRecv error: recv got EOF from 127.20.240.194:55721 (error 108)
Metrics: {"server-negotiator.queue_time_us":88}
Aug 08 04:41:02 dist-test-slave-vxj2 krb5kdc[30050](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.240.195@KRBTEST.COM for oryx/127.20.240.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 04:41:02 dist-test-slave-vxj2 krb5kdc[30050](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.240.195@KRBTEST.COM for oryx/127.20.240.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 04:41:02.988428 31167 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:41:02.982812 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:35557 (local address 127.20.240.195:55423)
0808 04:41:02.983091 (+ 279us) negotiation.cc:107] Waiting for socket to connect
0808 04:41:02.983106 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 04:41:02.983203 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:41:02.983475 (+ 272us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:41:02.983477 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:41:02.983653 (+ 176us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:41:02.983775 (+ 122us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:41:02.983782 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:41:02.984589 (+ 807us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:41:02.984594 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:41:02.985144 (+ 550us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:41:02.985201 (+ 57us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:41:02.985669 (+ 468us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:41:02.985673 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:41:02.985755 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:41:02.986266 (+ 511us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:41:02.986277 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:41:02.988238 (+ 1961us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.240.254:35557: Server oryx/127.20.240.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":194,"thread_start_us":111,"threads_started":1}
W20260808 04:41:02.988781 31165 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 04:41:02.982863 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.240.195:55423 (local address 127.20.240.254:35557)
0808 04:41:02.983008 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0808 04:41:02.983012 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:41:02.983199 (+ 187us) server_negotiation.cc:407] Connection header received
0808 04:41:02.983278 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:41:02.983281 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:41:02.983334 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:41:02.983470 (+ 136us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:41:02.983913 (+ 443us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:41:02.984471 (+ 558us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:41:02.985313 (+ 842us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:41:02.985551 (+ 238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:41:02.985665 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:41:02.988392 (+ 2727us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.240.195:55423: BlockingRecv error: recv got EOF from 127.20.240.195:55423 (error 108)
Metrics: {"server-negotiator.queue_time_us":60}
Aug 08 04:41:03 dist-test-slave-vxj2 krb5kdc[30050](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.240.193@KRBTEST.COM for oryx/127.20.240.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 04:41:03 dist-test-slave-vxj2 krb5kdc[30050](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.240.193@KRBTEST.COM for oryx/127.20.240.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 04:41:03.551581 31168 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:41:03.545608 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:35557 (local address 127.20.240.193:40487)
0808 04:41:03.545937 (+ 329us) negotiation.cc:107] Waiting for socket to connect
0808 04:41:03.545952 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 04:41:03.546050 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:41:03.546355 (+ 305us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:41:03.546357 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:41:03.546560 (+ 203us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:41:03.546656 (+ 96us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:41:03.546661 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:41:03.547475 (+ 814us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:41:03.547478 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:41:03.548049 (+ 571us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:41:03.548057 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:41:03.548573 (+ 516us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:41:03.548576 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:41:03.548643 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:41:03.549338 (+ 695us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:41:03.549352 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:41:03.551426 (+ 2074us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.240.254:35557: Server oryx/127.20.240.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":219,"thread_start_us":109,"threads_started":1}
W20260808 04:41:03.551805 31169 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 04:41:03.545653 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.240.193:40487 (local address 127.20.240.254:35557)
0808 04:41:03.545927 (+ 274us) server_negotiation.cc:206] Beginning negotiation
0808 04:41:03.545930 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 04:41:03.546029 (+ 99us) server_negotiation.cc:407] Connection header received
0808 04:41:03.546177 (+ 148us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:41:03.546180 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:41:03.546230 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:41:03.546315 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:41:03.546773 (+ 458us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:41:03.547357 (+ 584us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:41:03.548174 (+ 817us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:41:03.548421 (+ 247us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:41:03.548522 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:41:03.551615 (+ 3093us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.240.193:40487: BlockingRecv error: recv got EOF from 127.20.240.193:40487 (error 108)
Metrics: {"server-negotiator.queue_time_us":180,"thread_start_us":66,"threads_started":1}
Aug 08 04:41:03 dist-test-slave-vxj2 krb5kdc[30050](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.240.194@KRBTEST.COM for oryx/127.20.240.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 04:41:03 dist-test-slave-vxj2 krb5kdc[30050](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.240.194@KRBTEST.COM for oryx/127.20.240.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 04:41:03.745891 31170 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:41:03.739709 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:35557 (local address 127.20.240.194:57547)
0808 04:41:03.740182 (+ 473us) negotiation.cc:107] Waiting for socket to connect
0808 04:41:03.740205 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0808 04:41:03.740354 (+ 149us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:41:03.740672 (+ 318us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:41:03.740676 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:41:03.740914 (+ 238us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:41:03.741039 (+ 125us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:41:03.741046 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:41:03.741855 (+ 809us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:41:03.741861 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:41:03.742430 (+ 569us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:41:03.742439 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:41:03.742933 (+ 494us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:41:03.742936 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:41:03.743025 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:41:03.743626 (+ 601us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:41:03.743638 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:41:03.745709 (+ 2071us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.240.254:35557: Server oryx/127.20.240.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":375,"thread_start_us":110,"threads_started":1}
W20260808 04:41:03.746003 31169 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 04:41:03.739913 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.240.194:57547 (local address 127.20.240.254:35557)
0808 04:41:03.740106 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0808 04:41:03.740111 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 04:41:03.740274 (+ 163us) server_negotiation.cc:407] Connection header received
0808 04:41:03.740481 (+ 207us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:41:03.740485 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:41:03.740546 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:41:03.740647 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:41:03.741194 (+ 547us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:41:03.741739 (+ 545us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:41:03.742557 (+ 818us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:41:03.742796 (+ 239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:41:03.742926 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:41:03.745879 (+ 2953us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.240.194:57547: BlockingRecv error: recv got EOF from 127.20.240.194:57547 (error 108)
Metrics: {"server-negotiator.queue_time_us":76}
I20260808 04:41:03.861805 21443 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu with pid 30667
I20260808 04:41:03.869927 21443 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu with pid 30831
I20260808 04:41:03.877837 21443 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu with pid 30968
I20260808 04:41:03.884938 21443 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu with pid 30593
2026-08-08T04:41:03Z chronyd exiting
[ OK ] SecurityITest.TestMismatchingPrincipals (18252 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationInsecureCluster
2026-08-08T04:41:03Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T04:41:03Z Disabled control of system clock
I20260808 04:41:03.920830 21443 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
/tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786164000593138-21443-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786164000593138-21443-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786164000593138-21443-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786164000593138-21443-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.240.254:37559
--webserver_interface=127.20.240.254
--webserver_port=0
--builtin_ntp_servers=127.20.240.212:44321
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.240.254:37559
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260808 04:41:04.040055 31174 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:41:04.040395 31174 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:41:04.040434 31174 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:41:04.044773 31174 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 04:41:04.044876 31174 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:41:04.044893 31174 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:41:04.044909 31174 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 04:41:04.044927 31174 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 04:41:04.050230 31174 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.240.212:44321
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786164000593138-21443-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786164000593138-21443-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.240.254:37559
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.240.254:37559
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786164000593138-21443-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.240.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31174
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786164000593138-21443-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 04:05:18 UTC on ccycloud.quasar-drfdgt.root.comops.site
build id 4574101
I20260808 04:41:04.051436 31174 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:41:04.052881 31174 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260808 04:41:04.062279 31174 server_base.cc:1034] running on GCE node
W20260808 04:41:04.062215 31179 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:41:04.062213 31182 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:41:04.062213 31180 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:41:04.063200 31174 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:41:04.064483 31174 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:41:04.065660 31174 hybrid_clock.cc:648] HybridClock initialized: now 1786164064065599 us; error 77 us; skew 500 ppm
I20260808 04:41:04.072746 31174 webserver.cc:460] Webserver started at http://127.20.240.254:45179/ using document root <none> and password file <none>
I20260808 04:41:04.073612 31174 fs_manager.cc:359] Metadata directory not provided
I20260808 04:41:04.073697 31174 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:41:04.073949 31174 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 04:41:04.076979 31174 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786164000593138-21443-0/minicluster-data/master-0/data/instance:
uuid: "65be45d7267449809d4eb8e6f9a401dc"
format_stamp: "Formatted at 2026-08-08 04:41:04 on dist-test-slave-vxj2"
server_key: "b3133f4caac7d33580f1377ba4bb08b2"
server_key_iv: "dcbd4a0df060b601aa0ca86cd7606e8b"
server_key_version: "encryptionkey@0"
I20260808 04:41:04.077769 31174 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786164000593138-21443-0/minicluster-data/master-0/wal/instance:
uuid: "65be45d7267449809d4eb8e6f9a401dc"
format_stamp: "Formatted at 2026-08-08 04:41:04 on dist-test-slave-vxj2"
server_key: "b3133f4caac7d33580f1377ba4bb08b2"
server_key_iv: "dcbd4a0df060b601aa0ca86cd7606e8b"
server_key_version: "encryptionkey@0"
I20260808 04:41:04.082171 31174 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260808 04:41:04.084800 31188 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:41:04.086230 31174 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260808 04:41:04.086383 31174 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786164000593138-21443-0/minicluster-data/master-0/data,/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786164000593138-21443-0/minicluster-data/master-0/wal
uuid: "65be45d7267449809d4eb8e6f9a401dc"
format_stamp: "Formatted at 2026-08-08 04:41:04 on dist-test-slave-vxj2"
server_key: "b3133f4caac7d33580f1377ba4bb08b2"
server_key_iv: "dcbd4a0df060b601aa0ca86cd7606e8b"
server_key_version: "encryptionkey@0"
I20260808 04:41:04.086525 31174 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786164000593138-21443-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786164000593138-21443-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786164000593138-21443-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:41:04.101251 31174 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:41:04.102031 31174 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:41:04.102247 31174 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:41:04.110138 31174 rpc_server.cc:307] RPC server started. Bound to: 127.20.240.254:37559
I20260808 04:41:04.110149 31245 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.240.254:37559 every 8 connection(s)
I20260808 04:41:04.111215 31174 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786164000593138-21443-0/minicluster-data/master-0/data/info.pb
I20260808 04:41:04.114648 31246 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:41:04.117867 21443 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu as pid 31174
I20260808 04:41:04.117988 21443 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786164000593138-21443-0/minicluster-data/master-0/wal/instance
I20260808 04:41:04.118309 21443 external_mini_cluster.cc:1428] Setting key 9939156680edf91faadb1d518e912298
I20260808 04:41:04.121047 31246 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 65be45d7267449809d4eb8e6f9a401dc: Bootstrap starting.
I20260808 04:41:04.123414 31246 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 65be45d7267449809d4eb8e6f9a401dc: Neither blocks nor log segments found. Creating new log.
I20260808 04:41:04.124167 31246 log.cc:824] T 00000000000000000000000000000000 P 65be45d7267449809d4eb8e6f9a401dc: Log is configured to *not* fsync() on all Append() calls
I20260808 04:41:04.126176 31246 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 65be45d7267449809d4eb8e6f9a401dc: No bootstrap required, opened a new log
I20260808 04:41:04.127763 31249 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:41:04.119846 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57828 (local address 127.20.240.254:37559)
0808 04:41:04.120519 (+ 673us) server_negotiation.cc:206] Beginning negotiation
0808 04:41:04.120535 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0808 04:41:04.120571 (+ 36us) server_negotiation.cc:407] Connection header received
0808 04:41:04.121347 (+ 776us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:41:04.121368 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:41:04.121770 (+ 402us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:41:04.122105 (+ 335us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:41:04.122546 (+ 441us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:41:04.123547 (+ 1001us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:41:04.124482 (+ 935us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:41:04.124968 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:41:04.125139 (+ 171us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:41:04.126053 (+ 914us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:41:04.126058 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:41:04.126070 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 04:41:04.126512 (+ 442us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:41:04.126571 (+ 59us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 04:41:04.126591 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:41:04.126698 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0808 04:41:04.126832 (+ 134us) server_negotiation.cc:299] Negotiation successful
0808 04:41:04.127084 (+ 252us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":313,"thread_start_us":135,"threads_started":1}
I20260808 04:41:04.130023 31246 raft_consensus.cc:348] T 00000000000000000000000000000000 P 65be45d7267449809d4eb8e6f9a401dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "65be45d7267449809d4eb8e6f9a401dc" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 37559 } }
I20260808 04:41:04.130278 31246 raft_consensus.cc:374] T 00000000000000000000000000000000 P 65be45d7267449809d4eb8e6f9a401dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:41:04.130362 31246 raft_consensus.cc:729] T 00000000000000000000000000000000 P 65be45d7267449809d4eb8e6f9a401dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65be45d7267449809d4eb8e6f9a401dc, State: Initialized, Role: FOLLOWER
I20260808 04:41:04.130777 31246 consensus_queue.cc:260] T 00000000000000000000000000000000 P 65be45d7267449809d4eb8e6f9a401dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "65be45d7267449809d4eb8e6f9a401dc" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 37559 } }
I20260808 04:41:04.130937 31246 raft_consensus.cc:388] T 00000000000000000000000000000000 P 65be45d7267449809d4eb8e6f9a401dc [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 04:41:04.131023 31246 raft_consensus.cc:482] T 00000000000000000000000000000000 P 65be45d7267449809d4eb8e6f9a401dc [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 04:41:04.131140 31246 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 65be45d7267449809d4eb8e6f9a401dc [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:41:04.132124 31246 raft_consensus.cc:504] T 00000000000000000000000000000000 P 65be45d7267449809d4eb8e6f9a401dc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "65be45d7267449809d4eb8e6f9a401dc" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 37559 } }
I20260808 04:41:04.132483 31246 leader_election.cc:302] T 00000000000000000000000000000000 P 65be45d7267449809d4eb8e6f9a401dc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 65be45d7267449809d4eb8e6f9a401dc; no voters:
I20260808 04:41:04.132818 31246 leader_election.cc:288] T 00000000000000000000000000000000 P 65be45d7267449809d4eb8e6f9a401dc [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 04:41:04.132941 31251 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 65be45d7267449809d4eb8e6f9a401dc [term 1 FOLLOWER]: Leader election won for term 1
I20260808 04:41:04.133193 31251 raft_consensus.cc:686] T 00000000000000000000000000000000 P 65be45d7267449809d4eb8e6f9a401dc [term 1 LEADER]: Becoming Leader. State: Replica: 65be45d7267449809d4eb8e6f9a401dc, State: Running, Role: LEADER
I20260808 04:41:04.133597 31251 consensus_queue.cc:237] T 00000000000000000000000000000000 P 65be45d7267449809d4eb8e6f9a401dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "65be45d7267449809d4eb8e6f9a401dc" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 37559 } }
I20260808 04:41:04.134310 31246 sys_catalog.cc:564] T 00000000000000000000000000000000 P 65be45d7267449809d4eb8e6f9a401dc [sys.catalog]: configured and running, proceeding with master startup.
I20260808 04:41:04.134801 31253 sys_catalog.cc:455] T 00000000000000000000000000000000 P 65be45d7267449809d4eb8e6f9a401dc [sys.catalog]: SysCatalogTable state changed. Reason: New leader 65be45d7267449809d4eb8e6f9a401dc. Latest consensus state: current_term: 1 leader_uuid: "65be45d7267449809d4eb8e6f9a401dc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "65be45d7267449809d4eb8e6f9a401dc" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 37559 } } }
I20260808 04:41:04.134925 31253 sys_catalog.cc:458] T 00000000000000000000000000000000 P 65be45d7267449809d4eb8e6f9a401dc [sys.catalog]: This master's current role is: LEADER
I20260808 04:41:04.135268 31252 sys_catalog.cc:455] T 00000000000000000000000000000000 P 65be45d7267449809d4eb8e6f9a401dc [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "65be45d7267449809d4eb8e6f9a401dc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "65be45d7267449809d4eb8e6f9a401dc" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 37559 } } }
I20260808 04:41:04.135439 31255 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 04:41:04.135464 31252 sys_catalog.cc:458] T 00000000000000000000000000000000 P 65be45d7267449809d4eb8e6f9a401dc [sys.catalog]: This master's current role is: LEADER
I20260808 04:41:04.138677 31255 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 04:41:04.144639 31255 catalog_manager.cc:1347] Generated new cluster ID: f9332d2dfe544bb0b5a0bf31fdb19fdb
I20260808 04:41:04.144750 31255 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 04:41:04.154798 31255 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 04:41:04.156107 31255 catalog_manager.cc:1504] Loading token signing keys...
I20260808 04:41:04.172447 31255 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 65be45d7267449809d4eb8e6f9a401dc: Generated new TSK 0
I20260808 04:41:04.173424 31255 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 04:41:04.184116 21443 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
/tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786164000593138-21443-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786164000593138-21443-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786164000593138-21443-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786164000593138-21443-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.240.193:0
--local_ip_for_outbound_sockets=127.20.240.193
--webserver_interface=127.20.240.193
--webserver_port=0
--tserver_master_addrs=127.20.240.254:37559
--builtin_ntp_servers=127.20.240.212:44321
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
W20260808 04:41:04.301419 31271 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:41:04.301703 31271 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:41:04.301744 31271 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:41:04.305943 31271 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:41:04.306010 31271 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:41:04.306066 31271 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.240.193
I20260808 04:41:04.311033 31271 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.240.212:44321
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786164000593138-21443-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786164000593138-21443-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.240.193:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786164000593138-21443-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.240.193
--webserver_port=0
--tserver_master_addrs=127.20.240.254:37559
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31271
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.240.193
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786164000593138-21443-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 04:05:18 UTC on ccycloud.quasar-drfdgt.root.comops.site
build id 4574101
I20260808 04:41:04.312258 31271 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:41:04.313772 31271 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:41:04.324282 31278 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:41:04.324282 31280 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:41:04.324306 31277 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:41:04.324703 31271 server_base.cc:1034] running on GCE node
I20260808 04:41:04.325114 31271 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:41:04.325829 31271 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:41:04.327049 31271 hybrid_clock.cc:648] HybridClock initialized: now 1786164064327030 us; error 29 us; skew 500 ppm
I20260808 04:41:04.329039 31271 webserver.cc:460] Webserver started at http://127.20.240.193:33831/ using document root <none> and password file <none>
I20260808 04:41:04.329824 31271 fs_manager.cc:359] Metadata directory not provided
I20260808 04:41:04.329895 31271 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:41:04.330209 31271 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 04:41:04.332500 31271 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786164000593138-21443-0/minicluster-data/ts-0/data/instance:
uuid: "bc0af92f18044f14955f06a6f2b2f95c"
format_stamp: "Formatted at 2026-08-08 04:41:04 on dist-test-slave-vxj2"
server_key: "68f0040d6d039eb7b3ab6fbd5b265dbf"
server_key_iv: "4b0abc15d77fad6693d26aed6da0a8f6"
server_key_version: "encryptionkey@0"
I20260808 04:41:04.333096 31271 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786164000593138-21443-0/minicluster-data/ts-0/wal/instance:
uuid: "bc0af92f18044f14955f06a6f2b2f95c"
format_stamp: "Formatted at 2026-08-08 04:41:04 on dist-test-slave-vxj2"
server_key: "68f0040d6d039eb7b3ab6fbd5b265dbf"
server_key_iv: "4b0abc15d77fad6693d26aed6da0a8f6"
server_key_version: "encryptionkey@0"
I20260808 04:41:04.337404 31271 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260808 04:41:04.340160 31286 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:41:04.341660 31271 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 04:41:04.341789 31271 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786164000593138-21443-0/minicluster-data/ts-0/data,/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786164000593138-21443-0/minicluster-data/ts-0/wal
uuid: "bc0af92f18044f14955f06a6f2b2f95c"
format_stamp: "Formatted at 2026-08-08 04:41:04 on dist-test-slave-vxj2"
server_key: "68f0040d6d039eb7b3ab6fbd5b265dbf"
server_key_iv: "4b0abc15d77fad6693d26aed6da0a8f6"
server_key_version: "encryptionkey@0"
I20260808 04:41:04.341915 31271 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786164000593138-21443-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786164000593138-21443-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786164000593138-21443-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:41:04.354578 31271 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:41:04.355306 31271 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:41:04.355523 31271 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:41:04.356151 31271 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 04:41:04.357245 31271 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 04:41:04.357311 31271 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 04:41:04.357386 31271 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 04:41:04.357434 31271 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 04:41:04.366400 31271 rpc_server.cc:307] RPC server started. Bound to: 127.20.240.193:33335
I20260808 04:41:04.366420 31410 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.240.193:33335 every 8 connection(s)
I20260808 04:41:04.367370 31271 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786164000593138-21443-0/minicluster-data/ts-0/data/info.pb
I20260808 04:41:04.371440 21443 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu as pid 31271
I20260808 04:41:04.371556 21443 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786164000593138-21443-0/minicluster-data/ts-0/wal/instance
I20260808 04:41:04.371834 21443 external_mini_cluster.cc:1428] Setting key 42da2e274729b49d99814597710c7795
I20260808 04:41:04.374037 21443 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
/tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786164000593138-21443-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786164000593138-21443-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786164000593138-21443-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786164000593138-21443-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.240.194:0
--local_ip_for_outbound_sockets=127.20.240.194
--webserver_interface=127.20.240.194
--webserver_port=0
--tserver_master_addrs=127.20.240.254:37559
--builtin_ntp_servers=127.20.240.212:44321
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260808 04:41:04.377751 31249 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:41:04.369288 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.240.193:58795 (local address 127.20.240.254:37559)
0808 04:41:04.369435 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0808 04:41:04.369439 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:41:04.370523 (+ 1084us) server_negotiation.cc:407] Connection header received
0808 04:41:04.372068 (+ 1545us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:41:04.372073 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:41:04.372134 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:41:04.372223 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:41:04.373238 (+ 1015us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:41:04.374018 (+ 780us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:41:04.375399 (+ 1381us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:41:04.375663 (+ 264us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:41:04.375745 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:41:04.377094 (+ 1349us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:41:04.377101 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:41:04.377107 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 04:41:04.377126 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:41:04.377174 (+ 48us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 04:41:04.377188 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:41:04.377285 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0808 04:41:04.377456 (+ 171us) server_negotiation.cc:299] Negotiation successful
0808 04:41:04.377534 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260808 04:41:04.378580 31413 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:41:04.369679 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:37559 (local address 127.20.240.193:58795)
0808 04:41:04.370370 (+ 691us) negotiation.cc:107] Waiting for socket to connect
0808 04:41:04.370410 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0808 04:41:04.371793 (+ 1383us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:41:04.372428 (+ 635us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:41:04.372440 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:41:04.372543 (+ 103us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:41:04.373065 (+ 522us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:41:04.373079 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:41:04.374293 (+ 1214us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:41:04.374299 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:41:04.375245 (+ 946us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:41:04.375258 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:41:04.375829 (+ 571us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:41:04.375834 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:41:04.376063 (+ 229us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:41:04.376820 (+ 757us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 04:41:04.376822 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:41:04.376863 (+ 41us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 04:41:04.376936 (+ 73us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:41:04.377293 (+ 357us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:41:04.377301 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:41:04.377306 (+ 5us) client_negotiation.cc:769] Sending connection context
0808 04:41:04.377427 (+ 121us) client_negotiation.cc:240] Negotiation successful
0808 04:41:04.377664 (+ 237us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":303,"thread_start_us":117,"threads_started":1}
I20260808 04:41:04.379935 31411 heartbeater.cc:347] Connected to a master server at 127.20.240.254:37559
I20260808 04:41:04.380193 31411 heartbeater.cc:464] Registering TS with master...
I20260808 04:41:04.380815 31411 heartbeater.cc:511] Master 127.20.240.254:37559 requested a full tablet report, sending...
I20260808 04:41:04.382431 31206 ts_manager.cc:194] Registered new tserver with Master: bc0af92f18044f14955f06a6f2b2f95c (127.20.240.193:33335)
I20260808 04:41:04.383627 31206 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.20.240.193:58795
W20260808 04:41:04.491647 31414 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:41:04.491935 31414 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:41:04.491973 31414 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:41:04.496186 31414 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:41:04.496265 31414 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:41:04.496322 31414 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.240.194
I20260808 04:41:04.501195 31414 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.240.212:44321
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786164000593138-21443-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786164000593138-21443-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.240.194:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786164000593138-21443-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.240.194
--webserver_port=0
--tserver_master_addrs=127.20.240.254:37559
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31414
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.240.194
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786164000593138-21443-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 04:05:18 UTC on ccycloud.quasar-drfdgt.root.comops.site
build id 4574101
I20260808 04:41:04.502403 31414 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:41:04.503854 31414 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:41:04.513924 31419 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:41:04.513924 31422 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:41:04.513970 31420 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:41:04.514219 31414 server_base.cc:1034] running on GCE node
I20260808 04:41:04.514765 31414 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:41:04.515571 31414 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:41:04.516824 31414 hybrid_clock.cc:648] HybridClock initialized: now 1786164064516802 us; error 33 us; skew 500 ppm
I20260808 04:41:04.518908 31414 webserver.cc:460] Webserver started at http://127.20.240.194:36577/ using document root <none> and password file <none>
I20260808 04:41:04.519547 31414 fs_manager.cc:359] Metadata directory not provided
I20260808 04:41:04.519649 31414 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:41:04.519901 31414 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 04:41:04.522171 31414 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786164000593138-21443-0/minicluster-data/ts-1/data/instance:
uuid: "eb87c12845314de3b41e733d8f36ce7c"
format_stamp: "Formatted at 2026-08-08 04:41:04 on dist-test-slave-vxj2"
server_key: "64a51ba65cc9fdef47a998f6de6e9ecd"
server_key_iv: "292d1a65e3d7fb7bd018a1e0e754eac7"
server_key_version: "encryptionkey@0"
I20260808 04:41:04.522778 31414 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786164000593138-21443-0/minicluster-data/ts-1/wal/instance:
uuid: "eb87c12845314de3b41e733d8f36ce7c"
format_stamp: "Formatted at 2026-08-08 04:41:04 on dist-test-slave-vxj2"
server_key: "64a51ba65cc9fdef47a998f6de6e9ecd"
server_key_iv: "292d1a65e3d7fb7bd018a1e0e754eac7"
server_key_version: "encryptionkey@0"
I20260808 04:41:04.526652 31414 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260808 04:41:04.529410 31428 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:41:04.530689 31414 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 04:41:04.530884 31414 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786164000593138-21443-0/minicluster-data/ts-1/data,/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786164000593138-21443-0/minicluster-data/ts-1/wal
uuid: "eb87c12845314de3b41e733d8f36ce7c"
format_stamp: "Formatted at 2026-08-08 04:41:04 on dist-test-slave-vxj2"
server_key: "64a51ba65cc9fdef47a998f6de6e9ecd"
server_key_iv: "292d1a65e3d7fb7bd018a1e0e754eac7"
server_key_version: "encryptionkey@0"
I20260808 04:41:04.531059 31414 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786164000593138-21443-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786164000593138-21443-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786164000593138-21443-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:41:04.543982 31414 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:41:04.544761 31414 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:41:04.545060 31414 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:41:04.545753 31414 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 04:41:04.546909 31414 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 04:41:04.546985 31414 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 04:41:04.547055 31414 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 04:41:04.547108 31414 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 04:41:04.556501 31414 rpc_server.cc:307] RPC server started. Bound to: 127.20.240.194:43587
I20260808 04:41:04.556524 31546 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.240.194:43587 every 8 connection(s)
I20260808 04:41:04.557615 31414 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786164000593138-21443-0/minicluster-data/ts-1/data/info.pb
I20260808 04:41:04.561663 21443 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu as pid 31414
I20260808 04:41:04.561755 21443 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786164000593138-21443-0/minicluster-data/ts-1/wal/instance
I20260808 04:41:04.562068 21443 external_mini_cluster.cc:1428] Setting key 4e8f318c76e3d7c56d83b2dcf444b4e7
I20260808 04:41:04.564442 21443 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
/tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786164000593138-21443-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786164000593138-21443-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786164000593138-21443-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786164000593138-21443-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.240.195:0
--local_ip_for_outbound_sockets=127.20.240.195
--webserver_interface=127.20.240.195
--webserver_port=0
--tserver_master_addrs=127.20.240.254:37559
--builtin_ntp_servers=127.20.240.212:44321
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260808 04:41:04.568418 31249 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:41:04.559487 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.240.194:43777 (local address 127.20.240.254:37559)
0808 04:41:04.559635 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0808 04:41:04.559639 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:41:04.560696 (+ 1057us) server_negotiation.cc:407] Connection header received
0808 04:41:04.562279 (+ 1583us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:41:04.562282 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:41:04.562349 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:41:04.562462 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:41:04.563596 (+ 1134us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:41:04.564292 (+ 696us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:41:04.566182 (+ 1890us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:41:04.566603 (+ 421us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:41:04.566737 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:41:04.567938 (+ 1201us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:41:04.567941 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:41:04.567944 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 04:41:04.567957 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:41:04.567975 (+ 18us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 04:41:04.567983 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:41:04.568048 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0808 04:41:04.568248 (+ 200us) server_negotiation.cc:299] Negotiation successful
0808 04:41:04.568302 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260808 04:41:04.569725 31549 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:41:04.559839 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:37559 (local address 127.20.240.194:43777)
0808 04:41:04.560513 (+ 674us) negotiation.cc:107] Waiting for socket to connect
0808 04:41:04.560556 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0808 04:41:04.562016 (+ 1460us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:41:04.562683 (+ 667us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:41:04.562692 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:41:04.562807 (+ 115us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:41:04.563405 (+ 598us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:41:04.563428 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:41:04.564465 (+ 1037us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:41:04.564469 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:41:04.566016 (+ 1547us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:41:04.566033 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:41:04.566772 (+ 739us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:41:04.566775 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:41:04.566921 (+ 146us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:41:04.567610 (+ 689us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 04:41:04.567614 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:41:04.567669 (+ 55us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 04:41:04.567760 (+ 91us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:41:04.568074 (+ 314us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:41:04.568086 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:41:04.568095 (+ 9us) client_negotiation.cc:769] Sending connection context
0808 04:41:04.568228 (+ 133us) client_negotiation.cc:240] Negotiation successful
0808 04:41:04.568565 (+ 337us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":270,"thread_start_us":107,"threads_started":1}
I20260808 04:41:04.571072 31547 heartbeater.cc:347] Connected to a master server at 127.20.240.254:37559
I20260808 04:41:04.571337 31547 heartbeater.cc:464] Registering TS with master...
I20260808 04:41:04.571899 31547 heartbeater.cc:511] Master 127.20.240.254:37559 requested a full tablet report, sending...
I20260808 04:41:04.573050 31206 ts_manager.cc:194] Registered new tserver with Master: eb87c12845314de3b41e733d8f36ce7c (127.20.240.194:43587)
I20260808 04:41:04.573649 31206 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.20.240.194:43777
W20260808 04:41:04.680529 31550 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:41:04.680850 31550 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:41:04.680932 31550 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:41:04.685247 31550 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:41:04.685338 31550 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:41:04.685432 31550 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.240.195
I20260808 04:41:04.690528 31550 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.240.212:44321
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786164000593138-21443-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786164000593138-21443-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.240.195:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786164000593138-21443-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.240.195
--webserver_port=0
--tserver_master_addrs=127.20.240.254:37559
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31550
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.240.195
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786164000593138-21443-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 04:05:18 UTC on ccycloud.quasar-drfdgt.root.comops.site
build id 4574101
I20260808 04:41:04.691795 31550 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:41:04.693251 31550 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:41:04.703408 31556 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:41:04.703415 31555 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:41:04.703579 31550 server_base.cc:1034] running on GCE node
W20260808 04:41:04.703415 31558 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:41:04.704226 31550 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:41:04.704988 31550 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:41:04.706159 31550 hybrid_clock.cc:648] HybridClock initialized: now 1786164064706139 us; error 38 us; skew 500 ppm
I20260808 04:41:04.708088 31550 webserver.cc:460] Webserver started at http://127.20.240.195:36253/ using document root <none> and password file <none>
I20260808 04:41:04.708632 31550 fs_manager.cc:359] Metadata directory not provided
I20260808 04:41:04.708704 31550 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:41:04.708870 31550 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 04:41:04.710987 31550 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786164000593138-21443-0/minicluster-data/ts-2/data/instance:
uuid: "2e361983f1994d04b20b3ed53af63811"
format_stamp: "Formatted at 2026-08-08 04:41:04 on dist-test-slave-vxj2"
server_key: "6865e08da57cb2f899048af2c30b348b"
server_key_iv: "b100532b191cabd5a0af1c399d190e65"
server_key_version: "encryptionkey@0"
I20260808 04:41:04.711565 31550 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786164000593138-21443-0/minicluster-data/ts-2/wal/instance:
uuid: "2e361983f1994d04b20b3ed53af63811"
format_stamp: "Formatted at 2026-08-08 04:41:04 on dist-test-slave-vxj2"
server_key: "6865e08da57cb2f899048af2c30b348b"
server_key_iv: "b100532b191cabd5a0af1c399d190e65"
server_key_version: "encryptionkey@0"
I20260808 04:41:04.715344 31550 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260808 04:41:04.717849 31564 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:41:04.719050 31550 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 04:41:04.719187 31550 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786164000593138-21443-0/minicluster-data/ts-2/data,/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786164000593138-21443-0/minicluster-data/ts-2/wal
uuid: "2e361983f1994d04b20b3ed53af63811"
format_stamp: "Formatted at 2026-08-08 04:41:04 on dist-test-slave-vxj2"
server_key: "6865e08da57cb2f899048af2c30b348b"
server_key_iv: "b100532b191cabd5a0af1c399d190e65"
server_key_version: "encryptionkey@0"
I20260808 04:41:04.719316 31550 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786164000593138-21443-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786164000593138-21443-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786164000593138-21443-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:41:04.732313 31550 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:41:04.733018 31550 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:41:04.733283 31550 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:41:04.733896 31550 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 04:41:04.735066 31550 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 04:41:04.735150 31550 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 04:41:04.735222 31550 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 04:41:04.735252 31550 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 04:41:04.744648 31550 rpc_server.cc:307] RPC server started. Bound to: 127.20.240.195:38835
I20260808 04:41:04.744670 31684 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.240.195:38835 every 8 connection(s)
I20260808 04:41:04.745726 31550 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786164000593138-21443-0/minicluster-data/ts-2/data/info.pb
I20260808 04:41:04.752322 21443 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu as pid 31550
I20260808 04:41:04.752416 21443 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786164000593138-21443-0/minicluster-data/ts-2/wal/instance
I20260808 04:41:04.752717 21443 external_mini_cluster.cc:1428] Setting key 424fcaa78f5698d2b32ea0d8e9211ea1
I20260808 04:41:04.755875 31249 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:41:04.747708 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.240.195:42933 (local address 127.20.240.254:37559)
0808 04:41:04.747852 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0808 04:41:04.747857 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 04:41:04.748952 (+ 1095us) server_negotiation.cc:407] Connection header received
0808 04:41:04.750444 (+ 1492us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:41:04.750448 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:41:04.750509 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:41:04.750620 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:41:04.751543 (+ 923us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:41:04.752110 (+ 567us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:41:04.753583 (+ 1473us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:41:04.753947 (+ 364us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:41:04.754071 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:41:04.755374 (+ 1303us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:41:04.755384 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:41:04.755386 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 04:41:04.755398 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:41:04.755416 (+ 18us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 04:41:04.755424 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:41:04.755491 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0808 04:41:04.755674 (+ 183us) server_negotiation.cc:299] Negotiation successful
0808 04:41:04.755729 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260808 04:41:04.756735 31687 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:41:04.748135 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:37559 (local address 127.20.240.195:42933)
0808 04:41:04.748790 (+ 655us) negotiation.cc:107] Waiting for socket to connect
0808 04:41:04.748830 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0808 04:41:04.750216 (+ 1386us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:41:04.750797 (+ 581us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:41:04.750805 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:41:04.750892 (+ 87us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:41:04.751392 (+ 500us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:41:04.751405 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:41:04.752243 (+ 838us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:41:04.752251 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:41:04.753432 (+ 1181us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:41:04.753442 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:41:04.754134 (+ 692us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:41:04.754138 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:41:04.754360 (+ 222us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:41:04.755041 (+ 681us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 04:41:04.755045 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:41:04.755103 (+ 58us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 04:41:04.755188 (+ 85us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:41:04.755506 (+ 318us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:41:04.755512 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:41:04.755516 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 04:41:04.755614 (+ 98us) client_negotiation.cc:240] Negotiation successful
0808 04:41:04.755844 (+ 230us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":273,"thread_start_us":113,"threads_started":1}
I20260808 04:41:04.758090 31685 heartbeater.cc:347] Connected to a master server at 127.20.240.254:37559
I20260808 04:41:04.758335 31685 heartbeater.cc:464] Registering TS with master...
I20260808 04:41:04.758879 31685 heartbeater.cc:511] Master 127.20.240.254:37559 requested a full tablet report, sending...
I20260808 04:41:04.760063 31206 ts_manager.cc:194] Registered new tserver with Master: 2e361983f1994d04b20b3ed53af63811 (127.20.240.195:38835)
I20260808 04:41:04.760715 31206 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.20.240.195:42933
I20260808 04:41:04.767263 21443 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260808 04:41:04.770292 31249 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 04:41:04.769285 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38048 (local address 127.20.240.254:37559)
0808 04:41:04.769457 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0808 04:41:04.769466 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 04:41:04.769584 (+ 118us) server_negotiation.cc:407] Connection header received
0808 04:41:04.769693 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:41:04.769695 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:41:04.769736 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:41:04.769802 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:41:04.770126 (+ 324us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:38048: BlockingRecv error: recv got EOF from 127.0.0.1:38048 (error 108)
Metrics: {"server-negotiator.queue_time_us":79}
I20260808 04:41:04.770423 21443 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu with pid 31271
I20260808 04:41:04.777462 21443 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu with pid 31414
I20260808 04:41:04.784726 21443 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu with pid 31550
I20260808 04:41:04.792914 21443 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu with pid 31174
2026-08-08T04:41:04Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationInsecureCluster (903 ms)
[ RUN ] SecurityITest.TestRequireEncryptionInsecureCluster
2026-08-08T04:41:04Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T04:41:04Z Disabled control of system clock
I20260808 04:41:04.824225 21443 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
/tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786164000593138-21443-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786164000593138-21443-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786164000593138-21443-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786164000593138-21443-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.240.254:42449
--webserver_interface=127.20.240.254
--webserver_port=0
--builtin_ntp_servers=127.20.240.212:36877
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.240.254:42449
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260808 04:41:04.939937 31696 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:41:04.940232 31696 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:41:04.940271 31696 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:41:04.944280 31696 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 04:41:04.944345 31696 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:41:04.944361 31696 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:41:04.944377 31696 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 04:41:04.944393 31696 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 04:41:04.949826 31696 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.240.212:36877
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786164000593138-21443-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786164000593138-21443-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.240.254:42449
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.240.254:42449
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786164000593138-21443-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.240.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31696
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786164000593138-21443-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 04:05:18 UTC on ccycloud.quasar-drfdgt.root.comops.site
build id 4574101
I20260808 04:41:04.951006 31696 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:41:04.952512 31696 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:41:04.961689 31702 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:41:04.961728 31701 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:41:04.961871 31704 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:41:04.962035 31696 server_base.cc:1034] running on GCE node
I20260808 04:41:04.962778 31696 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:41:04.963960 31696 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:41:04.965135 31696 hybrid_clock.cc:648] HybridClock initialized: now 1786164064965101 us; error 49 us; skew 500 ppm
I20260808 04:41:04.967484 31696 webserver.cc:460] Webserver started at http://127.20.240.254:40931/ using document root <none> and password file <none>
I20260808 04:41:04.968194 31696 fs_manager.cc:359] Metadata directory not provided
I20260808 04:41:04.968276 31696 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:41:04.968587 31696 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 04:41:04.971206 31696 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786164000593138-21443-0/minicluster-data/master-0/data/instance:
uuid: "b609ce1f7ca74d188331870f5ad3266c"
format_stamp: "Formatted at 2026-08-08 04:41:04 on dist-test-slave-vxj2"
server_key: "d4c60f06679e30462b486718dc484e1c"
server_key_iv: "aeb48339ec7130c6a3619f4741f74756"
server_key_version: "encryptionkey@0"
I20260808 04:41:04.971952 31696 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786164000593138-21443-0/minicluster-data/master-0/wal/instance:
uuid: "b609ce1f7ca74d188331870f5ad3266c"
format_stamp: "Formatted at 2026-08-08 04:41:04 on dist-test-slave-vxj2"
server_key: "d4c60f06679e30462b486718dc484e1c"
server_key_iv: "aeb48339ec7130c6a3619f4741f74756"
server_key_version: "encryptionkey@0"
I20260808 04:41:04.976536 31696 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.000s sys 0.006s
I20260808 04:41:04.979238 31710 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:41:04.980532 31696 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260808 04:41:04.980679 31696 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786164000593138-21443-0/minicluster-data/master-0/data,/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786164000593138-21443-0/minicluster-data/master-0/wal
uuid: "b609ce1f7ca74d188331870f5ad3266c"
format_stamp: "Formatted at 2026-08-08 04:41:04 on dist-test-slave-vxj2"
server_key: "d4c60f06679e30462b486718dc484e1c"
server_key_iv: "aeb48339ec7130c6a3619f4741f74756"
server_key_version: "encryptionkey@0"
I20260808 04:41:04.980803 31696 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786164000593138-21443-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786164000593138-21443-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786164000593138-21443-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:41:04.985541 31696 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:41:04.986166 31696 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:41:04.986351 31696 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:41:04.993494 31696 rpc_server.cc:307] RPC server started. Bound to: 127.20.240.254:42449
I20260808 04:41:04.993515 31768 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.240.254:42449 every 8 connection(s)
I20260808 04:41:04.994463 31696 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786164000593138-21443-0/minicluster-data/master-0/data/info.pb
I20260808 04:41:04.997802 31769 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:41:05.000768 21443 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu as pid 31696
I20260808 04:41:05.000860 21443 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786164000593138-21443-0/minicluster-data/master-0/wal/instance
I20260808 04:41:05.001200 21443 external_mini_cluster.cc:1428] Setting key feec252c4db41a6c01624d32f6626436
I20260808 04:41:05.003921 31769 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b609ce1f7ca74d188331870f5ad3266c: Bootstrap starting.
I20260808 04:41:05.006814 31769 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b609ce1f7ca74d188331870f5ad3266c: Neither blocks nor log segments found. Creating new log.
I20260808 04:41:05.007395 31773 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:41:05.002686 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45740 (local address 127.20.240.254:42449)
0808 04:41:05.003375 (+ 689us) server_negotiation.cc:206] Beginning negotiation
0808 04:41:05.003398 (+ 23us) server_negotiation.cc:399] Waiting for connection header
0808 04:41:05.003443 (+ 45us) server_negotiation.cc:407] Connection header received
0808 04:41:05.004282 (+ 839us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:41:05.004304 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:41:05.004735 (+ 431us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:41:05.005111 (+ 376us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:41:05.005888 (+ 777us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:41:05.005894 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:41:05.005908 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 04:41:05.005921 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:41:05.005986 (+ 65us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 04:41:05.006008 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:41:05.006114 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0808 04:41:05.006207 (+ 93us) server_negotiation.cc:299] Negotiation successful
0808 04:41:05.006451 (+ 244us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":283,"thread_start_us":120,"threads_started":1}
I20260808 04:41:05.007704 31769 log.cc:824] T 00000000000000000000000000000000 P b609ce1f7ca74d188331870f5ad3266c: Log is configured to *not* fsync() on all Append() calls
I20260808 04:41:05.009831 31769 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b609ce1f7ca74d188331870f5ad3266c: No bootstrap required, opened a new log
I20260808 04:41:05.013588 31769 raft_consensus.cc:348] T 00000000000000000000000000000000 P b609ce1f7ca74d188331870f5ad3266c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b609ce1f7ca74d188331870f5ad3266c" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 42449 } }
I20260808 04:41:05.013870 31769 raft_consensus.cc:374] T 00000000000000000000000000000000 P b609ce1f7ca74d188331870f5ad3266c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:41:05.013962 31769 raft_consensus.cc:729] T 00000000000000000000000000000000 P b609ce1f7ca74d188331870f5ad3266c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b609ce1f7ca74d188331870f5ad3266c, State: Initialized, Role: FOLLOWER
I20260808 04:41:05.014475 31769 consensus_queue.cc:260] T 00000000000000000000000000000000 P b609ce1f7ca74d188331870f5ad3266c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b609ce1f7ca74d188331870f5ad3266c" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 42449 } }
I20260808 04:41:05.014642 31769 raft_consensus.cc:388] T 00000000000000000000000000000000 P b609ce1f7ca74d188331870f5ad3266c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 04:41:05.014734 31769 raft_consensus.cc:482] T 00000000000000000000000000000000 P b609ce1f7ca74d188331870f5ad3266c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 04:41:05.014838 31769 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b609ce1f7ca74d188331870f5ad3266c [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:41:05.015904 31769 raft_consensus.cc:504] T 00000000000000000000000000000000 P b609ce1f7ca74d188331870f5ad3266c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b609ce1f7ca74d188331870f5ad3266c" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 42449 } }
I20260808 04:41:05.016306 31769 leader_election.cc:302] T 00000000000000000000000000000000 P b609ce1f7ca74d188331870f5ad3266c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b609ce1f7ca74d188331870f5ad3266c; no voters:
I20260808 04:41:05.016697 31769 leader_election.cc:288] T 00000000000000000000000000000000 P b609ce1f7ca74d188331870f5ad3266c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 04:41:05.016906 31775 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b609ce1f7ca74d188331870f5ad3266c [term 1 FOLLOWER]: Leader election won for term 1
I20260808 04:41:05.017169 31775 raft_consensus.cc:686] T 00000000000000000000000000000000 P b609ce1f7ca74d188331870f5ad3266c [term 1 LEADER]: Becoming Leader. State: Replica: b609ce1f7ca74d188331870f5ad3266c, State: Running, Role: LEADER
I20260808 04:41:05.017529 31775 consensus_queue.cc:237] T 00000000000000000000000000000000 P b609ce1f7ca74d188331870f5ad3266c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b609ce1f7ca74d188331870f5ad3266c" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 42449 } }
I20260808 04:41:05.018134 31769 sys_catalog.cc:564] T 00000000000000000000000000000000 P b609ce1f7ca74d188331870f5ad3266c [sys.catalog]: configured and running, proceeding with master startup.
I20260808 04:41:05.019325 31777 sys_catalog.cc:455] T 00000000000000000000000000000000 P b609ce1f7ca74d188331870f5ad3266c [sys.catalog]: SysCatalogTable state changed. Reason: New leader b609ce1f7ca74d188331870f5ad3266c. Latest consensus state: current_term: 1 leader_uuid: "b609ce1f7ca74d188331870f5ad3266c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b609ce1f7ca74d188331870f5ad3266c" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 42449 } } }
I20260808 04:41:05.019497 31777 sys_catalog.cc:458] T 00000000000000000000000000000000 P b609ce1f7ca74d188331870f5ad3266c [sys.catalog]: This master's current role is: LEADER
I20260808 04:41:05.019856 31776 sys_catalog.cc:455] T 00000000000000000000000000000000 P b609ce1f7ca74d188331870f5ad3266c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b609ce1f7ca74d188331870f5ad3266c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b609ce1f7ca74d188331870f5ad3266c" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 42449 } } }
I20260808 04:41:05.019938 31784 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 04:41:05.019955 31776 sys_catalog.cc:458] T 00000000000000000000000000000000 P b609ce1f7ca74d188331870f5ad3266c [sys.catalog]: This master's current role is: LEADER
I20260808 04:41:05.023528 31784 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 04:41:05.030287 31784 catalog_manager.cc:1347] Generated new cluster ID: 38793ee73228470f8947a8221abde1e7
I20260808 04:41:05.030377 31784 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 04:41:05.064965 31784 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 04:41:05.065376 31784 catalog_manager.cc:1504] Loading token signing keys...
I20260808 04:41:05.074100 31784 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b609ce1f7ca74d188331870f5ad3266c: Generated new TSK 0
I20260808 04:41:05.074869 31784 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 04:41:05.086735 21443 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
/tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786164000593138-21443-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786164000593138-21443-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786164000593138-21443-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786164000593138-21443-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.240.193:0
--local_ip_for_outbound_sockets=127.20.240.193
--webserver_interface=127.20.240.193
--webserver_port=0
--tserver_master_addrs=127.20.240.254:42449
--builtin_ntp_servers=127.20.240.212:36877
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260808 04:41:05.204392 31795 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:41:05.204698 31795 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:41:05.204741 31795 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:41:05.208985 31795 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:41:05.209069 31795 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:41:05.209129 31795 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.240.193
I20260808 04:41:05.214337 31795 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.240.212:36877
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786164000593138-21443-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786164000593138-21443-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.240.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786164000593138-21443-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.240.193
--webserver_port=0
--tserver_master_addrs=127.20.240.254:42449
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31795
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.240.193
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786164000593138-21443-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 04:05:18 UTC on ccycloud.quasar-drfdgt.root.comops.site
build id 4574101
I20260808 04:41:05.215656 31795 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:41:05.217170 31795 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:41:05.227766 31801 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:41:05.227783 31800 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:41:05.227813 31795 server_base.cc:1034] running on GCE node
W20260808 04:41:05.227770 31803 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:41:05.228536 31795 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:41:05.229234 31795 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:41:05.230422 31795 hybrid_clock.cc:648] HybridClock initialized: now 1786164065230408 us; error 24 us; skew 500 ppm
I20260808 04:41:05.232290 31795 webserver.cc:460] Webserver started at http://127.20.240.193:38961/ using document root <none> and password file <none>
I20260808 04:41:05.232913 31795 fs_manager.cc:359] Metadata directory not provided
I20260808 04:41:05.232981 31795 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:41:05.233286 31795 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 04:41:05.235442 31795 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786164000593138-21443-0/minicluster-data/ts-0/data/instance:
uuid: "5e35b00c1bd34457bbf067826ce81a93"
format_stamp: "Formatted at 2026-08-08 04:41:05 on dist-test-slave-vxj2"
server_key: "ba6c08d4b9ac29dbdc5a3e04e606d26a"
server_key_iv: "b24884469212d2f1c932b96fbb576057"
server_key_version: "encryptionkey@0"
I20260808 04:41:05.236032 31795 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786164000593138-21443-0/minicluster-data/ts-0/wal/instance:
uuid: "5e35b00c1bd34457bbf067826ce81a93"
format_stamp: "Formatted at 2026-08-08 04:41:05 on dist-test-slave-vxj2"
server_key: "ba6c08d4b9ac29dbdc5a3e04e606d26a"
server_key_iv: "b24884469212d2f1c932b96fbb576057"
server_key_version: "encryptionkey@0"
I20260808 04:41:05.240026 31795 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.004s
I20260808 04:41:05.242947 31810 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:41:05.244313 31795 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260808 04:41:05.244462 31795 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786164000593138-21443-0/minicluster-data/ts-0/data,/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786164000593138-21443-0/minicluster-data/ts-0/wal
uuid: "5e35b00c1bd34457bbf067826ce81a93"
format_stamp: "Formatted at 2026-08-08 04:41:05 on dist-test-slave-vxj2"
server_key: "ba6c08d4b9ac29dbdc5a3e04e606d26a"
server_key_iv: "b24884469212d2f1c932b96fbb576057"
server_key_version: "encryptionkey@0"
I20260808 04:41:05.244596 31795 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786164000593138-21443-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786164000593138-21443-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786164000593138-21443-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:41:05.249359 31795 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:41:05.249977 31795 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:41:05.250169 31795 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:41:05.250727 31795 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 04:41:05.251653 31795 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 04:41:05.251724 31795 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 04:41:05.251797 31795 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 04:41:05.251843 31795 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 04:41:05.261585 31795 rpc_server.cc:307] RPC server started. Bound to: 127.20.240.193:37157
I20260808 04:41:05.261611 31937 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.240.193:37157 every 8 connection(s)
I20260808 04:41:05.262533 31795 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786164000593138-21443-0/minicluster-data/ts-0/data/info.pb
I20260808 04:41:05.264084 21443 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu as pid 31795
I20260808 04:41:05.264230 21443 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786164000593138-21443-0/minicluster-data/ts-0/wal/instance
I20260808 04:41:05.264564 21443 external_mini_cluster.cc:1428] Setting key 904622fe938603f1f670142ecc2cf840
I20260808 04:41:05.266963 21443 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
/tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786164000593138-21443-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786164000593138-21443-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786164000593138-21443-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786164000593138-21443-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.240.194:0
--local_ip_for_outbound_sockets=127.20.240.194
--webserver_interface=127.20.240.194
--webserver_port=0
--tserver_master_addrs=127.20.240.254:42449
--builtin_ntp_servers=127.20.240.212:36877
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
I20260808 04:41:05.269519 31773 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:41:05.265416 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.240.193:36507 (local address 127.20.240.254:42449)
0808 04:41:05.265559 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0808 04:41:05.265564 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 04:41:05.266082 (+ 518us) server_negotiation.cc:407] Connection header received
0808 04:41:05.267564 (+ 1482us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:41:05.267570 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:41:05.267624 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:41:05.267732 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:41:05.268963 (+ 1231us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:41:05.268966 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:41:05.268968 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 04:41:05.268980 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:41:05.269004 (+ 24us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 04:41:05.269013 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:41:05.269100 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0808 04:41:05.269361 (+ 261us) server_negotiation.cc:299] Negotiation successful
0808 04:41:05.269406 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260808 04:41:05.270498 31940 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:41:05.265026 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:42449 (local address 127.20.240.193:36507)
0808 04:41:05.265916 (+ 890us) negotiation.cc:107] Waiting for socket to connect
0808 04:41:05.265996 (+ 80us) client_negotiation.cc:174] Beginning negotiation
0808 04:41:05.267338 (+ 1342us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:41:05.267882 (+ 544us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:41:05.267889 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:41:05.267977 (+ 88us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:41:05.268630 (+ 653us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 04:41:05.268633 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:41:05.268693 (+ 60us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 04:41:05.268789 (+ 96us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:41:05.269108 (+ 319us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:41:05.269118 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:41:05.269126 (+ 8us) client_negotiation.cc:769] Sending connection context
0808 04:41:05.269342 (+ 216us) client_negotiation.cc:240] Negotiation successful
0808 04:41:05.269623 (+ 281us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":378,"thread_start_us":159,"threads_started":1}
I20260808 04:41:05.271816 31938 heartbeater.cc:347] Connected to a master server at 127.20.240.254:42449
I20260808 04:41:05.272097 31938 heartbeater.cc:464] Registering TS with master...
I20260808 04:41:05.272550 31938 heartbeater.cc:511] Master 127.20.240.254:42449 requested a full tablet report, sending...
I20260808 04:41:05.274528 31727 ts_manager.cc:194] Registered new tserver with Master: 5e35b00c1bd34457bbf067826ce81a93 (127.20.240.193:37157)
W20260808 04:41:05.384642 31941 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:41:05.384915 31941 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:41:05.384958 31941 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:41:05.390931 31941 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:41:05.391023 31941 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:41:05.391116 31941 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.240.194
I20260808 04:41:05.396733 31941 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.240.212:36877
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786164000593138-21443-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786164000593138-21443-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.240.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786164000593138-21443-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.240.194
--webserver_port=0
--tserver_master_addrs=127.20.240.254:42449
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31941
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.240.194
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786164000593138-21443-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 04:05:18 UTC on ccycloud.quasar-drfdgt.root.comops.site
build id 4574101
I20260808 04:41:05.398008 31941 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:41:05.399415 31941 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:41:05.409423 31951 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:41:05.409394 31948 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:41:05.409415 31947 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:41:05.409591 31941 server_base.cc:1034] running on GCE node
I20260808 04:41:05.410259 31941 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:41:05.410974 31941 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:41:05.412194 31941 hybrid_clock.cc:648] HybridClock initialized: now 1786164065412160 us; error 48 us; skew 500 ppm
I20260808 04:41:05.414587 31941 webserver.cc:460] Webserver started at http://127.20.240.194:35027/ using document root <none> and password file <none>
I20260808 04:41:05.415239 31941 fs_manager.cc:359] Metadata directory not provided
I20260808 04:41:05.415340 31941 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:41:05.415589 31941 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 04:41:05.418054 31941 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786164000593138-21443-0/minicluster-data/ts-1/data/instance:
uuid: "7950324912674eb5b81610215224076b"
format_stamp: "Formatted at 2026-08-08 04:41:05 on dist-test-slave-vxj2"
server_key: "3310c73ca7ed8271806a34edae6f0c1c"
server_key_iv: "cbc95ac7a899e1dfd58c3a55d2f79a92"
server_key_version: "encryptionkey@0"
I20260808 04:41:05.418717 31941 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786164000593138-21443-0/minicluster-data/ts-1/wal/instance:
uuid: "7950324912674eb5b81610215224076b"
format_stamp: "Formatted at 2026-08-08 04:41:05 on dist-test-slave-vxj2"
server_key: "3310c73ca7ed8271806a34edae6f0c1c"
server_key_iv: "cbc95ac7a899e1dfd58c3a55d2f79a92"
server_key_version: "encryptionkey@0"
I20260808 04:41:05.423028 31941 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260808 04:41:05.426144 31958 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:41:05.427652 31941 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 04:41:05.427866 31941 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786164000593138-21443-0/minicluster-data/ts-1/data,/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786164000593138-21443-0/minicluster-data/ts-1/wal
uuid: "7950324912674eb5b81610215224076b"
format_stamp: "Formatted at 2026-08-08 04:41:05 on dist-test-slave-vxj2"
server_key: "3310c73ca7ed8271806a34edae6f0c1c"
server_key_iv: "cbc95ac7a899e1dfd58c3a55d2f79a92"
server_key_version: "encryptionkey@0"
I20260808 04:41:05.428023 31941 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786164000593138-21443-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786164000593138-21443-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786164000593138-21443-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:41:05.432842 31941 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:41:05.433516 31941 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:41:05.433704 31941 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:41:05.434314 31941 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 04:41:05.435261 31941 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 04:41:05.435331 31941 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 04:41:05.435401 31941 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 04:41:05.435454 31941 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 04:41:05.444299 31941 rpc_server.cc:307] RPC server started. Bound to: 127.20.240.194:46411
I20260808 04:41:05.444322 32082 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.240.194:46411 every 8 connection(s)
I20260808 04:41:05.445341 31941 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786164000593138-21443-0/minicluster-data/ts-1/data/info.pb
I20260808 04:41:05.451795 31773 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:41:05.447236 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.240.194:40501 (local address 127.20.240.254:42449)
0808 04:41:05.447386 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0808 04:41:05.447390 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:41:05.448528 (+ 1138us) server_negotiation.cc:407] Connection header received
0808 04:41:05.450003 (+ 1475us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:41:05.450006 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:41:05.450055 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:41:05.450168 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:41:05.451294 (+ 1126us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:41:05.451298 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:41:05.451301 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 04:41:05.451314 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:41:05.451344 (+ 30us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 04:41:05.451353 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:41:05.451455 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0808 04:41:05.451605 (+ 150us) server_negotiation.cc:299] Negotiation successful
0808 04:41:05.451655 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260808 04:41:05.452625 32085 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:41:05.447714 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:42449 (local address 127.20.240.194:40501)
0808 04:41:05.448365 (+ 651us) negotiation.cc:107] Waiting for socket to connect
0808 04:41:05.448407 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0808 04:41:05.449782 (+ 1375us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:41:05.450337 (+ 555us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:41:05.450343 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:41:05.450427 (+ 84us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:41:05.451032 (+ 605us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 04:41:05.451034 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:41:05.451074 (+ 40us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 04:41:05.451140 (+ 66us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:41:05.451438 (+ 298us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:41:05.451454 (+ 16us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:41:05.451460 (+ 6us) client_negotiation.cc:769] Sending connection context
0808 04:41:05.451636 (+ 176us) client_negotiation.cc:240] Negotiation successful
0808 04:41:05.451871 (+ 235us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":255,"thread_start_us":110,"threads_started":1}
I20260808 04:41:05.453781 32083 heartbeater.cc:347] Connected to a master server at 127.20.240.254:42449
I20260808 04:41:05.454013 32083 heartbeater.cc:464] Registering TS with master...
I20260808 04:41:05.454433 32083 heartbeater.cc:511] Master 127.20.240.254:42449 requested a full tablet report, sending...
I20260808 04:41:05.454766 21443 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu as pid 31941
I20260808 04:41:05.454911 21443 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786164000593138-21443-0/minicluster-data/ts-1/wal/instance
I20260808 04:41:05.455276 21443 external_mini_cluster.cc:1428] Setting key 193aed168dc7a85baa401ec784452636
I20260808 04:41:05.455555 31727 ts_manager.cc:194] Registered new tserver with Master: 7950324912674eb5b81610215224076b (127.20.240.194:46411)
I20260808 04:41:05.457144 21443 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
/tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786164000593138-21443-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786164000593138-21443-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786164000593138-21443-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786164000593138-21443-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.240.195:0
--local_ip_for_outbound_sockets=127.20.240.195
--webserver_interface=127.20.240.195
--webserver_port=0
--tserver_master_addrs=127.20.240.254:42449
--builtin_ntp_servers=127.20.240.212:36877
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260808 04:41:05.571403 32086 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:41:05.571689 32086 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:41:05.571730 32086 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:41:05.575763 32086 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:41:05.575817 32086 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:41:05.575875 32086 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.240.195
I20260808 04:41:05.580701 32086 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.240.212:36877
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786164000593138-21443-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786164000593138-21443-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.240.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786164000593138-21443-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.240.195
--webserver_port=0
--tserver_master_addrs=127.20.240.254:42449
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32086
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.240.195
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786164000593138-21443-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 04:05:18 UTC on ccycloud.quasar-drfdgt.root.comops.site
build id 4574101
I20260808 04:41:05.581840 32086 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:41:05.583333 32086 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:41:05.593386 32092 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:41:05.593374 32095 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:41:05.593374 32091 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:41:05.593669 32086 server_base.cc:1034] running on GCE node
I20260808 04:41:05.594131 32086 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:41:05.594893 32086 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:41:05.596079 32086 hybrid_clock.cc:648] HybridClock initialized: now 1786164065596058 us; error 31 us; skew 500 ppm
I20260808 04:41:05.598150 32086 webserver.cc:460] Webserver started at http://127.20.240.195:33429/ using document root <none> and password file <none>
I20260808 04:41:05.598765 32086 fs_manager.cc:359] Metadata directory not provided
I20260808 04:41:05.598831 32086 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:41:05.599054 32086 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 04:41:05.601262 32086 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786164000593138-21443-0/minicluster-data/ts-2/data/instance:
uuid: "884d03147b834d7cb9932dd18f80417b"
format_stamp: "Formatted at 2026-08-08 04:41:05 on dist-test-slave-vxj2"
server_key: "c4167278a003e78b659dc13cca524c07"
server_key_iv: "85ba92742f54754d76ccd86e11733500"
server_key_version: "encryptionkey@0"
I20260808 04:41:05.601850 32086 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786164000593138-21443-0/minicluster-data/ts-2/wal/instance:
uuid: "884d03147b834d7cb9932dd18f80417b"
format_stamp: "Formatted at 2026-08-08 04:41:05 on dist-test-slave-vxj2"
server_key: "c4167278a003e78b659dc13cca524c07"
server_key_iv: "85ba92742f54754d76ccd86e11733500"
server_key_version: "encryptionkey@0"
I20260808 04:41:05.605762 32086 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.001s
I20260808 04:41:05.608476 32101 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:41:05.609758 32086 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 04:41:05.609907 32086 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786164000593138-21443-0/minicluster-data/ts-2/data,/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786164000593138-21443-0/minicluster-data/ts-2/wal
uuid: "884d03147b834d7cb9932dd18f80417b"
format_stamp: "Formatted at 2026-08-08 04:41:05 on dist-test-slave-vxj2"
server_key: "c4167278a003e78b659dc13cca524c07"
server_key_iv: "85ba92742f54754d76ccd86e11733500"
server_key_version: "encryptionkey@0"
I20260808 04:41:05.610028 32086 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786164000593138-21443-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786164000593138-21443-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786164000593138-21443-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:41:05.614774 32086 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:41:05.615411 32086 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:41:05.615612 32086 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:41:05.616253 32086 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 04:41:05.617539 32086 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 04:41:05.617587 32086 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 04:41:05.617630 32086 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 04:41:05.617645 32086 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 04:41:05.626871 32086 rpc_server.cc:307] RPC server started. Bound to: 127.20.240.195:34899
I20260808 04:41:05.626891 32227 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.240.195:34899 every 8 connection(s)
I20260808 04:41:05.627828 32086 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786164000593138-21443-0/minicluster-data/ts-2/data/info.pb
I20260808 04:41:05.633885 21443 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu as pid 32086
I20260808 04:41:05.634032 21443 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786164000593138-21443-0/minicluster-data/ts-2/wal/instance
I20260808 04:41:05.634351 21443 external_mini_cluster.cc:1428] Setting key ee3c58528a29cda14fb7eb16e078662d
I20260808 04:41:05.635295 31773 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:41:05.629817 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.240.195:60351 (local address 127.20.240.254:42449)
0808 04:41:05.629965 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0808 04:41:05.629968 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 04:41:05.631123 (+ 1155us) server_negotiation.cc:407] Connection header received
0808 04:41:05.632653 (+ 1530us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:41:05.632656 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:41:05.632712 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:41:05.632853 (+ 141us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:41:05.634723 (+ 1870us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:41:05.634727 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:41:05.634729 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 04:41:05.634745 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:41:05.634771 (+ 26us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 04:41:05.634781 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:41:05.634876 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0808 04:41:05.635115 (+ 239us) server_negotiation.cc:299] Negotiation successful
0808 04:41:05.635168 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260808 04:41:05.636700 32230 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:41:05.630181 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:42449 (local address 127.20.240.195:60351)
0808 04:41:05.630902 (+ 721us) negotiation.cc:107] Waiting for socket to connect
0808 04:41:05.630946 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0808 04:41:05.632410 (+ 1464us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:41:05.633087 (+ 677us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:41:05.633096 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:41:05.633294 (+ 198us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:41:05.634314 (+ 1020us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 04:41:05.634317 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:41:05.634372 (+ 55us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 04:41:05.634516 (+ 144us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:41:05.634933 (+ 417us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:41:05.634945 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:41:05.634954 (+ 9us) client_negotiation.cc:769] Sending connection context
0808 04:41:05.635151 (+ 197us) client_negotiation.cc:240] Negotiation successful
0808 04:41:05.635537 (+ 386us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":289,"thread_start_us":119,"threads_started":1}
I20260808 04:41:05.638042 32228 heartbeater.cc:347] Connected to a master server at 127.20.240.254:42449
I20260808 04:41:05.638361 32228 heartbeater.cc:464] Registering TS with master...
I20260808 04:41:05.638854 32228 heartbeater.cc:511] Master 127.20.240.254:42449 requested a full tablet report, sending...
I20260808 04:41:05.640105 31727 ts_manager.cc:194] Registered new tserver with Master: 884d03147b834d7cb9932dd18f80417b (127.20.240.195:34899)
I20260808 04:41:05.649691 21443 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260808 04:41:05.652730 31773 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 04:41:05.651746 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45750 (local address 127.20.240.254:42449)
0808 04:41:05.651945 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0808 04:41:05.651949 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:41:05.652028 (+ 79us) server_negotiation.cc:407] Connection header received
0808 04:41:05.652135 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:41:05.652137 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:41:05.652174 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:41:05.652248 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:41:05.652571 (+ 323us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:45750: BlockingRecv error: recv got EOF from 127.0.0.1:45750 (error 108)
Metrics: {"server-negotiator.queue_time_us":88}
I20260808 04:41:05.652767 21443 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu with pid 31795
I20260808 04:41:05.659307 21443 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu with pid 31941
I20260808 04:41:05.667302 21443 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu with pid 32086
I20260808 04:41:05.675868 21443 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu with pid 31696
2026-08-08T04:41:05Z chronyd exiting
[ OK ] SecurityITest.TestRequireEncryptionInsecureCluster (883 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationSecureCluster
Loading random data
Initializing database '/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786164000593138-21443-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 04:41:05 dist-test-slave-vxj2 krb5kdc[32238](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 04:41:05 dist-test-slave-vxj2 krb5kdc[32238](info): set up 2 sockets
Aug 08 04:41:05 dist-test-slave-vxj2 krb5kdc[32238](info): commencing operation
krb5kdc: starting...
W20260808 04:41:06.762603 21443 mini_kdc.cc:121] Time spent starting KDC: real 1.063s user 0.003s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786164000593138-21443-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786164000593138-21443-0/krb5kdc/test-user.keytab.
Aug 08 04:41:06 dist-test-slave-vxj2 krb5kdc[32238](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164066, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T04:41:06Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T04:41:06Z Disabled control of system clock
WARNING: no policy specified for kudu/127.20.240.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.240.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.240.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.254.keytab.
Entry for principal kudu/127.20.240.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.254.keytab.
I20260808 04:41:06.892884 21443 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
/tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786164000593138-21443-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786164000593138-21443-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786164000593138-21443-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786164000593138-21443-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.240.254:35057
--webserver_interface=127.20.240.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.254.keytab
--principal=kudu/127.20.240.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.240.212:35847
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.240.254:35057
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786164000593138-21443-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786164000593138-21443-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786164000593138-21443-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 04:41:07.007735 32254 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:41:07.008054 32254 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:41:07.008097 32254 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:41:07.012526 32254 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 04:41:07.012619 32254 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:41:07.012641 32254 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:41:07.012658 32254 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 04:41:07.012676 32254 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 04:41:07.018322 32254 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.240.212:35847
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786164000593138-21443-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786164000593138-21443-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.240.254:35057
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.254.keytab
--principal=kudu/127.20.240.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.240.254:35057
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786164000593138-21443-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.240.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32254
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786164000593138-21443-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 04:05:18 UTC on ccycloud.quasar-drfdgt.root.comops.site
build id 4574101
I20260808 04:41:07.019483 32254 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:41:07.020469 32254 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:41:07.029193 32263 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:41:07.029193 32261 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:41:07.029206 32260 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:41:07.029500 32254 server_base.cc:1034] running on GCE node
I20260808 04:41:07.030177 32254 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:41:07.031334 32254 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:41:07.032531 32254 hybrid_clock.cc:648] HybridClock initialized: now 1786164067032517 us; error 25 us; skew 500 ppm
Aug 08 04:41:07 dist-test-slave-vxj2 krb5kdc[32238](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164067, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.240.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:41:07.035418 32254 init.cc:377] Logged in from keytab as kudu/127.20.240.254@KRBTEST.COM (short username kudu)
I20260808 04:41:07.036315 32254 webserver.cc:460] Webserver started at http://127.20.240.254:34203/ using document root <none> and password file <none>
I20260808 04:41:07.036922 32254 fs_manager.cc:359] Metadata directory not provided
I20260808 04:41:07.037020 32254 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:41:07.037305 32254 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 04:41:07.039497 32254 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786164000593138-21443-0/minicluster-data/master-0/data/instance:
uuid: "b786694e82364d4b9396120de8a184f5"
format_stamp: "Formatted at 2026-08-08 04:41:07 on dist-test-slave-vxj2"
server_key: "a97cbb2f0c3d02b13b476bb097346c05"
server_key_iv: "babc16a635ff179abf2688704c3056d7"
server_key_version: "encryptionkey@0"
I20260808 04:41:07.040084 32254 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786164000593138-21443-0/minicluster-data/master-0/wal/instance:
uuid: "b786694e82364d4b9396120de8a184f5"
format_stamp: "Formatted at 2026-08-08 04:41:07 on dist-test-slave-vxj2"
server_key: "a97cbb2f0c3d02b13b476bb097346c05"
server_key_iv: "babc16a635ff179abf2688704c3056d7"
server_key_version: "encryptionkey@0"
I20260808 04:41:07.044102 32254 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.004s
I20260808 04:41:07.046756 32271 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:41:07.048089 32254 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260808 04:41:07.048259 32254 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786164000593138-21443-0/minicluster-data/master-0/data,/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786164000593138-21443-0/minicluster-data/master-0/wal
uuid: "b786694e82364d4b9396120de8a184f5"
format_stamp: "Formatted at 2026-08-08 04:41:07 on dist-test-slave-vxj2"
server_key: "a97cbb2f0c3d02b13b476bb097346c05"
server_key_iv: "babc16a635ff179abf2688704c3056d7"
server_key_version: "encryptionkey@0"
I20260808 04:41:07.048384 32254 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786164000593138-21443-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786164000593138-21443-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786164000593138-21443-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:41:07.074626 32254 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:41:07.077978 32254 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:41:07.078212 32254 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:41:07.085619 32254 rpc_server.cc:307] RPC server started. Bound to: 127.20.240.254:35057
I20260808 04:41:07.085995 32327 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.240.254:35057 every 8 connection(s)
I20260808 04:41:07.086679 32254 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786164000593138-21443-0/minicluster-data/master-0/data/info.pb
I20260808 04:41:07.089618 32329 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:41:07.090090 21443 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu as pid 32254
I20260808 04:41:07.090195 21443 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786164000593138-21443-0/minicluster-data/master-0/wal/instance
I20260808 04:41:07.090538 21443 external_mini_cluster.cc:1428] Setting key 835691052617289b116d419abd1e462f
I20260808 04:41:07.096181 32329 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b786694e82364d4b9396120de8a184f5: Bootstrap starting.
I20260808 04:41:07.099004 32329 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b786694e82364d4b9396120de8a184f5: Neither blocks nor log segments found. Creating new log.
I20260808 04:41:07.099972 32329 log.cc:824] T 00000000000000000000000000000000 P b786694e82364d4b9396120de8a184f5: Log is configured to *not* fsync() on all Append() calls
Aug 08 04:41:07 dist-test-slave-vxj2 krb5kdc[32238](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164066, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.240.254@KRBTEST.COM
I20260808 04:41:07.102538 32329 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b786694e82364d4b9396120de8a184f5: No bootstrap required, opened a new log
I20260808 04:41:07.106482 32332 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:41:07.092200 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39182 (local address 127.20.240.254:35057)
0808 04:41:07.092651 (+ 451us) server_negotiation.cc:206] Beginning negotiation
0808 04:41:07.092666 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0808 04:41:07.092702 (+ 36us) server_negotiation.cc:407] Connection header received
0808 04:41:07.093473 (+ 771us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:41:07.093493 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:41:07.093813 (+ 320us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:41:07.094145 (+ 332us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:41:07.095060 (+ 915us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:41:07.096074 (+ 1014us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:41:07.097238 (+ 1164us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:41:07.097702 (+ 464us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:41:07.097832 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:41:07.100918 (+ 3086us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:41:07.100926 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:41:07.100944 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:41:07.100978 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:41:07.103041 (+ 2063us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:41:07.103548 (+ 507us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:41:07.103553 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:41:07.103560 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:41:07.103700 (+ 140us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:41:07.103996 (+ 296us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:41:07.104000 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:41:07.104002 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:41:07.104533 (+ 531us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:41:07.104745 (+ 212us) server_negotiation.cc:1035] Waiting for connection context
0808 04:41:07.105114 (+ 369us) server_negotiation.cc:299] Negotiation successful
0808 04:41:07.105487 (+ 373us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":309,"thread_start_us":136,"threads_started":1}
I20260808 04:41:07.107306 32329 raft_consensus.cc:348] T 00000000000000000000000000000000 P b786694e82364d4b9396120de8a184f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b786694e82364d4b9396120de8a184f5" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 35057 } }
I20260808 04:41:07.107578 32329 raft_consensus.cc:374] T 00000000000000000000000000000000 P b786694e82364d4b9396120de8a184f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:41:07.107697 32329 raft_consensus.cc:729] T 00000000000000000000000000000000 P b786694e82364d4b9396120de8a184f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b786694e82364d4b9396120de8a184f5, State: Initialized, Role: FOLLOWER
I20260808 04:41:07.108191 32329 consensus_queue.cc:260] T 00000000000000000000000000000000 P b786694e82364d4b9396120de8a184f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b786694e82364d4b9396120de8a184f5" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 35057 } }
I20260808 04:41:07.108322 32329 raft_consensus.cc:388] T 00000000000000000000000000000000 P b786694e82364d4b9396120de8a184f5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 04:41:07.108407 32329 raft_consensus.cc:482] T 00000000000000000000000000000000 P b786694e82364d4b9396120de8a184f5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 04:41:07.108507 32329 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b786694e82364d4b9396120de8a184f5 [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:41:07.109700 32329 raft_consensus.cc:504] T 00000000000000000000000000000000 P b786694e82364d4b9396120de8a184f5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b786694e82364d4b9396120de8a184f5" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 35057 } }
I20260808 04:41:07.110069 32329 leader_election.cc:302] T 00000000000000000000000000000000 P b786694e82364d4b9396120de8a184f5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b786694e82364d4b9396120de8a184f5; no voters:
I20260808 04:41:07.110409 32329 leader_election.cc:288] T 00000000000000000000000000000000 P b786694e82364d4b9396120de8a184f5 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 04:41:07.110605 32334 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b786694e82364d4b9396120de8a184f5 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 04:41:07.110916 32334 raft_consensus.cc:686] T 00000000000000000000000000000000 P b786694e82364d4b9396120de8a184f5 [term 1 LEADER]: Becoming Leader. State: Replica: b786694e82364d4b9396120de8a184f5, State: Running, Role: LEADER
I20260808 04:41:07.111230 32334 consensus_queue.cc:237] T 00000000000000000000000000000000 P b786694e82364d4b9396120de8a184f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b786694e82364d4b9396120de8a184f5" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 35057 } }
I20260808 04:41:07.111814 32329 sys_catalog.cc:564] T 00000000000000000000000000000000 P b786694e82364d4b9396120de8a184f5 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 04:41:07.113054 32337 sys_catalog.cc:455] T 00000000000000000000000000000000 P b786694e82364d4b9396120de8a184f5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b786694e82364d4b9396120de8a184f5. Latest consensus state: current_term: 1 leader_uuid: "b786694e82364d4b9396120de8a184f5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b786694e82364d4b9396120de8a184f5" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 35057 } } }
I20260808 04:41:07.113221 32337 sys_catalog.cc:458] T 00000000000000000000000000000000 P b786694e82364d4b9396120de8a184f5 [sys.catalog]: This master's current role is: LEADER
I20260808 04:41:07.113585 32335 sys_catalog.cc:455] T 00000000000000000000000000000000 P b786694e82364d4b9396120de8a184f5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b786694e82364d4b9396120de8a184f5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b786694e82364d4b9396120de8a184f5" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 35057 } } }
I20260808 04:41:07.113679 32335 sys_catalog.cc:458] T 00000000000000000000000000000000 P b786694e82364d4b9396120de8a184f5 [sys.catalog]: This master's current role is: LEADER
I20260808 04:41:07.113684 32345 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 04:41:07.116883 32345 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 04:41:07.122907 32345 catalog_manager.cc:1347] Generated new cluster ID: 1fc4b87968874e6eb892fe1f83a83ca6
I20260808 04:41:07.123025 32345 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 04:41:07.136123 32345 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 04:41:07.137095 32345 catalog_manager.cc:1504] Loading token signing keys...
I20260808 04:41:07.149469 32345 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b786694e82364d4b9396120de8a184f5: Generated new TSK 0
I20260808 04:41:07.150240 32345 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.20.240.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.240.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.240.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.193.keytab.
Entry for principal kudu/127.20.240.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.193.keytab.
I20260808 04:41:07.186024 21443 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
/tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786164000593138-21443-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786164000593138-21443-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786164000593138-21443-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786164000593138-21443-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.240.193:0
--local_ip_for_outbound_sockets=127.20.240.193
--webserver_interface=127.20.240.193
--webserver_port=0
--tserver_master_addrs=127.20.240.254:35057
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.193.keytab
--principal=kudu/127.20.240.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.240.212:35847
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786164000593138-21443-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786164000593138-21443-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786164000593138-21443-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 04:41:07.329835 32360 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:41:07.330216 32360 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:41:07.330286 32360 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:41:07.334499 32360 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:41:07.334571 32360 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:41:07.334635 32360 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.240.193
I20260808 04:41:07.340045 32360 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.240.212:35847
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786164000593138-21443-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786164000593138-21443-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.193.keytab
--principal=kudu/127.20.240.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.240.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786164000593138-21443-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.240.193
--webserver_port=0
--tserver_master_addrs=127.20.240.254:35057
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32360
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.240.193
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786164000593138-21443-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 04:05:18 UTC on ccycloud.quasar-drfdgt.root.comops.site
build id 4574101
I20260808 04:41:07.341115 32360 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:41:07.342185 32360 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:41:07.352149 32366 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:41:07.352195 32369 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:41:07.352196 32367 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:41:07.352530 32360 server_base.cc:1034] running on GCE node
I20260808 04:41:07.352973 32360 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:41:07.353681 32360 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:41:07.354900 32360 hybrid_clock.cc:648] HybridClock initialized: now 1786164067354869 us; error 39 us; skew 500 ppm
Aug 08 04:41:07 dist-test-slave-vxj2 krb5kdc[32238](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164067, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.240.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:41:07.358036 32360 init.cc:377] Logged in from keytab as kudu/127.20.240.193@KRBTEST.COM (short username kudu)
I20260808 04:41:07.359016 32360 webserver.cc:460] Webserver started at http://127.20.240.193:33113/ using document root <none> and password file <none>
I20260808 04:41:07.359599 32360 fs_manager.cc:359] Metadata directory not provided
I20260808 04:41:07.359694 32360 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:41:07.359943 32360 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 04:41:07.362104 32360 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786164000593138-21443-0/minicluster-data/ts-0/data/instance:
uuid: "fb71842da3f04b93a7c0fa8d14bdd2c7"
format_stamp: "Formatted at 2026-08-08 04:41:07 on dist-test-slave-vxj2"
server_key: "998cc1bdcaa7e793bdf6064d9285cf77"
server_key_iv: "e23c9158306966eaead9cc5dbb3a7ed1"
server_key_version: "encryptionkey@0"
I20260808 04:41:07.362764 32360 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786164000593138-21443-0/minicluster-data/ts-0/wal/instance:
uuid: "fb71842da3f04b93a7c0fa8d14bdd2c7"
format_stamp: "Formatted at 2026-08-08 04:41:07 on dist-test-slave-vxj2"
server_key: "998cc1bdcaa7e793bdf6064d9285cf77"
server_key_iv: "e23c9158306966eaead9cc5dbb3a7ed1"
server_key_version: "encryptionkey@0"
I20260808 04:41:07.366784 32360 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260808 04:41:07.369529 32376 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:41:07.370889 32360 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260808 04:41:07.371060 32360 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786164000593138-21443-0/minicluster-data/ts-0/data,/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786164000593138-21443-0/minicluster-data/ts-0/wal
uuid: "fb71842da3f04b93a7c0fa8d14bdd2c7"
format_stamp: "Formatted at 2026-08-08 04:41:07 on dist-test-slave-vxj2"
server_key: "998cc1bdcaa7e793bdf6064d9285cf77"
server_key_iv: "e23c9158306966eaead9cc5dbb3a7ed1"
server_key_version: "encryptionkey@0"
I20260808 04:41:07.371188 32360 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786164000593138-21443-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786164000593138-21443-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786164000593138-21443-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:41:07.385058 32360 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:41:07.389277 32360 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:41:07.389506 32360 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:41:07.390169 32360 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 04:41:07.391081 32360 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 04:41:07.391155 32360 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 04:41:07.391223 32360 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 04:41:07.391253 32360 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 04:41:07.400363 32360 rpc_server.cc:307] RPC server started. Bound to: 127.20.240.193:40313
I20260808 04:41:07.400429 32496 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.240.193:40313 every 8 connection(s)
I20260808 04:41:07.401575 32360 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786164000593138-21443-0/minicluster-data/ts-0/data/info.pb
I20260808 04:41:07.404465 21443 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu as pid 32360
I20260808 04:41:07.404598 21443 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786164000593138-21443-0/minicluster-data/ts-0/wal/instance
I20260808 04:41:07.404954 21443 external_mini_cluster.cc:1428] Setting key b3a6eb97e08dcdb997dc2c67b8afe55d
Aug 08 04:41:07 dist-test-slave-vxj2 krb5kdc[32238](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164067, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.240.193@KRBTEST.COM for kudu/127.20.240.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.20.240.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.240.194@KRBTEST.COM" created.
I20260808 04:41:07.419670 32332 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:41:07.403578 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.240.193:32917 (local address 127.20.240.254:35057)
0808 04:41:07.403720 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0808 04:41:07.403724 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:41:07.404898 (+ 1174us) server_negotiation.cc:407] Connection header received
0808 04:41:07.406636 (+ 1738us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:41:07.406640 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:41:07.406697 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:41:07.406806 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:41:07.408460 (+ 1654us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:41:07.409475 (+ 1015us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:41:07.411730 (+ 2255us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:41:07.412047 (+ 317us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:41:07.412147 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:41:07.415675 (+ 3528us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:41:07.415678 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:41:07.415680 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:41:07.415706 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:41:07.417290 (+ 1584us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:41:07.417946 (+ 656us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:41:07.417949 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:41:07.417950 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:41:07.418031 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:41:07.418391 (+ 360us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:41:07.418393 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:41:07.418394 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:41:07.418584 (+ 190us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:41:07.418748 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0808 04:41:07.419326 (+ 578us) server_negotiation.cc:299] Negotiation successful
0808 04:41:07.419465 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260808 04:41:07.420990 32499 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:41:07.404095 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:35057 (local address 127.20.240.193:32917)
0808 04:41:07.404672 (+ 577us) negotiation.cc:107] Waiting for socket to connect
0808 04:41:07.404736 (+ 64us) client_negotiation.cc:174] Beginning negotiation
0808 04:41:07.406396 (+ 1660us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:41:07.406979 (+ 583us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:41:07.406990 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:41:07.407534 (+ 544us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:41:07.408273 (+ 739us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:41:07.408296 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:41:07.409645 (+ 1349us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:41:07.409649 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:41:07.411551 (+ 1902us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:41:07.411569 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:41:07.412254 (+ 685us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:41:07.412259 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:41:07.412538 (+ 279us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:41:07.413331 (+ 793us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:41:07.413364 (+ 33us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:41:07.415458 (+ 2094us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:41:07.417405 (+ 1947us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:41:07.417411 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:41:07.417426 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:41:07.417830 (+ 404us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:41:07.418144 (+ 314us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:41:07.418147 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:41:07.418148 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:41:07.418299 (+ 151us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:41:07.418749 (+ 450us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:41:07.418755 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:41:07.419061 (+ 306us) client_negotiation.cc:769] Sending connection context
0808 04:41:07.419243 (+ 182us) client_negotiation.cc:240] Negotiation successful
0808 04:41:07.419655 (+ 412us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":321,"thread_start_us":132,"threads_started":1}
I20260808 04:41:07.422526 32497 heartbeater.cc:347] Connected to a master server at 127.20.240.254:35057
I20260808 04:41:07.422788 32497 heartbeater.cc:464] Registering TS with master...
I20260808 04:41:07.423308 32497 heartbeater.cc:511] Master 127.20.240.254:35057 requested a full tablet report, sending...
I20260808 04:41:07.425145 32291 ts_manager.cc:194] Registered new tserver with Master: fb71842da3f04b93a7c0fa8d14bdd2c7 (127.20.240.193:40313)
I20260808 04:41:07.426992 32291 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.240.193@KRBTEST.COM'} at 127.20.240.193:32917
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.240.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.194.keytab.
Entry for principal kudu/127.20.240.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.194.keytab.
I20260808 04:41:07.438999 21443 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
/tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786164000593138-21443-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786164000593138-21443-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786164000593138-21443-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786164000593138-21443-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.240.194:0
--local_ip_for_outbound_sockets=127.20.240.194
--webserver_interface=127.20.240.194
--webserver_port=0
--tserver_master_addrs=127.20.240.254:35057
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.194.keytab
--principal=kudu/127.20.240.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.240.212:35847
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786164000593138-21443-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786164000593138-21443-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786164000593138-21443-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 04:41:07.557246 32502 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:41:07.557600 32502 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:41:07.557696 32502 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:41:07.562014 32502 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:41:07.562137 32502 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:41:07.562237 32502 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.240.194
I20260808 04:41:07.568001 32502 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.240.212:35847
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786164000593138-21443-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786164000593138-21443-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.194.keytab
--principal=kudu/127.20.240.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.240.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786164000593138-21443-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.240.194
--webserver_port=0
--tserver_master_addrs=127.20.240.254:35057
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32502
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.240.194
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786164000593138-21443-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 04:05:18 UTC on ccycloud.quasar-drfdgt.root.comops.site
build id 4574101
I20260808 04:41:07.569244 32502 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:41:07.570326 32502 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260808 04:41:07.580687 32502 server_base.cc:1034] running on GCE node
W20260808 04:41:07.580708 32509 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:41:07.580912 32511 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:41:07.580941 32507 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:41:07.581552 32502 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:41:07.582240 32502 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:41:07.583425 32502 hybrid_clock.cc:648] HybridClock initialized: now 1786164067583392 us; error 50 us; skew 500 ppm
Aug 08 04:41:07 dist-test-slave-vxj2 krb5kdc[32238](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164067, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.240.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:41:07.586447 32502 init.cc:377] Logged in from keytab as kudu/127.20.240.194@KRBTEST.COM (short username kudu)
I20260808 04:41:07.587308 32502 webserver.cc:460] Webserver started at http://127.20.240.194:46207/ using document root <none> and password file <none>
I20260808 04:41:07.587826 32502 fs_manager.cc:359] Metadata directory not provided
I20260808 04:41:07.587885 32502 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:41:07.588047 32502 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 04:41:07.590180 32502 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786164000593138-21443-0/minicluster-data/ts-1/data/instance:
uuid: "c154a2256ac049fcbfd535a2aba96e37"
format_stamp: "Formatted at 2026-08-08 04:41:07 on dist-test-slave-vxj2"
server_key: "d77c7cf51d19adbde83cf11513b33fb2"
server_key_iv: "0c8892ba92cb2f8f4f22340768944687"
server_key_version: "encryptionkey@0"
I20260808 04:41:07.590687 32502 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786164000593138-21443-0/minicluster-data/ts-1/wal/instance:
uuid: "c154a2256ac049fcbfd535a2aba96e37"
format_stamp: "Formatted at 2026-08-08 04:41:07 on dist-test-slave-vxj2"
server_key: "d77c7cf51d19adbde83cf11513b33fb2"
server_key_iv: "0c8892ba92cb2f8f4f22340768944687"
server_key_version: "encryptionkey@0"
I20260808 04:41:07.594489 32502 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260808 04:41:07.596989 32520 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:41:07.598282 32502 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 04:41:07.598424 32502 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786164000593138-21443-0/minicluster-data/ts-1/data,/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786164000593138-21443-0/minicluster-data/ts-1/wal
uuid: "c154a2256ac049fcbfd535a2aba96e37"
format_stamp: "Formatted at 2026-08-08 04:41:07 on dist-test-slave-vxj2"
server_key: "d77c7cf51d19adbde83cf11513b33fb2"
server_key_iv: "0c8892ba92cb2f8f4f22340768944687"
server_key_version: "encryptionkey@0"
I20260808 04:41:07.598537 32502 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786164000593138-21443-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786164000593138-21443-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786164000593138-21443-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:41:07.608667 32502 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:41:07.612176 32502 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:41:07.612421 32502 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:41:07.613062 32502 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 04:41:07.614001 32502 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 04:41:07.614051 32502 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 04:41:07.614123 32502 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 04:41:07.614158 32502 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 04:41:07.623792 32502 rpc_server.cc:307] RPC server started. Bound to: 127.20.240.194:44253
I20260808 04:41:07.623816 32647 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.240.194:44253 every 8 connection(s)
I20260808 04:41:07.624823 32502 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786164000593138-21443-0/minicluster-data/ts-1/data/info.pb
I20260808 04:41:07.626652 21443 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu as pid 32502
I20260808 04:41:07.626798 21443 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786164000593138-21443-0/minicluster-data/ts-1/wal/instance
I20260808 04:41:07.627100 21443 external_mini_cluster.cc:1428] Setting key fd5656df37338797c216db3f39991598
WARNING: no policy specified for kudu/127.20.240.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.240.195@KRBTEST.COM" created.
Aug 08 04:41:07 dist-test-slave-vxj2 krb5kdc[32238](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164067, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.240.194@KRBTEST.COM for kudu/127.20.240.254@KRBTEST.COM
I20260808 04:41:07.647004 32332 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:41:07.628724 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.240.194:58441 (local address 127.20.240.254:35057)
0808 04:41:07.628875 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0808 04:41:07.628881 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 04:41:07.628898 (+ 17us) server_negotiation.cc:407] Connection header received
0808 04:41:07.631762 (+ 2864us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:41:07.631766 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:41:07.631828 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:41:07.631913 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:41:07.633857 (+ 1944us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:41:07.634615 (+ 758us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:41:07.636677 (+ 2062us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:41:07.636954 (+ 277us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:41:07.637064 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:41:07.642783 (+ 5719us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:41:07.642787 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:41:07.642790 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:41:07.642827 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:41:07.644418 (+ 1591us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:41:07.645070 (+ 652us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:41:07.645077 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:41:07.645081 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:41:07.645244 (+ 163us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:41:07.645650 (+ 406us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:41:07.645656 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:41:07.645661 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:41:07.645958 (+ 297us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:41:07.646090 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0808 04:41:07.646755 (+ 665us) server_negotiation.cc:299] Negotiation successful
0808 04:41:07.646875 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260808 04:41:07.647882 32650 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:41:07.627507 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:35057 (local address 127.20.240.194:58441)
0808 04:41:07.628167 (+ 660us) negotiation.cc:107] Waiting for socket to connect
0808 04:41:07.628214 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0808 04:41:07.631419 (+ 3205us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:41:07.632159 (+ 740us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:41:07.632173 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:41:07.632754 (+ 581us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:41:07.633608 (+ 854us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:41:07.633636 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:41:07.634799 (+ 1163us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:41:07.634804 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:41:07.636500 (+ 1696us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:41:07.636518 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:41:07.637199 (+ 681us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:41:07.637206 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:41:07.637458 (+ 252us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:41:07.638238 (+ 780us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:41:07.638269 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:41:07.642537 (+ 4268us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:41:07.644581 (+ 2044us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:41:07.644611 (+ 30us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:41:07.644629 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:41:07.644933 (+ 304us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:41:07.645363 (+ 430us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:41:07.645365 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:41:07.645367 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:41:07.645528 (+ 161us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:41:07.646147 (+ 619us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:41:07.646156 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:41:07.646456 (+ 300us) client_negotiation.cc:769] Sending connection context
0808 04:41:07.646643 (+ 187us) client_negotiation.cc:240] Negotiation successful
0808 04:41:07.646936 (+ 293us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":440,"thread_start_us":244,"threads_started":1}
I20260808 04:41:07.649222 32648 heartbeater.cc:347] Connected to a master server at 127.20.240.254:35057
I20260808 04:41:07.649473 32648 heartbeater.cc:464] Registering TS with master...
I20260808 04:41:07.650069 32648 heartbeater.cc:511] Master 127.20.240.254:35057 requested a full tablet report, sending...
I20260808 04:41:07.651242 32291 ts_manager.cc:194] Registered new tserver with Master: c154a2256ac049fcbfd535a2aba96e37 (127.20.240.194:44253)
I20260808 04:41:07.651829 32291 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.240.194@KRBTEST.COM'} at 127.20.240.194:58441
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.240.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.195.keytab.
Entry for principal kudu/127.20.240.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.195.keytab.
I20260808 04:41:07.661723 21443 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
/tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786164000593138-21443-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786164000593138-21443-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786164000593138-21443-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786164000593138-21443-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.240.195:0
--local_ip_for_outbound_sockets=127.20.240.195
--webserver_interface=127.20.240.195
--webserver_port=0
--tserver_master_addrs=127.20.240.254:35057
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.195.keytab
--principal=kudu/127.20.240.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.240.212:35847
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786164000593138-21443-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786164000593138-21443-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786164000593138-21443-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 04:41:07.777427 32653 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:41:07.777724 32653 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:41:07.777809 32653 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:41:07.781898 32653 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:41:07.782011 32653 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:41:07.782109 32653 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.240.195
I20260808 04:41:07.787739 32653 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.240.212:35847
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786164000593138-21443-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786164000593138-21443-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.195.keytab
--principal=kudu/127.20.240.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.240.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786164000593138-21443-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.240.195
--webserver_port=0
--tserver_master_addrs=127.20.240.254:35057
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32653
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.240.195
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786164000593138-21443-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 04:05:18 UTC on ccycloud.quasar-drfdgt.root.comops.site
build id 4574101
I20260808 04:41:07.788955 32653 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:41:07.790037 32653 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:41:07.800014 32660 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:41:07.799983 32659 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:41:07.800227 32653 server_base.cc:1034] running on GCE node
W20260808 04:41:07.799952 32662 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:41:07.800716 32653 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:41:07.801496 32653 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:41:07.802690 32653 hybrid_clock.cc:648] HybridClock initialized: now 1786164067802663 us; error 51 us; skew 500 ppm
Aug 08 04:41:07 dist-test-slave-vxj2 krb5kdc[32238](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164067, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.240.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:41:07.805513 32653 init.cc:377] Logged in from keytab as kudu/127.20.240.195@KRBTEST.COM (short username kudu)
I20260808 04:41:07.806501 32653 webserver.cc:460] Webserver started at http://127.20.240.195:43095/ using document root <none> and password file <none>
I20260808 04:41:07.807104 32653 fs_manager.cc:359] Metadata directory not provided
I20260808 04:41:07.807199 32653 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:41:07.807447 32653 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 04:41:07.809628 32653 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786164000593138-21443-0/minicluster-data/ts-2/data/instance:
uuid: "79f7684a17fd40859a15b4c70311013b"
format_stamp: "Formatted at 2026-08-08 04:41:07 on dist-test-slave-vxj2"
server_key: "ff1a7700f979005c87f1215544a59651"
server_key_iv: "b0ffc1617c6537604836353670b84c50"
server_key_version: "encryptionkey@0"
I20260808 04:41:07.810212 32653 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786164000593138-21443-0/minicluster-data/ts-2/wal/instance:
uuid: "79f7684a17fd40859a15b4c70311013b"
format_stamp: "Formatted at 2026-08-08 04:41:07 on dist-test-slave-vxj2"
server_key: "ff1a7700f979005c87f1215544a59651"
server_key_iv: "b0ffc1617c6537604836353670b84c50"
server_key_version: "encryptionkey@0"
I20260808 04:41:07.814582 32653 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.000s sys 0.004s
I20260808 04:41:07.817505 32671 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:41:07.818993 32653 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 04:41:07.819166 32653 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786164000593138-21443-0/minicluster-data/ts-2/data,/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786164000593138-21443-0/minicluster-data/ts-2/wal
uuid: "79f7684a17fd40859a15b4c70311013b"
format_stamp: "Formatted at 2026-08-08 04:41:07 on dist-test-slave-vxj2"
server_key: "ff1a7700f979005c87f1215544a59651"
server_key_iv: "b0ffc1617c6537604836353670b84c50"
server_key_version: "encryptionkey@0"
I20260808 04:41:07.819342 32653 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786164000593138-21443-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786164000593138-21443-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786164000593138-21443-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:41:07.835512 32653 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:41:07.839123 32653 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:41:07.839406 32653 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:41:07.840143 32653 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 04:41:07.841099 32653 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 04:41:07.841213 32653 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 04:41:07.841315 32653 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 04:41:07.841382 32653 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 04:41:07.851639 32653 rpc_server.cc:307] RPC server started. Bound to: 127.20.240.195:45799
I20260808 04:41:07.851734 327 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.240.195:45799 every 8 connection(s)
I20260808 04:41:07.852684 32653 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786164000593138-21443-0/minicluster-data/ts-2/data/info.pb
I20260808 04:41:07.859651 21443 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu as pid 32653
I20260808 04:41:07.859846 21443 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786164000593138-21443-0/minicluster-data/ts-2/wal/instance
I20260808 04:41:07.860231 21443 external_mini_cluster.cc:1428] Setting key d5305d2ad3532a76addb0b7f6e8fbc7b
Aug 08 04:41:07 dist-test-slave-vxj2 krb5kdc[32238](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164067, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.240.195@KRBTEST.COM for kudu/127.20.240.254@KRBTEST.COM
I20260808 04:41:07.869307 32332 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:41:07.854756 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.240.195:54249 (local address 127.20.240.254:35057)
0808 04:41:07.854937 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0808 04:41:07.854941 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:41:07.855842 (+ 901us) server_negotiation.cc:407] Connection header received
0808 04:41:07.857426 (+ 1584us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:41:07.857430 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:41:07.857495 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:41:07.857580 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:41:07.859292 (+ 1712us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:41:07.860117 (+ 825us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:41:07.862016 (+ 1899us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:41:07.862259 (+ 243us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:41:07.862378 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:41:07.865316 (+ 2938us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:41:07.865319 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:41:07.865322 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:41:07.865351 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:41:07.866790 (+ 1439us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:41:07.867403 (+ 613us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:41:07.867406 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:41:07.867408 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:41:07.867504 (+ 96us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:41:07.867937 (+ 433us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:41:07.867941 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:41:07.867942 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:41:07.868147 (+ 205us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:41:07.868228 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0808 04:41:07.868880 (+ 652us) server_negotiation.cc:299] Negotiation successful
0808 04:41:07.869033 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82}
I20260808 04:41:07.870064 330 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:41:07.855141 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:35057 (local address 127.20.240.195:54249)
0808 04:41:07.855645 (+ 504us) negotiation.cc:107] Waiting for socket to connect
0808 04:41:07.855688 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0808 04:41:07.857070 (+ 1382us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:41:07.857760 (+ 690us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:41:07.857767 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:41:07.858384 (+ 617us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:41:07.859122 (+ 738us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:41:07.859143 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:41:07.860321 (+ 1178us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:41:07.860325 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:41:07.861876 (+ 1551us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:41:07.861888 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:41:07.862425 (+ 537us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:41:07.862429 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:41:07.862635 (+ 206us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:41:07.863440 (+ 805us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:41:07.863459 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:41:07.865070 (+ 1611us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:41:07.866915 (+ 1845us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:41:07.866922 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:41:07.866939 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:41:07.867240 (+ 301us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:41:07.867629 (+ 389us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:41:07.867632 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:41:07.867633 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:41:07.867795 (+ 162us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:41:07.868249 (+ 454us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:41:07.868255 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:41:07.868533 (+ 278us) client_negotiation.cc:769] Sending connection context
0808 04:41:07.868707 (+ 174us) client_negotiation.cc:240] Negotiation successful
0808 04:41:07.869043 (+ 336us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":320,"thread_start_us":148,"threads_started":1}
I20260808 04:41:07.871317 328 heartbeater.cc:347] Connected to a master server at 127.20.240.254:35057
I20260808 04:41:07.871608 328 heartbeater.cc:464] Registering TS with master...
I20260808 04:41:07.872162 328 heartbeater.cc:511] Master 127.20.240.254:35057 requested a full tablet report, sending...
I20260808 04:41:07.873404 32291 ts_manager.cc:194] Registered new tserver with Master: 79f7684a17fd40859a15b4c70311013b (127.20.240.195:45799)
I20260808 04:41:07.874181 32291 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.240.195@KRBTEST.COM'} at 127.20.240.195:54249
I20260808 04:41:07.875499 21443 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 04:41:07.885964 32332 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:41:07.878020 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39184 (local address 127.20.240.254:35057)
0808 04:41:07.878224 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0808 04:41:07.878229 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 04:41:07.878381 (+ 152us) server_negotiation.cc:407] Connection header received
0808 04:41:07.878559 (+ 178us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:41:07.878562 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:41:07.878617 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:41:07.878703 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:41:07.879484 (+ 781us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:41:07.880016 (+ 532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:41:07.880868 (+ 852us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:41:07.881127 (+ 259us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:41:07.881303 (+ 176us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:41:07.882734 (+ 1431us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:41:07.882737 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:41:07.882740 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:41:07.882777 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:41:07.884041 (+ 1264us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:41:07.884508 (+ 467us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:41:07.884512 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:41:07.884514 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:41:07.884608 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:41:07.884914 (+ 306us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:41:07.884917 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:41:07.884919 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:41:07.885236 (+ 317us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:41:07.885391 (+ 155us) server_negotiation.cc:1035] Waiting for connection context
0808 04:41:07.885656 (+ 265us) server_negotiation.cc:299] Negotiation successful
0808 04:41:07.885784 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":102}
I20260808 04:41:07.889668 32291 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39184:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 04:41:07.892699 32291 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 04:41:07.908313 347 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:41:07.903353 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58248 (local address 127.20.240.194:44253)
0808 04:41:07.903743 (+ 390us) server_negotiation.cc:206] Beginning negotiation
0808 04:41:07.903756 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0808 04:41:07.903779 (+ 23us) server_negotiation.cc:407] Connection header received
0808 04:41:07.903858 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:41:07.903863 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:41:07.904045 (+ 182us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:41:07.904211 (+ 166us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 04:41:07.904421 (+ 210us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:41:07.905643 (+ 1222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:41:07.907006 (+ 1363us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:41:07.907556 (+ 550us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:41:07.907695 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:41:07.907841 (+ 146us) server_negotiation.cc:1035] Waiting for connection context
0808 04:41:07.908042 (+ 201us) server_negotiation.cc:299] Negotiation successful
0808 04:41:07.908143 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":281,"thread_start_us":147,"threads_started":1}
I20260808 04:41:07.908308 346 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:41:07.902933 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.194:44253 (local address 127.0.0.1:58248)
0808 04:41:07.903209 (+ 276us) negotiation.cc:107] Waiting for socket to connect
0808 04:41:07.903224 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 04:41:07.903383 (+ 159us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:41:07.904195 (+ 812us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:41:07.904198 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:41:07.904217 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 04:41:07.904323 (+ 106us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:41:07.904329 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:41:07.905791 (+ 1462us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:41:07.905795 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:41:07.906888 (+ 1093us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:41:07.906896 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:41:07.907693 (+ 797us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:41:07.907697 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:41:07.907816 (+ 119us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:41:07.907880 (+ 64us) client_negotiation.cc:769] Sending connection context
0808 04:41:07.908009 (+ 129us) client_negotiation.cc:240] Negotiation successful
0808 04:41:07.908139 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":205,"mutex_wait_us":62,"thread_start_us":103,"threads_started":1}
I20260808 04:41:07.908665 344 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:41:07.901805 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57356 (local address 127.20.240.195:45799)
0808 04:41:07.902743 (+ 938us) server_negotiation.cc:206] Beginning negotiation
0808 04:41:07.902771 (+ 28us) server_negotiation.cc:399] Waiting for connection header
0808 04:41:07.902798 (+ 27us) server_negotiation.cc:407] Connection header received
0808 04:41:07.903001 (+ 203us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:41:07.903010 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:41:07.903231 (+ 221us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:41:07.903389 (+ 158us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 04:41:07.903976 (+ 587us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:41:07.905023 (+ 1047us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:41:07.906605 (+ 1582us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:41:07.907540 (+ 935us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:41:07.907699 (+ 159us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:41:07.907841 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0808 04:41:07.908384 (+ 543us) server_negotiation.cc:299] Negotiation successful
0808 04:41:07.908510 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":822,"thread_start_us":180,"threads_started":1}
I20260808 04:41:07.909075 342 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:41:07.901764 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.193:40313 (local address 127.0.0.1:54764)
0808 04:41:07.902617 (+ 853us) negotiation.cc:107] Waiting for socket to connect
0808 04:41:07.902633 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 04:41:07.902781 (+ 148us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:41:07.903736 (+ 955us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:41:07.903738 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:41:07.903752 (+ 14us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 04:41:07.903839 (+ 87us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:41:07.903844 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:41:07.905842 (+ 1998us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:41:07.905846 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:41:07.906932 (+ 1086us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:41:07.906944 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:41:07.908119 (+ 1175us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:41:07.908126 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:41:07.908232 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:41:07.908252 (+ 20us) client_negotiation.cc:769] Sending connection context
0808 04:41:07.908302 (+ 50us) client_negotiation.cc:240] Negotiation successful
0808 04:41:07.908373 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":774,"mutex_wait_us":9,"spinlock_wait_cycles":5760,"thread_start_us":88,"threads_started":1}
I20260808 04:41:07.909363 343 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:41:07.901646 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.195:45799 (local address 127.0.0.1:57356)
0808 04:41:07.902574 (+ 928us) negotiation.cc:107] Waiting for socket to connect
0808 04:41:07.902631 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0808 04:41:07.902779 (+ 148us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:41:07.903609 (+ 830us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:41:07.903615 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:41:07.903641 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 04:41:07.903834 (+ 193us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:41:07.903841 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:41:07.905167 (+ 1326us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:41:07.905174 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:41:07.906440 (+ 1266us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:41:07.906451 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:41:07.907916 (+ 1465us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:41:07.907921 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:41:07.908044 (+ 123us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:41:07.908083 (+ 39us) client_negotiation.cc:769] Sending connection context
0808 04:41:07.908158 (+ 75us) client_negotiation.cc:240] Negotiation successful
0808 04:41:07.908236 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":730,"spinlock_wait_cycles":5120,"thread_start_us":123,"threads_started":1}
I20260808 04:41:07.910159 345 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:41:07.902501 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54764 (local address 127.20.240.193:40313)
0808 04:41:07.903177 (+ 676us) server_negotiation.cc:206] Beginning negotiation
0808 04:41:07.903193 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0808 04:41:07.903219 (+ 26us) server_negotiation.cc:407] Connection header received
0808 04:41:07.903317 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:41:07.903326 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:41:07.903538 (+ 212us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:41:07.903748 (+ 210us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 04:41:07.903944 (+ 196us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:41:07.905636 (+ 1692us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:41:07.907086 (+ 1450us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:41:07.907972 (+ 886us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:41:07.909697 (+ 1725us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:41:07.909852 (+ 155us) server_negotiation.cc:1035] Waiting for connection context
0808 04:41:07.909905 (+ 53us) server_negotiation.cc:299] Negotiation successful
0808 04:41:07.910002 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":537,"thread_start_us":107,"threads_started":1}
I20260808 04:41:07.911705 32574 tablet_service.cc:1467] Processing CreateTablet for tablet e8e1743f3a0542feb6b0403956ceb462 (DEFAULT_TABLE table=test-table [id=b48e7a556a164cf0a9e3befeae622fe8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 04:41:07.912113 32726 tablet_service.cc:1467] Processing CreateTablet for tablet e8e1743f3a0542feb6b0403956ceb462 (DEFAULT_TABLE table=test-table [id=b48e7a556a164cf0a9e3befeae622fe8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 04:41:07.913040 32574 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e8e1743f3a0542feb6b0403956ceb462. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:41:07.913041 32726 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e8e1743f3a0542feb6b0403956ceb462. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:41:07.912729 32428 tablet_service.cc:1467] Processing CreateTablet for tablet e8e1743f3a0542feb6b0403956ceb462 (DEFAULT_TABLE table=test-table [id=b48e7a556a164cf0a9e3befeae622fe8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 04:41:07.913930 32428 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e8e1743f3a0542feb6b0403956ceb462. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:41:07.920656 349 tablet_bootstrap.cc:492] T e8e1743f3a0542feb6b0403956ceb462 P fb71842da3f04b93a7c0fa8d14bdd2c7: Bootstrap starting.
I20260808 04:41:07.921545 350 tablet_bootstrap.cc:492] T e8e1743f3a0542feb6b0403956ceb462 P c154a2256ac049fcbfd535a2aba96e37: Bootstrap starting.
I20260808 04:41:07.922013 351 tablet_bootstrap.cc:492] T e8e1743f3a0542feb6b0403956ceb462 P 79f7684a17fd40859a15b4c70311013b: Bootstrap starting.
I20260808 04:41:07.924036 349 tablet_bootstrap.cc:654] T e8e1743f3a0542feb6b0403956ceb462 P fb71842da3f04b93a7c0fa8d14bdd2c7: Neither blocks nor log segments found. Creating new log.
I20260808 04:41:07.924139 351 tablet_bootstrap.cc:654] T e8e1743f3a0542feb6b0403956ceb462 P 79f7684a17fd40859a15b4c70311013b: Neither blocks nor log segments found. Creating new log.
I20260808 04:41:07.924338 350 tablet_bootstrap.cc:654] T e8e1743f3a0542feb6b0403956ceb462 P c154a2256ac049fcbfd535a2aba96e37: Neither blocks nor log segments found. Creating new log.
I20260808 04:41:07.925184 349 log.cc:824] T e8e1743f3a0542feb6b0403956ceb462 P fb71842da3f04b93a7c0fa8d14bdd2c7: Log is configured to *not* fsync() on all Append() calls
I20260808 04:41:07.925261 350 log.cc:824] T e8e1743f3a0542feb6b0403956ceb462 P c154a2256ac049fcbfd535a2aba96e37: Log is configured to *not* fsync() on all Append() calls
I20260808 04:41:07.925428 351 log.cc:824] T e8e1743f3a0542feb6b0403956ceb462 P 79f7684a17fd40859a15b4c70311013b: Log is configured to *not* fsync() on all Append() calls
I20260808 04:41:07.927295 350 tablet_bootstrap.cc:492] T e8e1743f3a0542feb6b0403956ceb462 P c154a2256ac049fcbfd535a2aba96e37: No bootstrap required, opened a new log
I20260808 04:41:07.927531 351 tablet_bootstrap.cc:492] T e8e1743f3a0542feb6b0403956ceb462 P 79f7684a17fd40859a15b4c70311013b: No bootstrap required, opened a new log
I20260808 04:41:07.927531 349 tablet_bootstrap.cc:492] T e8e1743f3a0542feb6b0403956ceb462 P fb71842da3f04b93a7c0fa8d14bdd2c7: No bootstrap required, opened a new log
I20260808 04:41:07.927544 350 ts_tablet_manager.cc:1397] T e8e1743f3a0542feb6b0403956ceb462 P c154a2256ac049fcbfd535a2aba96e37: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260808 04:41:07.927742 351 ts_tablet_manager.cc:1397] T e8e1743f3a0542feb6b0403956ceb462 P 79f7684a17fd40859a15b4c70311013b: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260808 04:41:07.927742 349 ts_tablet_manager.cc:1397] T e8e1743f3a0542feb6b0403956ceb462 P fb71842da3f04b93a7c0fa8d14bdd2c7: Time spent bootstrapping tablet: real 0.007s user 0.005s sys 0.000s
I20260808 04:41:07.930677 350 raft_consensus.cc:348] T e8e1743f3a0542feb6b0403956ceb462 P c154a2256ac049fcbfd535a2aba96e37 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f7684a17fd40859a15b4c70311013b" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 45799 } } peers { permanent_uuid: "fb71842da3f04b93a7c0fa8d14bdd2c7" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 40313 } } peers { permanent_uuid: "c154a2256ac049fcbfd535a2aba96e37" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 44253 } }
I20260808 04:41:07.930962 350 raft_consensus.cc:374] T e8e1743f3a0542feb6b0403956ceb462 P c154a2256ac049fcbfd535a2aba96e37 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:41:07.931025 350 raft_consensus.cc:729] T e8e1743f3a0542feb6b0403956ceb462 P c154a2256ac049fcbfd535a2aba96e37 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c154a2256ac049fcbfd535a2aba96e37, State: Initialized, Role: FOLLOWER
I20260808 04:41:07.931578 350 consensus_queue.cc:260] T e8e1743f3a0542feb6b0403956ceb462 P c154a2256ac049fcbfd535a2aba96e37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f7684a17fd40859a15b4c70311013b" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 45799 } } peers { permanent_uuid: "fb71842da3f04b93a7c0fa8d14bdd2c7" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 40313 } } peers { permanent_uuid: "c154a2256ac049fcbfd535a2aba96e37" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 44253 } }
I20260808 04:41:07.932310 351 raft_consensus.cc:348] T e8e1743f3a0542feb6b0403956ceb462 P 79f7684a17fd40859a15b4c70311013b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f7684a17fd40859a15b4c70311013b" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 45799 } } peers { permanent_uuid: "fb71842da3f04b93a7c0fa8d14bdd2c7" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 40313 } } peers { permanent_uuid: "c154a2256ac049fcbfd535a2aba96e37" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 44253 } }
I20260808 04:41:07.932421 349 raft_consensus.cc:348] T e8e1743f3a0542feb6b0403956ceb462 P fb71842da3f04b93a7c0fa8d14bdd2c7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f7684a17fd40859a15b4c70311013b" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 45799 } } peers { permanent_uuid: "fb71842da3f04b93a7c0fa8d14bdd2c7" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 40313 } } peers { permanent_uuid: "c154a2256ac049fcbfd535a2aba96e37" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 44253 } }
I20260808 04:41:07.932610 351 raft_consensus.cc:374] T e8e1743f3a0542feb6b0403956ceb462 P 79f7684a17fd40859a15b4c70311013b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:41:07.932665 349 raft_consensus.cc:374] T e8e1743f3a0542feb6b0403956ceb462 P fb71842da3f04b93a7c0fa8d14bdd2c7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:41:07.932680 351 raft_consensus.cc:729] T e8e1743f3a0542feb6b0403956ceb462 P 79f7684a17fd40859a15b4c70311013b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79f7684a17fd40859a15b4c70311013b, State: Initialized, Role: FOLLOWER
I20260808 04:41:07.932721 350 ts_tablet_manager.cc:1428] T e8e1743f3a0542feb6b0403956ceb462 P c154a2256ac049fcbfd535a2aba96e37: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20260808 04:41:07.932741 349 raft_consensus.cc:729] T e8e1743f3a0542feb6b0403956ceb462 P fb71842da3f04b93a7c0fa8d14bdd2c7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fb71842da3f04b93a7c0fa8d14bdd2c7, State: Initialized, Role: FOLLOWER
I20260808 04:41:07.933111 32648 heartbeater.cc:503] Master 127.20.240.254:35057 was elected leader, sending a full tablet report...
I20260808 04:41:07.933213 351 consensus_queue.cc:260] T e8e1743f3a0542feb6b0403956ceb462 P 79f7684a17fd40859a15b4c70311013b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f7684a17fd40859a15b4c70311013b" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 45799 } } peers { permanent_uuid: "fb71842da3f04b93a7c0fa8d14bdd2c7" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 40313 } } peers { permanent_uuid: "c154a2256ac049fcbfd535a2aba96e37" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 44253 } }
I20260808 04:41:07.933213 349 consensus_queue.cc:260] T e8e1743f3a0542feb6b0403956ceb462 P fb71842da3f04b93a7c0fa8d14bdd2c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f7684a17fd40859a15b4c70311013b" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 45799 } } peers { permanent_uuid: "fb71842da3f04b93a7c0fa8d14bdd2c7" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 40313 } } peers { permanent_uuid: "c154a2256ac049fcbfd535a2aba96e37" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 44253 } }
I20260808 04:41:07.933923 32497 heartbeater.cc:503] Master 127.20.240.254:35057 was elected leader, sending a full tablet report...
I20260808 04:41:07.934289 349 ts_tablet_manager.cc:1428] T e8e1743f3a0542feb6b0403956ceb462 P fb71842da3f04b93a7c0fa8d14bdd2c7: Time spent starting tablet: real 0.006s user 0.003s sys 0.004s
I20260808 04:41:07.934293 328 heartbeater.cc:503] Master 127.20.240.254:35057 was elected leader, sending a full tablet report...
I20260808 04:41:07.934900 351 ts_tablet_manager.cc:1428] T e8e1743f3a0542feb6b0403956ceb462 P 79f7684a17fd40859a15b4c70311013b: Time spent starting tablet: real 0.007s user 0.007s sys 0.000s
I20260808 04:41:08.045704 356 raft_consensus.cc:482] T e8e1743f3a0542feb6b0403956ceb462 P fb71842da3f04b93a7c0fa8d14bdd2c7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 04:41:08.045984 356 raft_consensus.cc:504] T e8e1743f3a0542feb6b0403956ceb462 P fb71842da3f04b93a7c0fa8d14bdd2c7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f7684a17fd40859a15b4c70311013b" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 45799 } } peers { permanent_uuid: "fb71842da3f04b93a7c0fa8d14bdd2c7" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 40313 } } peers { permanent_uuid: "c154a2256ac049fcbfd535a2aba96e37" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 44253 } }
I20260808 04:41:08.047252 356 leader_election.cc:288] T e8e1743f3a0542feb6b0403956ceb462 P fb71842da3f04b93a7c0fa8d14bdd2c7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79f7684a17fd40859a15b4c70311013b (127.20.240.195:45799), c154a2256ac049fcbfd535a2aba96e37 (127.20.240.194:44253)
I20260808 04:41:08.048676 357 raft_consensus.cc:482] T e8e1743f3a0542feb6b0403956ceb462 P 79f7684a17fd40859a15b4c70311013b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 04:41:08.048874 357 raft_consensus.cc:504] T e8e1743f3a0542feb6b0403956ceb462 P 79f7684a17fd40859a15b4c70311013b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f7684a17fd40859a15b4c70311013b" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 45799 } } peers { permanent_uuid: "fb71842da3f04b93a7c0fa8d14bdd2c7" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 40313 } } peers { permanent_uuid: "c154a2256ac049fcbfd535a2aba96e37" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 44253 } }
I20260808 04:41:08.050190 357 leader_election.cc:288] T e8e1743f3a0542feb6b0403956ceb462 P 79f7684a17fd40859a15b4c70311013b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fb71842da3f04b93a7c0fa8d14bdd2c7 (127.20.240.193:40313), c154a2256ac049fcbfd535a2aba96e37 (127.20.240.194:44253)
I20260808 04:41:08.052666 347 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:41:08.047736 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.240.193:53231 (local address 127.20.240.194:44253)
0808 04:41:08.047887 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0808 04:41:08.047894 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 04:41:08.048171 (+ 277us) server_negotiation.cc:407] Connection header received
0808 04:41:08.048344 (+ 173us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:41:08.048347 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:41:08.048400 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:41:08.048492 (+ 92us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 04:41:08.049012 (+ 520us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:41:08.049727 (+ 715us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:41:08.051322 (+ 1595us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:41:08.051955 (+ 633us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:41:08.052069 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:41:08.052121 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0808 04:41:08.052456 (+ 335us) server_negotiation.cc:299] Negotiation successful
0808 04:41:08.052533 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260808 04:41:08.052800 344 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:41:08.047978 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.240.193:42515 (local address 127.20.240.195:45799)
0808 04:41:08.048136 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0808 04:41:08.048147 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 04:41:08.048160 (+ 13us) server_negotiation.cc:407] Connection header received
0808 04:41:08.048206 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:41:08.048209 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:41:08.048250 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:41:08.048334 (+ 84us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 04:41:08.048647 (+ 313us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:41:08.049477 (+ 830us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:41:08.051370 (+ 1893us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:41:08.052006 (+ 636us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:41:08.052092 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:41:08.052139 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0808 04:41:08.052558 (+ 419us) server_negotiation.cc:299] Negotiation successful
0808 04:41:08.052657 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260808 04:41:08.053508 359 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:41:08.047642 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.194:44253 (local address 127.20.240.193:53231)
0808 04:41:08.048046 (+ 404us) negotiation.cc:107] Waiting for socket to connect
0808 04:41:08.048061 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 04:41:08.048212 (+ 151us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:41:08.048667 (+ 455us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:41:08.048671 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:41:08.048691 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 04:41:08.048829 (+ 138us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:41:08.048836 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:41:08.049834 (+ 998us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:41:08.049840 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:41:08.051211 (+ 1371us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:41:08.051222 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:41:08.052191 (+ 969us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:41:08.052195 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:41:08.052298 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:41:08.052340 (+ 42us) client_negotiation.cc:769] Sending connection context
0808 04:41:08.053255 (+ 915us) client_negotiation.cc:240] Negotiation successful
0808 04:41:08.053334 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":337,"mutex_wait_us":271,"thread_start_us":135,"threads_started":1}
I20260808 04:41:08.053967 358 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:41:08.047513 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.195:45799 (local address 127.20.240.193:42515)
0808 04:41:08.047866 (+ 353us) negotiation.cc:107] Waiting for socket to connect
0808 04:41:08.047883 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 04:41:08.048003 (+ 120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:41:08.048360 (+ 357us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:41:08.048363 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:41:08.048380 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 04:41:08.048532 (+ 152us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:41:08.048537 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:41:08.049610 (+ 1073us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:41:08.049613 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:41:08.050967 (+ 1354us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:41:08.050982 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:41:08.052302 (+ 1320us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:41:08.052307 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:41:08.052419 (+ 112us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:41:08.052440 (+ 21us) client_negotiation.cc:769] Sending connection context
0808 04:41:08.053210 (+ 770us) client_negotiation.cc:240] Negotiation successful
0808 04:41:08.053295 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":274,"mutex_wait_us":1,"thread_start_us":156,"threads_started":1}
I20260808 04:41:08.054152 32595 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e8e1743f3a0542feb6b0403956ceb462" candidate_uuid: "fb71842da3f04b93a7c0fa8d14bdd2c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c154a2256ac049fcbfd535a2aba96e37" is_pre_election: true
I20260808 04:41:08.054522 32595 raft_consensus.cc:2454] T e8e1743f3a0542feb6b0403956ceb462 P c154a2256ac049fcbfd535a2aba96e37 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fb71842da3f04b93a7c0fa8d14bdd2c7 in term 0.
I20260808 04:41:08.054564 32747 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e8e1743f3a0542feb6b0403956ceb462" candidate_uuid: "fb71842da3f04b93a7c0fa8d14bdd2c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79f7684a17fd40859a15b4c70311013b" is_pre_election: true
I20260808 04:41:08.054774 32747 raft_consensus.cc:2454] T e8e1743f3a0542feb6b0403956ceb462 P 79f7684a17fd40859a15b4c70311013b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fb71842da3f04b93a7c0fa8d14bdd2c7 in term 0.
I20260808 04:41:08.054934 330 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:41:08.050356 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.193:40313 (local address 127.20.240.195:43901)
0808 04:41:08.050591 (+ 235us) negotiation.cc:107] Waiting for socket to connect
0808 04:41:08.050604 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 04:41:08.050681 (+ 77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:41:08.051197 (+ 516us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:41:08.051202 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:41:08.051221 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 04:41:08.051333 (+ 112us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:41:08.051339 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:41:08.052355 (+ 1016us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:41:08.052358 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:41:08.053589 (+ 1231us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:41:08.053601 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:41:08.054526 (+ 925us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:41:08.054530 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:41:08.054635 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:41:08.054657 (+ 22us) client_negotiation.cc:769] Sending connection context
0808 04:41:08.054732 (+ 75us) client_negotiation.cc:240] Negotiation successful
0808 04:41:08.054815 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":171,"mutex_wait_us":70}
I20260808 04:41:08.055068 32379 leader_election.cc:302] T e8e1743f3a0542feb6b0403956ceb462 P fb71842da3f04b93a7c0fa8d14bdd2c7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c154a2256ac049fcbfd535a2aba96e37, fb71842da3f04b93a7c0fa8d14bdd2c7; no voters:
I20260808 04:41:08.055326 345 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:41:08.050802 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.240.195:43901 (local address 127.20.240.193:40313)
0808 04:41:08.050915 (+ 113us) server_negotiation.cc:206] Beginning negotiation
0808 04:41:08.050919 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:41:08.050932 (+ 13us) server_negotiation.cc:407] Connection header received
0808 04:41:08.050971 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:41:08.050974 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:41:08.051013 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:41:08.051083 (+ 70us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 04:41:08.051503 (+ 420us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:41:08.052189 (+ 686us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:41:08.053733 (+ 1544us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:41:08.054302 (+ 569us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:41:08.054411 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:41:08.054469 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0808 04:41:08.055153 (+ 684us) server_negotiation.cc:299] Negotiation successful
0808 04:41:08.055219 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260808 04:41:08.055629 356 raft_consensus.cc:2781] T e8e1743f3a0542feb6b0403956ceb462 P fb71842da3f04b93a7c0fa8d14bdd2c7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 04:41:08.055725 356 raft_consensus.cc:482] T e8e1743f3a0542feb6b0403956ceb462 P fb71842da3f04b93a7c0fa8d14bdd2c7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 04:41:08.055706 32448 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e8e1743f3a0542feb6b0403956ceb462" candidate_uuid: "79f7684a17fd40859a15b4c70311013b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fb71842da3f04b93a7c0fa8d14bdd2c7" is_pre_election: true
I20260808 04:41:08.055840 356 raft_consensus.cc:3037] T e8e1743f3a0542feb6b0403956ceb462 P fb71842da3f04b93a7c0fa8d14bdd2c7 [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:41:08.056403 360 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:41:08.050500 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.194:44253 (local address 127.20.240.195:50857)
0808 04:41:08.051089 (+ 589us) negotiation.cc:107] Waiting for socket to connect
0808 04:41:08.051103 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 04:41:08.051183 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:41:08.051515 (+ 332us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:41:08.051518 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:41:08.051535 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 04:41:08.051642 (+ 107us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:41:08.051647 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:41:08.052647 (+ 1000us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:41:08.052650 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:41:08.054730 (+ 2080us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:41:08.054741 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:41:08.056093 (+ 1352us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:41:08.056096 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:41:08.056172 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:41:08.056190 (+ 18us) client_negotiation.cc:769] Sending connection context
0808 04:41:08.056247 (+ 57us) client_negotiation.cc:240] Negotiation successful
0808 04:41:08.056297 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":506,"mutex_wait_us":8,"thread_start_us":107,"threads_started":1}
I20260808 04:41:08.056471 361 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:41:08.050851 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.240.195:50857 (local address 127.20.240.194:44253)
0808 04:41:08.051186 (+ 335us) server_negotiation.cc:206] Beginning negotiation
0808 04:41:08.051195 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 04:41:08.051208 (+ 13us) server_negotiation.cc:407] Connection header received
0808 04:41:08.051254 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:41:08.051259 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:41:08.051324 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:41:08.051405 (+ 81us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 04:41:08.051769 (+ 364us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:41:08.052517 (+ 748us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:41:08.054924 (+ 2407us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:41:08.055970 (+ 1046us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:41:08.056105 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:41:08.056170 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0808 04:41:08.056265 (+ 95us) server_negotiation.cc:299] Negotiation successful
0808 04:41:08.056332 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":269,"thread_start_us":104,"threads_started":1}
I20260808 04:41:08.057013 32595 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e8e1743f3a0542feb6b0403956ceb462" candidate_uuid: "79f7684a17fd40859a15b4c70311013b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c154a2256ac049fcbfd535a2aba96e37" is_pre_election: true
I20260808 04:41:08.057185 32595 raft_consensus.cc:2454] T e8e1743f3a0542feb6b0403956ceb462 P c154a2256ac049fcbfd535a2aba96e37 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79f7684a17fd40859a15b4c70311013b in term 0.
I20260808 04:41:08.057420 356 raft_consensus.cc:504] T e8e1743f3a0542feb6b0403956ceb462 P fb71842da3f04b93a7c0fa8d14bdd2c7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f7684a17fd40859a15b4c70311013b" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 45799 } } peers { permanent_uuid: "fb71842da3f04b93a7c0fa8d14bdd2c7" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 40313 } } peers { permanent_uuid: "c154a2256ac049fcbfd535a2aba96e37" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 44253 } }
I20260808 04:41:08.057559 32674 leader_election.cc:302] T e8e1743f3a0542feb6b0403956ceb462 P 79f7684a17fd40859a15b4c70311013b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79f7684a17fd40859a15b4c70311013b, c154a2256ac049fcbfd535a2aba96e37; no voters:
I20260808 04:41:08.057852 356 leader_election.cc:288] T e8e1743f3a0542feb6b0403956ceb462 P fb71842da3f04b93a7c0fa8d14bdd2c7 [CANDIDATE]: Term 1 election: Requested vote from peers 79f7684a17fd40859a15b4c70311013b (127.20.240.195:45799), c154a2256ac049fcbfd535a2aba96e37 (127.20.240.194:44253)
I20260808 04:41:08.057900 357 raft_consensus.cc:2781] T e8e1743f3a0542feb6b0403956ceb462 P 79f7684a17fd40859a15b4c70311013b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 04:41:08.058039 357 raft_consensus.cc:482] T e8e1743f3a0542feb6b0403956ceb462 P 79f7684a17fd40859a15b4c70311013b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 04:41:08.058058 32448 raft_consensus.cc:2379] T e8e1743f3a0542feb6b0403956ceb462 P fb71842da3f04b93a7c0fa8d14bdd2c7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79f7684a17fd40859a15b4c70311013b in current term 1: Already voted for candidate fb71842da3f04b93a7c0fa8d14bdd2c7 in this term.
I20260808 04:41:08.058105 357 raft_consensus.cc:3037] T e8e1743f3a0542feb6b0403956ceb462 P 79f7684a17fd40859a15b4c70311013b [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:41:08.058209 32747 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e8e1743f3a0542feb6b0403956ceb462" candidate_uuid: "fb71842da3f04b93a7c0fa8d14bdd2c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79f7684a17fd40859a15b4c70311013b"
I20260808 04:41:08.059187 32595 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e8e1743f3a0542feb6b0403956ceb462" candidate_uuid: "fb71842da3f04b93a7c0fa8d14bdd2c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c154a2256ac049fcbfd535a2aba96e37"
I20260808 04:41:08.059489 32595 raft_consensus.cc:3037] T e8e1743f3a0542feb6b0403956ceb462 P c154a2256ac049fcbfd535a2aba96e37 [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:41:08.059541 357 raft_consensus.cc:504] T e8e1743f3a0542feb6b0403956ceb462 P 79f7684a17fd40859a15b4c70311013b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f7684a17fd40859a15b4c70311013b" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 45799 } } peers { permanent_uuid: "fb71842da3f04b93a7c0fa8d14bdd2c7" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 40313 } } peers { permanent_uuid: "c154a2256ac049fcbfd535a2aba96e37" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 44253 } }
I20260808 04:41:08.059759 32747 raft_consensus.cc:2379] T e8e1743f3a0542feb6b0403956ceb462 P 79f7684a17fd40859a15b4c70311013b [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate fb71842da3f04b93a7c0fa8d14bdd2c7 in current term 1: Already voted for candidate 79f7684a17fd40859a15b4c70311013b in this term.
I20260808 04:41:08.059931 357 leader_election.cc:288] T e8e1743f3a0542feb6b0403956ceb462 P 79f7684a17fd40859a15b4c70311013b [CANDIDATE]: Term 1 election: Requested vote from peers fb71842da3f04b93a7c0fa8d14bdd2c7 (127.20.240.193:40313), c154a2256ac049fcbfd535a2aba96e37 (127.20.240.194:44253)
I20260808 04:41:08.060493 32594 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e8e1743f3a0542feb6b0403956ceb462" candidate_uuid: "79f7684a17fd40859a15b4c70311013b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c154a2256ac049fcbfd535a2aba96e37"
I20260808 04:41:08.060981 32595 raft_consensus.cc:2454] T e8e1743f3a0542feb6b0403956ceb462 P c154a2256ac049fcbfd535a2aba96e37 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fb71842da3f04b93a7c0fa8d14bdd2c7 in term 1.
I20260808 04:41:08.061319 32379 leader_election.cc:302] T e8e1743f3a0542feb6b0403956ceb462 P fb71842da3f04b93a7c0fa8d14bdd2c7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c154a2256ac049fcbfd535a2aba96e37, fb71842da3f04b93a7c0fa8d14bdd2c7; no voters: 79f7684a17fd40859a15b4c70311013b
I20260808 04:41:08.061280 32448 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e8e1743f3a0542feb6b0403956ceb462" candidate_uuid: "79f7684a17fd40859a15b4c70311013b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fb71842da3f04b93a7c0fa8d14bdd2c7"
I20260808 04:41:08.061471 32448 raft_consensus.cc:2379] T e8e1743f3a0542feb6b0403956ceb462 P fb71842da3f04b93a7c0fa8d14bdd2c7 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 79f7684a17fd40859a15b4c70311013b in current term 1: Already voted for candidate fb71842da3f04b93a7c0fa8d14bdd2c7 in this term.
I20260808 04:41:08.061640 356 raft_consensus.cc:2781] T e8e1743f3a0542feb6b0403956ceb462 P fb71842da3f04b93a7c0fa8d14bdd2c7 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 04:41:08.061776 32675 leader_election.cc:302] T e8e1743f3a0542feb6b0403956ceb462 P 79f7684a17fd40859a15b4c70311013b [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79f7684a17fd40859a15b4c70311013b; no voters: c154a2256ac049fcbfd535a2aba96e37, fb71842da3f04b93a7c0fa8d14bdd2c7
I20260808 04:41:08.061905 356 raft_consensus.cc:686] T e8e1743f3a0542feb6b0403956ceb462 P fb71842da3f04b93a7c0fa8d14bdd2c7 [term 1 LEADER]: Becoming Leader. State: Replica: fb71842da3f04b93a7c0fa8d14bdd2c7, State: Running, Role: LEADER
I20260808 04:41:08.062075 357 raft_consensus.cc:2726] T e8e1743f3a0542feb6b0403956ceb462 P 79f7684a17fd40859a15b4c70311013b [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260808 04:41:08.062280 356 consensus_queue.cc:237] T e8e1743f3a0542feb6b0403956ceb462 P fb71842da3f04b93a7c0fa8d14bdd2c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f7684a17fd40859a15b4c70311013b" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 45799 } } peers { permanent_uuid: "fb71842da3f04b93a7c0fa8d14bdd2c7" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 40313 } } peers { permanent_uuid: "c154a2256ac049fcbfd535a2aba96e37" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 44253 } }
I20260808 04:41:08.065802 32291 catalog_manager.cc:5495] T e8e1743f3a0542feb6b0403956ceb462 P fb71842da3f04b93a7c0fa8d14bdd2c7 reported cstate change: term changed from 0 to 1, leader changed from <none> to fb71842da3f04b93a7c0fa8d14bdd2c7 (127.20.240.193). New cstate: current_term: 1 leader_uuid: "fb71842da3f04b93a7c0fa8d14bdd2c7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f7684a17fd40859a15b4c70311013b" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 45799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fb71842da3f04b93a7c0fa8d14bdd2c7" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 40313 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c154a2256ac049fcbfd535a2aba96e37" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 44253 } health_report { overall_health: UNKNOWN } } }
I20260808 04:41:08.099928 345 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:41:08.096128 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54770 (local address 127.20.240.193:40313)
0808 04:41:08.096294 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0808 04:41:08.096301 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 04:41:08.096319 (+ 18us) server_negotiation.cc:407] Connection header received
0808 04:41:08.096447 (+ 128us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:41:08.096451 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:41:08.096535 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:41:08.096664 (+ 129us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 04:41:08.096959 (+ 295us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:41:08.097543 (+ 584us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:41:08.098429 (+ 886us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:41:08.098652 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:41:08.098762 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:41:08.099104 (+ 342us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 04:41:08.099522 (+ 418us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 04:41:08.099656 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0808 04:41:08.099722 (+ 66us) server_negotiation.cc:299] Negotiation successful
0808 04:41:08.099779 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
W20260808 04:41:08.103870 329 tablet.cc:2369] T e8e1743f3a0542feb6b0403956ceb462 P 79f7684a17fd40859a15b4c70311013b: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 04:41:08.106359 32747 raft_consensus.cc:1261] T e8e1743f3a0542feb6b0403956ceb462 P 79f7684a17fd40859a15b4c70311013b [term 1 FOLLOWER]: Refusing update from remote peer fb71842da3f04b93a7c0fa8d14bdd2c7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 04:41:08.106392 32595 raft_consensus.cc:1261] T e8e1743f3a0542feb6b0403956ceb462 P c154a2256ac049fcbfd535a2aba96e37 [term 1 FOLLOWER]: Refusing update from remote peer fb71842da3f04b93a7c0fa8d14bdd2c7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 04:41:08.107007 356 consensus_queue.cc:1035] T e8e1743f3a0542feb6b0403956ceb462 P fb71842da3f04b93a7c0fa8d14bdd2c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79f7684a17fd40859a15b4c70311013b" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 45799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 04:41:08.107271 362 consensus_queue.cc:1035] T e8e1743f3a0542feb6b0403956ceb462 P fb71842da3f04b93a7c0fa8d14bdd2c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c154a2256ac049fcbfd535a2aba96e37" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 44253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 04:41:08.116576 367 mvcc.cc:205] Tried to move back new op lower bound from 7316128022956158976 to 7316128022786220032. Current Snapshot: MvccSnapshot[applied={T|T < 7316128022956158976}]
I20260808 04:41:08.125113 32291 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39184:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 04:41:08.125371 32291 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39184:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 04:41:08.128342 32291 catalog_manager.cc:5782] T 00000000000000000000000000000000 P b786694e82364d4b9396120de8a184f5: Sending DeleteTablet for 3 replicas of tablet e8e1743f3a0542feb6b0403956ceb462
I20260808 04:41:08.129292 32428 tablet_service.cc:1514] Processing DeleteTablet for tablet e8e1743f3a0542feb6b0403956ceb462 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 04:41:08 UTC) from {username='kudu', principal='kudu/127.20.240.254@KRBTEST.COM'} at 127.0.0.1:54764
I20260808 04:41:08.129324 32726 tablet_service.cc:1514] Processing DeleteTablet for tablet e8e1743f3a0542feb6b0403956ceb462 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 04:41:08 UTC) from {username='kudu', principal='kudu/127.20.240.254@KRBTEST.COM'} at 127.0.0.1:57356
I20260808 04:41:08.129434 32574 tablet_service.cc:1514] Processing DeleteTablet for tablet e8e1743f3a0542feb6b0403956ceb462 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 04:41:08 UTC) from {username='kudu', principal='kudu/127.20.240.254@KRBTEST.COM'} at 127.0.0.1:58248
I20260808 04:41:08.129920 378 tablet_replica.cc:330] T e8e1743f3a0542feb6b0403956ceb462 P 79f7684a17fd40859a15b4c70311013b: stopping tablet replica
I20260808 04:41:08.130345 378 raft_consensus.cc:2229] T e8e1743f3a0542feb6b0403956ceb462 P 79f7684a17fd40859a15b4c70311013b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 04:41:08.130371 21443 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu with pid 32360
I20260808 04:41:08.130746 378 raft_consensus.cc:2258] T e8e1743f3a0542feb6b0403956ceb462 P 79f7684a17fd40859a15b4c70311013b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 04:41:08.131191 377 tablet_replica.cc:330] T e8e1743f3a0542feb6b0403956ceb462 P c154a2256ac049fcbfd535a2aba96e37: stopping tablet replica
I20260808 04:41:08.131448 377 raft_consensus.cc:2229] T e8e1743f3a0542feb6b0403956ceb462 P c154a2256ac049fcbfd535a2aba96e37 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 04:41:08.131731 377 raft_consensus.cc:2258] T e8e1743f3a0542feb6b0403956ceb462 P c154a2256ac049fcbfd535a2aba96e37 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 04:41:08.133396 378 ts_tablet_manager.cc:1905] T e8e1743f3a0542feb6b0403956ceb462 P 79f7684a17fd40859a15b4c70311013b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 04:41:08.134070 377 ts_tablet_manager.cc:1905] T e8e1743f3a0542feb6b0403956ceb462 P c154a2256ac049fcbfd535a2aba96e37: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 04:41:08.136668 378 ts_tablet_manager.cc:1918] T e8e1743f3a0542feb6b0403956ceb462 P 79f7684a17fd40859a15b4c70311013b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 04:41:08.136799 378 log.cc:1196] T e8e1743f3a0542feb6b0403956ceb462 P 79f7684a17fd40859a15b4c70311013b: Deleting WAL directory at /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786164000593138-21443-0/minicluster-data/ts-2/wal/wals/e8e1743f3a0542feb6b0403956ceb462
I20260808 04:41:08.137130 377 ts_tablet_manager.cc:1918] T e8e1743f3a0542feb6b0403956ceb462 P c154a2256ac049fcbfd535a2aba96e37: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 04:41:08.137228 378 ts_tablet_manager.cc:1939] T e8e1743f3a0542feb6b0403956ceb462 P 79f7684a17fd40859a15b4c70311013b: Deleting consensus metadata
I20260808 04:41:08.137262 377 log.cc:1196] T e8e1743f3a0542feb6b0403956ceb462 P c154a2256ac049fcbfd535a2aba96e37: Deleting WAL directory at /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786164000593138-21443-0/minicluster-data/ts-1/wal/wals/e8e1743f3a0542feb6b0403956ceb462
I20260808 04:41:08.137995 377 ts_tablet_manager.cc:1939] T e8e1743f3a0542feb6b0403956ceb462 P c154a2256ac049fcbfd535a2aba96e37: Deleting consensus metadata
I20260808 04:41:08.138859 32272 catalog_manager.cc:4841] TS 79f7684a17fd40859a15b4c70311013b (127.20.240.195:45799): tablet e8e1743f3a0542feb6b0403956ceb462 (table test-table [id=b48e7a556a164cf0a9e3befeae622fe8]) successfully deleted
I20260808 04:41:08.139168 32274 catalog_manager.cc:4841] TS c154a2256ac049fcbfd535a2aba96e37 (127.20.240.194:44253): tablet e8e1743f3a0542feb6b0403956ceb462 (table test-table [id=b48e7a556a164cf0a9e3befeae622fe8]) successfully deleted
W20260808 04:41:08.139380 32275 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.20.240.193:40313 (error 108)
I20260808 04:41:08.140219 21443 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu with pid 32502
I20260808 04:41:08.140456 343 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:41:08.140149 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.193:40313 (local address 127.0.0.1:54786)
0808 04:41:08.140289 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0808 04:41:08.140361 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.240.193:40313: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
W20260808 04:41:08.141661 32275 catalog_manager.cc:4584] TS fb71842da3f04b93a7c0fa8d14bdd2c7 (127.20.240.193:40313): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet e8e1743f3a0542feb6b0403956ceb462: Network error: Client connection negotiation failed: client connection to 127.20.240.193:40313: connect: Connection refused (error 111)
I20260808 04:41:08.148648 21443 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu with pid 32653
I20260808 04:41:08.157128 21443 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu with pid 32254
2026-08-08T04:41:08Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationSecureCluster (2482 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegration
Loading random data
Initializing database '/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786164000593138-21443-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 04:41:08 dist-test-slave-vxj2 krb5kdc[382](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 04:41:08 dist-test-slave-vxj2 krb5kdc[382](info): set up 2 sockets
Aug 08 04:41:08 dist-test-slave-vxj2 krb5kdc[382](info): commencing operation
krb5kdc: starting...
W20260808 04:41:09.255120 21443 mini_kdc.cc:121] Time spent starting KDC: real 1.073s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786164000593138-21443-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786164000593138-21443-0/krb5kdc/test-user.keytab.
Aug 08 04:41:09 dist-test-slave-vxj2 krb5kdc[382](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164069, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T04:41:09Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T04:41:09Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.20.240.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.20.240.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.20.240.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786164000593138-21443-0/krb5kdc/rangeradmin_127.20.240.212@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.20.240.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786164000593138-21443-0/krb5kdc/rangeradmin_127.20.240.212@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.20.240.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.20.240.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.20.240.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786164000593138-21443-0/krb5kdc/rangerlookup_127.20.240.212@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.20.240.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786164000593138-21443-0/krb5kdc/rangerlookup_127.20.240.212@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.20.240.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.20.240.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.20.240.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786164000593138-21443-0/krb5kdc/HTTP_127.20.240.212@KRBTEST.COM.keytab.
Entry for principal HTTP/127.20.240.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786164000593138-21443-0/krb5kdc/HTTP_127.20.240.212@KRBTEST.COM.keytab.
I20260808 04:41:09.436882 21443 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786164000593138-21443-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskgby_Qd/build/debug/bin/postgres/pg_ctl -D /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786164000593138-21443-0/minicluster-data/postgres -l logfile start
2026-08-08 04:41:12.247 UTC [417] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-08 04:41:12.247 UTC [417] LOG: listening on IPv4 address "127.20.240.212", port 50395
2026-08-08 04:41:12.251 UTC [417] LOG: listening on Unix socket "/tmp/.s.PGSQL.50395"
2026-08-08 04:41:12.274 UTC [420] LOG: database system was shut down at 2026-08-08 04:41:10 UTC
2026-08-08 04:41:12.278 UTC [417] LOG: database system is ready to accept connections
I20260808 04:41:13.289686 21443 mini_postgres.cc:96] Postgres bound to 50395
2026-08-08 04:41:13.297 UTC [428] FATAL: database "slave" does not exist
127.20.240.212:50395 - accepting connections
I20260808 04:41:13.297983 21443 mini_ranger.cc:161] Starting Ranger...
I20260808 04:41:13.315212 21443 mini_ranger.cc:84] Created miniranger Postgres user
I20260808 04:41:13.888034 21443 mini_ranger.cc:87] Created ranger Postgres database
I20260808 04:41:13.888120 21443 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786164000593138-21443-0/minicluster-data/ranger-admin
2026-08-08 04:41:14,211 [I] DB FLAVOR :POSTGRES
2026-08-08 04:41:14,211 [I] --------- Verifying Ranger DB connection ---------
2026-08-08 04:41:14,211 [I] Checking connection..
2026-08-08 04:41:14,211 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskgby_Qd/build/debug/bin/postgresql.jar:/tmp/dist-test-taskgby_Qd/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.240.212:50395/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-08 04:41:14,461 [I] Checking connection passed.
2026-08-08 04:41:14,462 [I] --------- Verifying version history table ---------
2026-08-08 04:41:14,462 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskgby_Qd/build/debug/bin/postgresql.jar:/tmp/dist-test-taskgby_Qd/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.240.212:50395/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-08 04:41:14,746 [I] Table x_db_version_h does not exist in database ranger
2026-08-08 04:41:14,747 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskgby_Qd/build/debug/bin/postgresql.jar:/tmp/dist-test-taskgby_Qd/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.240.212:50395/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-08 04:41:15,020 [I] Table x_db_version_h does not exist in database ranger
2026-08-08 04:41:15,021 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-08 04:41:15,021 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskgby_Qd/build/debug/bin/postgresql.jar:/tmp/dist-test-taskgby_Qd/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.240.212:50395/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskgby_Qd/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-08 04:41:15.277 UTC [502] WARNING: there is no transaction in progress
2026-08-08 04:41:15,285 [I] create_dbversion_catalog.sql file imported successfully
2026-08-08 04:41:15,286 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskgby_Qd/build/debug/bin/postgresql.jar:/tmp/dist-test-taskgby_Qd/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.240.212:50395/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-08 04:41:15,537 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-08 04:41:15,538 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-08 04:41:15,538 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskgby_Qd/build/debug/bin/postgresql.jar:/tmp/dist-test-taskgby_Qd/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.240.212:50395/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-08 04:41:15,787 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskgby_Qd/build/debug/bin/postgresql.jar:/tmp/dist-test-taskgby_Qd/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.240.212:50395/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-08 04:41:16,038 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskgby_Qd/build/debug/bin/postgresql.jar:/tmp/dist-test-taskgby_Qd/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.240.212:50395/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-vxj2.c.gcp-upstream.internal','N') ;"
2026-08-08 04:41:16,301 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskgby_Qd/build/debug/bin/postgresql.jar:/tmp/dist-test-taskgby_Qd/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.240.212:50395/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-08 04:41:16,552 [I] Table x_portal_user does not exist in database ranger
2026-08-08 04:41:16,552 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskgby_Qd/build/debug/bin/postgresql.jar:/tmp/dist-test-taskgby_Qd/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.240.212:50395/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-08 04:41:16,802 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-08 04:41:16,803 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskgby_Qd/build/debug/bin/postgresql.jar:/tmp/dist-test-taskgby_Qd/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.240.212:50395/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-08 04:41:17,046 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskgby_Qd/build/debug/bin/postgresql.jar:/tmp/dist-test-taskgby_Qd/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.240.212:50395/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-08 04:41:17,315 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-08 04:41:17,316 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskgby_Qd/build/debug/bin/postgresql.jar:/tmp/dist-test-taskgby_Qd/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.240.212:50395/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskgby_Qd/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-08 04:41:18.362 UTC [625] WARNING: there is no transaction in progress
2026-08-08 04:41:18.380 UTC [625] WARNING: there is no transaction in progress
2026-08-08 04:41:18.398 UTC [625] WARNING: there is no transaction in progress
2026-08-08 04:41:18.416 UTC [625] WARNING: there is no transaction in progress
2026-08-08 04:41:18.434 UTC [625] WARNING: there is no transaction in progress
2026-08-08 04:41:18.456 UTC [625] WARNING: there is no transaction in progress
2026-08-08 04:41:18.521 UTC [625] WARNING: there is no transaction in progress
2026-08-08 04:41:18.529 UTC [625] WARNING: there is no transaction in progress
2026-08-08 04:41:18.545 UTC [625] WARNING: there is no transaction in progress
2026-08-08 04:41:18.556 UTC [625] WARNING: there is no transaction in progress
2026-08-08 04:41:18.567 UTC [625] WARNING: there is no transaction in progress
2026-08-08 04:41:18.583 UTC [625] WARNING: there is no transaction in progress
2026-08-08 04:41:18.594 UTC [625] WARNING: there is no transaction in progress
2026-08-08 04:41:18.602 UTC [625] WARNING: there is no transaction in progress
2026-08-08 04:41:18.610 UTC [625] WARNING: there is no transaction in progress
2026-08-08 04:41:18.618 UTC [625] WARNING: there is no transaction in progress
2026-08-08 04:41:19,340 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-08 04:41:19,340 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskgby_Qd/build/debug/bin/postgresql.jar:/tmp/dist-test-taskgby_Qd/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.240.212:50395/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-08 04:41:19,610 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-08 04:41:19,611 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskgby_Qd/build/debug/bin/postgresql.jar:/tmp/dist-test-taskgby_Qd/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.240.212:50395/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-08 04:41:19,861 [I] Table x_portal_user already exists in database 'ranger'
2026-08-08 04:41:19,861 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskgby_Qd/build/debug/bin/postgresql.jar:/tmp/dist-test-taskgby_Qd/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.240.212:50395/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-08 04:41:20,151 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-08 04:41:20,151 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskgby_Qd/build/debug/bin/postgresql.jar:/tmp/dist-test-taskgby_Qd/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.240.212:50395/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-08 04:41:20,411 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskgby_Qd/build/debug/bin/postgresql.jar:/tmp/dist-test-taskgby_Qd/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.240.212:50395/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-08 04:41:20,676 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskgby_Qd/build/debug/bin/postgresql.jar:/tmp/dist-test-taskgby_Qd/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.240.212:50395/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-vxj2.c.gcp-upstream.internal';"
2026-08-08 04:41:20,943 [I] CORE_DB_SCHEMA import status has been updated
2026-08-08 04:41:20,943 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskgby_Qd/build/debug/bin/postgresql.jar:/tmp/dist-test-taskgby_Qd/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.240.212:50395/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-08 04:41:21,217 [I] DB_PATCHES have already been applied
I20260808 04:41:21.223150 21443 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786164000593138-21443-0/minicluster-data/ranger-admin:/tmp/dist-test-taskgby_Qd/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskgby_Qd/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskgby_Qd/build/debug/bin/postgresql.jar:/tmp/dist-test-taskgby_Qd/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260808 04:41:21.223227 21443 mini_ranger.cc:193] Using host: 127.20.240.212
I20260808 04:41:21.228008 21443 mini_ranger.cc:227] Ranger admin URL: http://127.20.240.212:43373
Aug 08, 2026 4:41:21 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 08, 2026 4:41:21 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 08, 2026 4:41:21 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786164000593138-21443-0/minicluster-data/ranger-admin/ews/webapp
Aug 08, 2026 4:41:21 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786164000593138-21443-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 08, 2026 4:41:21 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786164000593138-21443-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 08, 2026 4:41:22 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786164000593138-21443-0/minicluster-data/ranger-admin/ews/webapp].
Aug 08, 2026 4:41:22 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260808 04:41:22.439429 21443 mini_ranger.cc:160] Time spent starting Ranger: real 9.141s user 0.000s sys 0.012s
Aug 08, 2026 4:41:45 AM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 08, 2026 4:41:45 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.PublicAPIsv2
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.UserREST
Aug 08, 2026 4:41:45 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 08, 2026 4:41:45 AM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 08, 2026 4:41:45 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 08, 2026 4:41:45 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 08, 2026 4:41:45 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 08, 2026 4:41:45 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 08, 2026 4:41:45 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 08, 2026 4:41:45 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 08, 2026 4:41:45 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 08, 2026 4:41:45 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 08, 2026 4:41:45 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 08, 2026 4:41:45 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 08, 2026 4:41:45 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 08, 2026 4:41:45 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 08, 2026 4:41:45 AM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 08, 2026 4:41:45 AM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260808 04:41:46.621176 21443 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.20.240.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.20.240.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.20.240.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786164000593138-21443-0/krb5kdc/rangerkms_127.20.240.212@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.20.240.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786164000593138-21443-0/krb5kdc/rangerkms_127.20.240.212@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.20.240.212@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.20.240.212@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.20.240.212@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786164000593138-21443-0/krb5kdc/HTTP_127.20.240.212@KRBTEST.COM.keytab.
Entry for principal HTTP/127.20.240.212@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786164000593138-21443-0/krb5kdc/HTTP_127.20.240.212@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 08 04:41:46 dist-test-slave-vxj2 krb5kdc[382](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164106, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260808 04:41:46.722189 21443 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260808 04:41:46.733603 21443 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260808 04:41:47.682051 21443 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260808 04:41:47.682166 21443 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786164000593138-21443-0/minicluster-data/ranger-kms
I20260808 04:41:47.682305 21443 mini_ranger_kms.cc:227] Using postgres at 127.20.240.212:50395
2026-08-08 04:41:48,630 [I] DB FLAVOR :POSTGRES
2026-08-08 04:41:48,630 [I] --------- Verifying Ranger DB connection ---------
2026-08-08 04:41:48,630 [I] Checking connection
2026-08-08 04:41:48,630 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskgby_Qd/build/debug/bin/postgresql.jar:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786164000593138-21443-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.240.212:50395/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-08 04:41:48,931 [I] connection success
2026-08-08 04:41:48,931 [I] --------- Verifying Ranger DB tables ---------
2026-08-08 04:41:48,932 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-08 04:41:48,932 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskgby_Qd/build/debug/bin/postgresql.jar:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786164000593138-21443-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.240.212:50395/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-08 04:41:49,202 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-08 04:41:49,202 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-08 04:41:49,202 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-08 04:41:49,202 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskgby_Qd/build/debug/bin/postgresql.jar:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786164000593138-21443-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.240.212:50395/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786164000593138-21443-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-08 04:41:49,508 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260808 04:41:50.021071 21443 mini_ranger_kms.cc:310] Created kms service
I20260808 04:41:50.259166 21443 mini_ranger_kms.cc:326] Created kudu user
I20260808 04:41:50.309276 21443 mini_ranger_kms.cc:343] Created rangerkms user
Aug 08 04:41:50 dist-test-slave-vxj2 krb5kdc[382](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164106, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.20.240.212@KRBTEST.COM
I20260808 04:41:50.745023 21443 mini_ranger_kms.cc:384] Added ranger policy
I20260808 04:41:50.745234 21443 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786164000593138-21443-0/minicluster-data/ranger-kms:/tmp/dist-test-taskgby_Qd/build/debug/bin/postgresql.jar:/tmp/dist-test-taskgby_Qd/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskgby_Qd/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260808 04:41:50.745263 21443 mini_ranger_kms.cc:240] Using host: 127.20.240.212
I20260808 04:41:50.749927 21443 mini_ranger_kms.cc:276] Ranger KMS PID: 826
I20260808 04:41:50.750070 21443 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.20.240.212:40755
Aug 08, 2026 4:41:52 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 08, 2026 4:41:52 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 08, 2026 4:41:52 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786164000593138-21443-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 08, 2026 4:41:52 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786164000593138-21443-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 08, 2026 4:41:52 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786164000593138-21443-0/minicluster-data/ranger-kms/ews/webapp].
Aug 08, 2026 4:41:52 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
I20260808 04:41:53.189051 21443 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 6.467s user 0.066s sys 0.437s
I20260808 04:41:53.189248 21443 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260808 04:41:53.189375 21443 mini_ranger_kms.cc:401] 127.20.240.212:40755/kms/v1/keys
Aug 08 04:41:53 dist-test-slave-vxj2 krb5kdc[382](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786164113, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.20.240.212@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Aug 08 04:41:53 dist-test-slave-vxj2 krb5kdc[382](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164113, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.20.240.212@KRBTEST.COM for HTTP/127.20.240.212@KRBTEST.COM
Aug 08 04:41:54 dist-test-slave-vxj2 krb5kdc[382](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164113, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.20.240.212@KRBTEST.COM for HTTP/127.20.240.212@KRBTEST.COM
Aug 08 04:41:56 dist-test-slave-vxj2 krb5kdc[382](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164116, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.20.240.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.240.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.240.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.254.keytab.
Entry for principal kudu/127.20.240.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.254.keytab.
I20260808 04:41:56.842133 21443 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
/tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786164000593138-21443-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786164000593138-21443-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786164000593138-21443-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786164000593138-21443-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.240.254:43875
--webserver_interface=127.20.240.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.254.keytab
--principal=kudu/127.20.240.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.240.212:33585
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.240.254:43875
--ranger_config_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786164000593138-21443-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.20.240.212:40755/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786164000593138-21443-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786164000593138-21443-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786164000593138-21443-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 04:41:56.979668 878 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:41:56.979957 878 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:41:56.980001 878 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:41:56.984275 878 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 04:41:56.984354 878 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:41:56.984375 878 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:41:56.984392 878 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 04:41:56.984408 878 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 04:41:56.990434 878 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.240.212:33585
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786164000593138-21443-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786164000593138-21443-0/minicluster-data/master-0/wal
--ranger_kms_url=127.20.240.212:40755/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.20.240.254:43875
--ranger_config_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786164000593138-21443-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.254.keytab
--principal=kudu/127.20.240.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.240.254:43875
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786164000593138-21443-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.240.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.878
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786164000593138-21443-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 04:05:18 UTC on ccycloud.quasar-drfdgt.root.comops.site
build id 4574101
I20260808 04:41:56.991616 878 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:41:56.992695 878 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:41:57.001835 887 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:41:57.001864 885 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:41:57.002064 878 server_base.cc:1034] running on GCE node
W20260808 04:41:57.001878 884 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:41:57.002797 878 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:41:57.003959 878 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:41:57.005240 878 hybrid_clock.cc:648] HybridClock initialized: now 1786164117005213 us; error 38 us; skew 500 ppm
Aug 08 04:41:57 dist-test-slave-vxj2 krb5kdc[382](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164117, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.240.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:41:57.012344 878 init.cc:377] Logged in from keytab as kudu/127.20.240.254@KRBTEST.COM (short username kudu)
I20260808 04:41:57.013398 878 webserver.cc:460] Webserver started at http://127.20.240.254:36725/ using document root <none> and password file <none>
I20260808 04:41:57.013943 878 fs_manager.cc:359] Metadata directory not provided
I20260808 04:41:57.013998 878 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:41:57.014169 878 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 08 04:41:57 dist-test-slave-vxj2 krb5kdc[382](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164117, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.240.254@KRBTEST.COM for HTTP/127.20.240.212@KRBTEST.COM
I20260808 04:41:57.085959 878 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786164000593138-21443-0/minicluster-data/master-0/data/instance:
uuid: "7200556f03b8469faee3736204c84b7d"
format_stamp: "Formatted at 2026-08-08 04:41:57 on dist-test-slave-vxj2"
server_key: "af6d30fa3f4cf95dc092005a84128fa7"
server_key_iv: "7397996366f5b6dfd8cafa182922859b"
server_key_version: "kuduclusterkey@0"
I20260808 04:41:57.086609 878 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786164000593138-21443-0/minicluster-data/master-0/wal/instance:
uuid: "7200556f03b8469faee3736204c84b7d"
format_stamp: "Formatted at 2026-08-08 04:41:57 on dist-test-slave-vxj2"
server_key: "af6d30fa3f4cf95dc092005a84128fa7"
server_key_iv: "7397996366f5b6dfd8cafa182922859b"
server_key_version: "kuduclusterkey@0"
I20260808 04:41:57.090834 878 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260808 04:41:57.109236 895 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:41:57.110669 878 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260808 04:41:57.110827 878 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786164000593138-21443-0/minicluster-data/master-0/data,/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786164000593138-21443-0/minicluster-data/master-0/wal
uuid: "7200556f03b8469faee3736204c84b7d"
format_stamp: "Formatted at 2026-08-08 04:41:57 on dist-test-slave-vxj2"
server_key: "af6d30fa3f4cf95dc092005a84128fa7"
server_key_iv: "7397996366f5b6dfd8cafa182922859b"
server_key_version: "kuduclusterkey@0"
I20260808 04:41:57.110958 878 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786164000593138-21443-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786164000593138-21443-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786164000593138-21443-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:41:57.134943 878 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:41:57.138083 878 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:41:57.138559 878 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:41:57.149721 878 rpc_server.cc:307] RPC server started. Bound to: 127.20.240.254:43875
I20260808 04:41:57.149739 954 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.240.254:43875 every 8 connection(s)
I20260808 04:41:57.150768 878 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786164000593138-21443-0/minicluster-data/master-0/data/info.pb
I20260808 04:41:57.151623 21443 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu as pid 878
I20260808 04:41:57.151751 21443 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786164000593138-21443-0/minicluster-data/master-0/wal/instance
I20260808 04:41:57.152073 21443 external_mini_cluster.cc:1428] Setting key 85471ad01566d377eab82a70ae38a58d
I20260808 04:41:57.154333 955 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:41:57.161520 955 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7200556f03b8469faee3736204c84b7d: Bootstrap starting.
Aug 08 04:41:57 dist-test-slave-vxj2 krb5kdc[382](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164116, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.240.254@KRBTEST.COM
I20260808 04:41:57.164551 955 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7200556f03b8469faee3736204c84b7d: Neither blocks nor log segments found. Creating new log.
I20260808 04:41:57.165640 955 log.cc:824] T 00000000000000000000000000000000 P 7200556f03b8469faee3736204c84b7d: Log is configured to *not* fsync() on all Append() calls
I20260808 04:41:57.168483 955 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7200556f03b8469faee3736204c84b7d: No bootstrap required, opened a new log
I20260808 04:41:57.171135 958 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:41:57.153573 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59048 (local address 127.20.240.254:43875)
0808 04:41:57.154103 (+ 530us) server_negotiation.cc:206] Beginning negotiation
0808 04:41:57.154126 (+ 23us) server_negotiation.cc:399] Waiting for connection header
0808 04:41:57.154171 (+ 45us) server_negotiation.cc:407] Connection header received
0808 04:41:57.155280 (+ 1109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:41:57.155309 (+ 29us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:41:57.155805 (+ 496us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:41:57.156235 (+ 430us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:41:57.157357 (+ 1122us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:41:57.159238 (+ 1881us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:41:57.160547 (+ 1309us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:41:57.161413 (+ 866us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:41:57.161590 (+ 177us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:41:57.165255 (+ 3665us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:41:57.165262 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:41:57.165299 (+ 37us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:41:57.165364 (+ 65us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:41:57.168127 (+ 2763us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:41:57.168669 (+ 542us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:41:57.168676 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:41:57.168682 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:41:57.168808 (+ 126us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:41:57.169103 (+ 295us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:41:57.169107 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:41:57.169109 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:41:57.169561 (+ 452us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:41:57.169792 (+ 231us) server_negotiation.cc:1035] Waiting for connection context
0808 04:41:57.170061 (+ 269us) server_negotiation.cc:299] Negotiation successful
0808 04:41:57.170360 (+ 299us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":375,"thread_start_us":203,"threads_started":1}
I20260808 04:41:57.172994 955 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7200556f03b8469faee3736204c84b7d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7200556f03b8469faee3736204c84b7d" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 43875 } }
I20260808 04:41:57.173468 955 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7200556f03b8469faee3736204c84b7d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:41:57.173553 955 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7200556f03b8469faee3736204c84b7d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7200556f03b8469faee3736204c84b7d, State: Initialized, Role: FOLLOWER
I20260808 04:41:57.174068 955 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7200556f03b8469faee3736204c84b7d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7200556f03b8469faee3736204c84b7d" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 43875 } }
I20260808 04:41:57.174253 955 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7200556f03b8469faee3736204c84b7d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 04:41:57.174345 955 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7200556f03b8469faee3736204c84b7d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 04:41:57.174458 955 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7200556f03b8469faee3736204c84b7d [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:41:57.175856 955 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7200556f03b8469faee3736204c84b7d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7200556f03b8469faee3736204c84b7d" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 43875 } }
I20260808 04:41:57.176285 955 leader_election.cc:302] T 00000000000000000000000000000000 P 7200556f03b8469faee3736204c84b7d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7200556f03b8469faee3736204c84b7d; no voters:
I20260808 04:41:57.176728 955 leader_election.cc:288] T 00000000000000000000000000000000 P 7200556f03b8469faee3736204c84b7d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 04:41:57.176829 960 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7200556f03b8469faee3736204c84b7d [term 1 FOLLOWER]: Leader election won for term 1
I20260808 04:41:57.177366 960 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7200556f03b8469faee3736204c84b7d [term 1 LEADER]: Becoming Leader. State: Replica: 7200556f03b8469faee3736204c84b7d, State: Running, Role: LEADER
I20260808 04:41:57.177841 960 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7200556f03b8469faee3736204c84b7d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7200556f03b8469faee3736204c84b7d" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 43875 } }
I20260808 04:41:57.178435 955 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7200556f03b8469faee3736204c84b7d [sys.catalog]: configured and running, proceeding with master startup.
I20260808 04:41:57.179342 960 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7200556f03b8469faee3736204c84b7d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7200556f03b8469faee3736204c84b7d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7200556f03b8469faee3736204c84b7d" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 43875 } } }
I20260808 04:41:57.179576 960 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7200556f03b8469faee3736204c84b7d [sys.catalog]: This master's current role is: LEADER
I20260808 04:41:57.179893 960 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7200556f03b8469faee3736204c84b7d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7200556f03b8469faee3736204c84b7d. Latest consensus state: current_term: 1 leader_uuid: "7200556f03b8469faee3736204c84b7d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7200556f03b8469faee3736204c84b7d" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 43875 } } }
I20260808 04:41:57.180055 960 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7200556f03b8469faee3736204c84b7d [sys.catalog]: This master's current role is: LEADER
I20260808 04:41:57.181892 955 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786164000593138-21443-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260808 04:41:57.183247 969 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 04:41:57.190932 969 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 04:41:57.198993 969 catalog_manager.cc:1347] Generated new cluster ID: e711ee0112ec44dbb2fadfd2e0c3e302
I20260808 04:41:57.199077 969 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 04:41:57.231508 969 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 04:41:57.233220 969 catalog_manager.cc:1504] Loading token signing keys...
I20260808 04:41:57.249851 969 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 7200556f03b8469faee3736204c84b7d: Generated new TSK 0
I20260808 04:41:57.251166 969 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.20.240.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.240.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.240.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.193.keytab.
Entry for principal kudu/127.20.240.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.193.keytab.
I20260808 04:41:58.001905 21443 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
/tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786164000593138-21443-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786164000593138-21443-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786164000593138-21443-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786164000593138-21443-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.20.240.212:40755/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.240.193:0
--local_ip_for_outbound_sockets=127.20.240.193
--webserver_interface=127.20.240.193
--webserver_port=0
--tserver_master_addrs=127.20.240.254:43875
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.193.keytab
--principal=kudu/127.20.240.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.240.212:33585
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786164000593138-21443-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786164000593138-21443-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786164000593138-21443-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 04:41:58.192286 1003 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:41:58.192570 1003 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:41:58.192616 1003 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:41:58.197431 1003 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:41:58.197500 1003 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:41:58.197598 1003 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.240.193
I20260808 04:41:58.203588 1003 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.240.212:33585
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786164000593138-21443-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786164000593138-21443-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.20.240.212:40755/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.193.keytab
--principal=kudu/127.20.240.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.240.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786164000593138-21443-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.240.193
--webserver_port=0
--tserver_master_addrs=127.20.240.254:43875
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1003
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.240.193
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786164000593138-21443-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 04:05:18 UTC on ccycloud.quasar-drfdgt.root.comops.site
build id 4574101
I20260808 04:41:58.204790 1003 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:41:58.206292 1003 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260808 04:41:58.218298 1003 server_base.cc:1034] running on GCE node
W20260808 04:41:58.218201 1011 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:41:58.218573 1014 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:41:58.218850 1009 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:41:58.219329 1003 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:41:58.220104 1003 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:41:58.221292 1003 hybrid_clock.cc:648] HybridClock initialized: now 1786164118221240 us; error 54 us; skew 500 ppm
Aug 08 04:41:58 dist-test-slave-vxj2 krb5kdc[382](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164118, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.240.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:41:58.225049 1003 init.cc:377] Logged in from keytab as kudu/127.20.240.193@KRBTEST.COM (short username kudu)
I20260808 04:41:58.226364 1003 webserver.cc:460] Webserver started at http://127.20.240.193:37189/ using document root <none> and password file <none>
I20260808 04:41:58.227226 1003 fs_manager.cc:359] Metadata directory not provided
I20260808 04:41:58.227348 1003 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:41:58.227595 1003 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 08 04:41:58 dist-test-slave-vxj2 krb5kdc[382](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164118, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.240.193@KRBTEST.COM for HTTP/127.20.240.212@KRBTEST.COM
I20260808 04:41:58.252615 1003 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786164000593138-21443-0/minicluster-data/ts-0/data/instance:
uuid: "feceee543b3c43a8b8c7ad79fce3e542"
format_stamp: "Formatted at 2026-08-08 04:41:58 on dist-test-slave-vxj2"
server_key: "56b4b59da4cacdf397687103153b5e97"
server_key_iv: "5b08191c3e0a1a8ea52ecef870e74d40"
server_key_version: "kuduclusterkey@0"
I20260808 04:41:58.253698 1003 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786164000593138-21443-0/minicluster-data/ts-0/wal/instance:
uuid: "feceee543b3c43a8b8c7ad79fce3e542"
format_stamp: "Formatted at 2026-08-08 04:41:58 on dist-test-slave-vxj2"
server_key: "56b4b59da4cacdf397687103153b5e97"
server_key_iv: "5b08191c3e0a1a8ea52ecef870e74d40"
server_key_version: "kuduclusterkey@0"
I20260808 04:41:58.262992 1003 fs_manager.cc:691] Time spent creating directory manager: real 0.009s user 0.004s sys 0.000s
I20260808 04:41:58.282024 1024 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:41:58.284163 1003 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.002s sys 0.001s
I20260808 04:41:58.284350 1003 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786164000593138-21443-0/minicluster-data/ts-0/data,/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786164000593138-21443-0/minicluster-data/ts-0/wal
uuid: "feceee543b3c43a8b8c7ad79fce3e542"
format_stamp: "Formatted at 2026-08-08 04:41:58 on dist-test-slave-vxj2"
server_key: "56b4b59da4cacdf397687103153b5e97"
server_key_iv: "5b08191c3e0a1a8ea52ecef870e74d40"
server_key_version: "kuduclusterkey@0"
I20260808 04:41:58.284502 1003 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786164000593138-21443-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786164000593138-21443-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786164000593138-21443-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:41:58.302145 1003 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:41:58.306046 1003 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:41:58.306339 1003 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:41:58.307307 1003 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 04:41:58.308578 1003 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 04:41:58.308679 1003 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 04:41:58.308779 1003 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 04:41:58.308845 1003 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 04:41:58.325256 1003 rpc_server.cc:307] RPC server started. Bound to: 127.20.240.193:40863
I20260808 04:41:58.326745 1003 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786164000593138-21443-0/minicluster-data/ts-0/data/info.pb
I20260808 04:41:58.328693 1149 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.240.193:40863 every 8 connection(s)
I20260808 04:41:58.331750 21443 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu as pid 1003
I20260808 04:41:58.331887 21443 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786164000593138-21443-0/minicluster-data/ts-0/wal/instance
I20260808 04:41:58.332214 21443 external_mini_cluster.cc:1428] Setting key 7c9e9fb78ee0e7d9bd425b293f1174bd
Aug 08 04:41:58 dist-test-slave-vxj2 krb5kdc[382](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164118, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.240.193@KRBTEST.COM for kudu/127.20.240.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.20.240.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.240.194@KRBTEST.COM" created.
I20260808 04:41:58.355176 1153 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:41:58.330285 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:43875 (local address 127.20.240.193:47865)
0808 04:41:58.337831 (+ 7546us) negotiation.cc:107] Waiting for socket to connect
0808 04:41:58.337915 (+ 84us) client_negotiation.cc:174] Beginning negotiation
0808 04:41:58.339220 (+ 1305us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:41:58.340146 (+ 926us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:41:58.340156 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:41:58.340636 (+ 480us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:41:58.341519 (+ 883us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:41:58.341542 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:41:58.342858 (+ 1316us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:41:58.342862 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:41:58.344318 (+ 1456us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:41:58.344329 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:41:58.345210 (+ 881us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:41:58.345215 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:41:58.345459 (+ 244us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:41:58.346347 (+ 888us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:41:58.346369 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:41:58.348264 (+ 1895us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:41:58.351388 (+ 3124us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:41:58.351396 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:41:58.351420 (+ 24us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:41:58.351791 (+ 371us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:41:58.352132 (+ 341us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:41:58.352138 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:41:58.352141 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:41:58.352373 (+ 232us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:41:58.352865 (+ 492us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:41:58.352875 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:41:58.353287 (+ 412us) client_negotiation.cc:769] Sending connection context
0808 04:41:58.353519 (+ 232us) client_negotiation.cc:240] Negotiation successful
0808 04:41:58.353937 (+ 418us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":7252,"thread_start_us":152,"threads_started":1}
I20260808 04:41:58.361753 1154 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:41:58.332714 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.240.193:47865 (local address 127.20.240.254:43875)
0808 04:41:58.337403 (+ 4689us) server_negotiation.cc:206] Beginning negotiation
0808 04:41:58.337408 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 04:41:58.338073 (+ 665us) server_negotiation.cc:407] Connection header received
0808 04:41:58.339616 (+ 1543us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:41:58.339619 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:41:58.339677 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:41:58.339767 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:41:58.341745 (+ 1978us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:41:58.342691 (+ 946us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:41:58.344468 (+ 1777us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:41:58.344848 (+ 380us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:41:58.344933 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:41:58.348645 (+ 3712us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:41:58.348652 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:41:58.348658 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:41:58.348694 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:41:58.351181 (+ 2487us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:41:58.351927 (+ 746us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:41:58.351930 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:41:58.351932 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:41:58.352023 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:41:58.352498 (+ 475us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:41:58.352501 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:41:58.352503 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:41:58.352750 (+ 247us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:41:58.352860 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0808 04:41:58.361368 (+ 8508us) server_negotiation.cc:299] Negotiation successful
0808 04:41:58.361550 (+ 182us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":4591,"thread_start_us":66,"threads_started":1}
I20260808 04:41:58.363057 1150 heartbeater.cc:347] Connected to a master server at 127.20.240.254:43875
I20260808 04:41:58.363356 1150 heartbeater.cc:464] Registering TS with master...
I20260808 04:41:58.364040 1150 heartbeater.cc:511] Master 127.20.240.254:43875 requested a full tablet report, sending...
I20260808 04:41:58.366055 916 ts_manager.cc:194] Registered new tserver with Master: feceee543b3c43a8b8c7ad79fce3e542 (127.20.240.193:40863)
I20260808 04:41:58.367803 916 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.240.193@KRBTEST.COM'} at 127.20.240.193:47865
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.240.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.194.keytab.
Entry for principal kudu/127.20.240.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.194.keytab.
I20260808 04:41:58.378999 21443 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
/tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786164000593138-21443-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786164000593138-21443-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786164000593138-21443-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786164000593138-21443-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.20.240.212:40755/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.240.194:0
--local_ip_for_outbound_sockets=127.20.240.194
--webserver_interface=127.20.240.194
--webserver_port=0
--tserver_master_addrs=127.20.240.254:43875
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.194.keytab
--principal=kudu/127.20.240.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.240.212:33585
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786164000593138-21443-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786164000593138-21443-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786164000593138-21443-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 08 04:41:58 dist-test-slave-vxj2 krb5kdc[382](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786164118, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.240.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
W20260808 04:41:58.569743 1159 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:41:58.570272 1159 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:41:58.570410 1159 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:41:58.579654 1159 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:41:58.579842 1159 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:41:58.580026 1159 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.240.194
I20260808 04:41:58.589784 1159 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.240.212:33585
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786164000593138-21443-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786164000593138-21443-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.20.240.212:40755/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.194.keytab
--principal=kudu/127.20.240.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.240.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786164000593138-21443-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.240.194
--webserver_port=0
--tserver_master_addrs=127.20.240.254:43875
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1159
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.240.194
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786164000593138-21443-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 04:05:18 UTC on ccycloud.quasar-drfdgt.root.comops.site
build id 4574101
I20260808 04:41:58.591593 1159 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:41:58.593113 1159 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:41:58.607826 1168 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:41:58.608001 1165 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:41:58.608136 1166 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:41:58.608228 1159 server_base.cc:1034] running on GCE node
I20260808 04:41:58.608917 1159 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:41:58.609966 1159 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:41:58.611274 1159 hybrid_clock.cc:648] HybridClock initialized: now 1786164118611240 us; error 49 us; skew 500 ppm
Aug 08 04:41:58 dist-test-slave-vxj2 krb5kdc[382](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164118, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.240.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:41:58.615763 1159 init.cc:377] Logged in from keytab as kudu/127.20.240.194@KRBTEST.COM (short username kudu)
I20260808 04:41:58.617323 1159 webserver.cc:460] Webserver started at http://127.20.240.194:44523/ using document root <none> and password file <none>
I20260808 04:41:58.618139 1159 fs_manager.cc:359] Metadata directory not provided
I20260808 04:41:58.618235 1159 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:41:58.618579 1159 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 08 04:41:58 dist-test-slave-vxj2 krb5kdc[382](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164118, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.240.194@KRBTEST.COM for HTTP/127.20.240.212@KRBTEST.COM
I20260808 04:41:58.635871 1159 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786164000593138-21443-0/minicluster-data/ts-1/data/instance:
uuid: "261c23717439443ca2b408789b573f2d"
format_stamp: "Formatted at 2026-08-08 04:41:58 on dist-test-slave-vxj2"
server_key: "7b89d4c1850564fddadf61260ecadcdb"
server_key_iv: "901d4df8d750304d4b1892fcb6ca308f"
server_key_version: "kuduclusterkey@0"
I20260808 04:41:58.637311 1159 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786164000593138-21443-0/minicluster-data/ts-1/wal/instance:
uuid: "261c23717439443ca2b408789b573f2d"
format_stamp: "Formatted at 2026-08-08 04:41:58 on dist-test-slave-vxj2"
server_key: "7b89d4c1850564fddadf61260ecadcdb"
server_key_iv: "901d4df8d750304d4b1892fcb6ca308f"
server_key_version: "kuduclusterkey@0"
I20260808 04:41:58.646731 1159 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.000s sys 0.005s
I20260808 04:41:58.677820 1177 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:41:58.680135 1159 fs_manager.cc:725] Time spent opening block manager: real 0.017s user 0.001s sys 0.004s
I20260808 04:41:58.680384 1159 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786164000593138-21443-0/minicluster-data/ts-1/data,/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786164000593138-21443-0/minicluster-data/ts-1/wal
uuid: "261c23717439443ca2b408789b573f2d"
format_stamp: "Formatted at 2026-08-08 04:41:58 on dist-test-slave-vxj2"
server_key: "7b89d4c1850564fddadf61260ecadcdb"
server_key_iv: "901d4df8d750304d4b1892fcb6ca308f"
server_key_version: "kuduclusterkey@0"
I20260808 04:41:58.680653 1159 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786164000593138-21443-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786164000593138-21443-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786164000593138-21443-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:41:58.702190 1159 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:41:58.706310 1159 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:41:58.706611 1159 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:41:58.707548 1159 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 04:41:58.708737 1159 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 04:41:58.708878 1159 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 04:41:58.709003 1159 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 04:41:58.709070 1159 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 04:41:58.724519 1159 rpc_server.cc:307] RPC server started. Bound to: 127.20.240.194:35913
I20260808 04:41:58.725965 1159 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786164000593138-21443-0/minicluster-data/ts-1/data/info.pb
I20260808 04:41:58.727833 1301 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.240.194:35913 every 8 connection(s)
I20260808 04:41:58.735666 21443 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu as pid 1159
I20260808 04:41:58.735821 21443 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786164000593138-21443-0/minicluster-data/ts-1/wal/instance
I20260808 04:41:58.736184 21443 external_mini_cluster.cc:1428] Setting key 51a3feebaf2f4ed7f0f54b0c24e0f6f1
Aug 08 04:41:58 dist-test-slave-vxj2 krb5kdc[382](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164118, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.240.194@KRBTEST.COM for kudu/127.20.240.254@KRBTEST.COM
I20260808 04:41:58.747692 1154 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:41:58.732158 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.240.194:33441 (local address 127.20.240.254:43875)
0808 04:41:58.732323 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0808 04:41:58.732330 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 04:41:58.732719 (+ 389us) server_negotiation.cc:407] Connection header received
0808 04:41:58.734064 (+ 1345us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:41:58.734068 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:41:58.734132 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:41:58.734198 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:41:58.736099 (+ 1901us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:41:58.736863 (+ 764us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:41:58.738771 (+ 1908us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:41:58.739197 (+ 426us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:41:58.739292 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:41:58.742726 (+ 3434us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:41:58.742733 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:41:58.742740 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:41:58.742776 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:41:58.744732 (+ 1956us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:41:58.745546 (+ 814us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:41:58.745552 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:41:58.745557 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:41:58.745669 (+ 112us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:41:58.746143 (+ 474us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:41:58.746146 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:41:58.746148 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:41:58.746399 (+ 251us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:41:58.746517 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0808 04:41:58.747317 (+ 800us) server_negotiation.cc:299] Negotiation successful
0808 04:41:58.747478 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
WARNING: no policy specified for kudu/127.20.240.195@KRBTEST.COM; defaulting to no policy
I20260808 04:41:58.749648 1305 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:41:58.730968 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:43875 (local address 127.20.240.194:33441)
0808 04:41:58.732549 (+ 1581us) negotiation.cc:107] Waiting for socket to connect
0808 04:41:58.732606 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0808 04:41:58.733783 (+ 1177us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:41:58.734736 (+ 953us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:41:58.734745 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:41:58.735161 (+ 416us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:41:58.735901 (+ 740us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:41:58.735924 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:41:58.737239 (+ 1315us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:41:58.737242 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:41:58.738621 (+ 1379us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:41:58.738636 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:41:58.739520 (+ 884us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:41:58.739526 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:41:58.739767 (+ 241us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:41:58.740521 (+ 754us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:41:58.740547 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:41:58.742506 (+ 1959us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:41:58.744907 (+ 2401us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:41:58.744917 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:41:58.744939 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:41:58.745404 (+ 465us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:41:58.745794 (+ 390us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:41:58.745797 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:41:58.745800 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:41:58.746022 (+ 222us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:41:58.746598 (+ 576us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:41:58.746606 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:41:58.746999 (+ 393us) client_negotiation.cc:769] Sending connection context
0808 04:41:58.748177 (+ 1178us) client_negotiation.cc:240] Negotiation successful
0808 04:41:58.748589 (+ 412us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1360,"thread_start_us":148,"threads_started":1}
I20260808 04:41:58.750905 1302 heartbeater.cc:347] Connected to a master server at 127.20.240.254:43875
I20260808 04:41:58.751157 1302 heartbeater.cc:464] Registering TS with master...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.240.195@KRBTEST.COM" created.
I20260808 04:41:58.751752 1302 heartbeater.cc:511] Master 127.20.240.254:43875 requested a full tablet report, sending...
I20260808 04:41:58.752919 916 ts_manager.cc:194] Registered new tserver with Master: 261c23717439443ca2b408789b573f2d (127.20.240.194:35913)
I20260808 04:41:58.753865 916 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.240.194@KRBTEST.COM'} at 127.20.240.194:33441
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.240.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.195.keytab.
Entry for principal kudu/127.20.240.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.195.keytab.
I20260808 04:41:58.772058 21443 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
/tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786164000593138-21443-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786164000593138-21443-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786164000593138-21443-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786164000593138-21443-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.20.240.212:40755/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.240.195:0
--local_ip_for_outbound_sockets=127.20.240.195
--webserver_interface=127.20.240.195
--webserver_port=0
--tserver_master_addrs=127.20.240.254:43875
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.195.keytab
--principal=kudu/127.20.240.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.240.212:33585
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786164000593138-21443-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786164000593138-21443-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786164000593138-21443-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 04:41:58.957121 1308 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:41:58.958065 1308 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:41:58.958201 1308 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:41:58.964571 1308 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:41:58.964811 1308 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:41:58.964962 1308 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.240.195
I20260808 04:41:58.973186 1308 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.240.212:33585
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786164000593138-21443-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786164000593138-21443-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.20.240.212:40755/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.195.keytab
--principal=kudu/127.20.240.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.240.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786164000593138-21443-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.240.195
--webserver_port=0
--tserver_master_addrs=127.20.240.254:43875
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1308
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.240.195
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786164000593138-21443-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 04:05:18 UTC on ccycloud.quasar-drfdgt.root.comops.site
build id 4574101
I20260808 04:41:58.974974 1308 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:41:58.976439 1308 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:41:58.991515 1314 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:41:58.992930 1316 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:41:58.993322 1308 server_base.cc:1034] running on GCE node
W20260808 04:41:58.994104 1313 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:41:58.994735 1308 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:41:58.995589 1308 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:41:58.996747 1308 hybrid_clock.cc:648] HybridClock initialized: now 1786164118996712 us; error 52 us; skew 500 ppm
Aug 08 04:41:59 dist-test-slave-vxj2 krb5kdc[382](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164119, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.240.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:41:59.006438 1308 init.cc:377] Logged in from keytab as kudu/127.20.240.195@KRBTEST.COM (short username kudu)
I20260808 04:41:59.007776 1308 webserver.cc:460] Webserver started at http://127.20.240.195:35451/ using document root <none> and password file <none>
I20260808 04:41:59.008944 1308 fs_manager.cc:359] Metadata directory not provided
I20260808 04:41:59.009109 1308 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:41:59.009486 1308 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 08 04:41:59 dist-test-slave-vxj2 krb5kdc[382](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164119, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.240.195@KRBTEST.COM for HTTP/127.20.240.212@KRBTEST.COM
I20260808 04:41:59.045837 1308 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786164000593138-21443-0/minicluster-data/ts-2/data/instance:
uuid: "c50dc43c7a1045f287e0324d0f3e658a"
format_stamp: "Formatted at 2026-08-08 04:41:59 on dist-test-slave-vxj2"
server_key: "be0b565cdbd421c9ef76adabe453cd75"
server_key_iv: "d20b6202bce4acc5a014a7f838887dfa"
server_key_version: "kuduclusterkey@0"
I20260808 04:41:59.046829 1308 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786164000593138-21443-0/minicluster-data/ts-2/wal/instance:
uuid: "c50dc43c7a1045f287e0324d0f3e658a"
format_stamp: "Formatted at 2026-08-08 04:41:59 on dist-test-slave-vxj2"
server_key: "be0b565cdbd421c9ef76adabe453cd75"
server_key_iv: "d20b6202bce4acc5a014a7f838887dfa"
server_key_version: "kuduclusterkey@0"
I20260808 04:41:59.052729 1308 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
Aug 08 04:41:59 dist-test-slave-vxj2 krb5kdc[382](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164118, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.240.254@KRBTEST.COM for HTTP/127.20.240.212@KRBTEST.COM
I20260808 04:41:59.109091 1324 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:41:59.111291 1308 fs_manager.cc:725] Time spent opening block manager: real 0.041s user 0.002s sys 0.000s
I20260808 04:41:59.111467 1308 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786164000593138-21443-0/minicluster-data/ts-2/data,/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786164000593138-21443-0/minicluster-data/ts-2/wal
uuid: "c50dc43c7a1045f287e0324d0f3e658a"
format_stamp: "Formatted at 2026-08-08 04:41:59 on dist-test-slave-vxj2"
server_key: "be0b565cdbd421c9ef76adabe453cd75"
server_key_iv: "d20b6202bce4acc5a014a7f838887dfa"
server_key_version: "kuduclusterkey@0"
I20260808 04:41:59.111624 1308 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786164000593138-21443-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786164000593138-21443-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786164000593138-21443-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:41:59.209043 1308 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:41:59.213125 1308 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:41:59.213423 1308 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:41:59.215412 1308 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 04:41:59.228385 1308 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 04:41:59.228708 1308 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 04:41:59.228865 1308 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 04:41:59.228940 1308 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 04:41:59.243016 1308 rpc_server.cc:307] RPC server started. Bound to: 127.20.240.195:38671
I20260808 04:41:59.243059 1447 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.240.195:38671 every 8 connection(s)
I20260808 04:41:59.247185 1308 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786164000593138-21443-0/minicluster-data/ts-2/data/info.pb
I20260808 04:41:59.256582 21443 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu as pid 1308
I20260808 04:41:59.256705 21443 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786164000593138-21443-0/minicluster-data/ts-2/wal/instance
I20260808 04:41:59.257010 21443 external_mini_cluster.cc:1428] Setting key 94217c76f1fe0be3c55c8781ce79e75f
Aug 08 04:41:59 dist-test-slave-vxj2 krb5kdc[382](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164119, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.240.195@KRBTEST.COM for kudu/127.20.240.254@KRBTEST.COM
I20260808 04:41:59.266530 1451 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:41:59.250409 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.240.195:57793 (local address 127.20.240.254:43875)
0808 04:41:59.250792 (+ 383us) server_negotiation.cc:206] Beginning negotiation
0808 04:41:59.250797 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 04:41:59.251703 (+ 906us) server_negotiation.cc:407] Connection header received
0808 04:41:59.252918 (+ 1215us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:41:59.252922 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:41:59.252978 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:41:59.253043 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:41:59.254724 (+ 1681us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:41:59.255575 (+ 851us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:41:59.258449 (+ 2874us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:41:59.258811 (+ 362us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:41:59.258903 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:41:59.262095 (+ 3192us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:41:59.262099 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:41:59.262102 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:41:59.262130 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:41:59.263997 (+ 1867us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:41:59.264631 (+ 634us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:41:59.264635 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:41:59.264636 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:41:59.264734 (+ 98us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:41:59.265194 (+ 460us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:41:59.265197 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:41:59.265199 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:41:59.265421 (+ 222us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:41:59.265504 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0808 04:41:59.266187 (+ 683us) server_negotiation.cc:299] Negotiation successful
0808 04:41:59.266325 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":270,"thread_start_us":173,"threads_started":1}
I20260808 04:41:59.268123 1452 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:41:59.250988 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:43875 (local address 127.20.240.195:57793)
0808 04:41:59.251515 (+ 527us) negotiation.cc:107] Waiting for socket to connect
0808 04:41:59.251572 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0808 04:41:59.252661 (+ 1089us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:41:59.253476 (+ 815us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:41:59.253484 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:41:59.253864 (+ 380us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:41:59.254545 (+ 681us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:41:59.254565 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:41:59.255754 (+ 1189us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:41:59.255758 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:41:59.258250 (+ 2492us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:41:59.258262 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:41:59.259109 (+ 847us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:41:59.259112 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:41:59.259308 (+ 196us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:41:59.259981 (+ 673us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:41:59.260002 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:41:59.261902 (+ 1900us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:41:59.264137 (+ 2235us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:41:59.264143 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:41:59.264159 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:41:59.264508 (+ 349us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:41:59.264862 (+ 354us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:41:59.264865 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:41:59.264867 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:41:59.265058 (+ 191us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:41:59.265571 (+ 513us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:41:59.265577 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:41:59.265905 (+ 328us) client_negotiation.cc:769] Sending connection context
0808 04:41:59.266717 (+ 812us) client_negotiation.cc:240] Negotiation successful
0808 04:41:59.267085 (+ 368us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":295,"thread_start_us":109,"threads_started":1}
I20260808 04:41:59.269562 1449 heartbeater.cc:347] Connected to a master server at 127.20.240.254:43875
I20260808 04:41:59.269816 1449 heartbeater.cc:464] Registering TS with master...
I20260808 04:41:59.270426 1449 heartbeater.cc:511] Master 127.20.240.254:43875 requested a full tablet report, sending...
I20260808 04:41:59.271585 916 ts_manager.cc:194] Registered new tserver with Master: c50dc43c7a1045f287e0324d0f3e658a (127.20.240.195:38671)
I20260808 04:41:59.272351 916 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.240.195@KRBTEST.COM'} at 127.20.240.195:57793
I20260808 04:41:59.273855 21443 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 04:41:59.291019 1451 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:41:59.280660 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59060 (local address 127.20.240.254:43875)
0808 04:41:59.280812 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0808 04:41:59.280816 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:41:59.281278 (+ 462us) server_negotiation.cc:407] Connection header received
0808 04:41:59.281475 (+ 197us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:41:59.281479 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:41:59.281526 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:41:59.281574 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:41:59.282644 (+ 1070us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:41:59.283474 (+ 830us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:41:59.284689 (+ 1215us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:41:59.285031 (+ 342us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:41:59.285106 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:41:59.287170 (+ 2064us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:41:59.287173 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:41:59.287176 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:41:59.287204 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:41:59.289061 (+ 1857us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:41:59.289619 (+ 558us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:41:59.289623 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:41:59.289624 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:41:59.289712 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:41:59.290015 (+ 303us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:41:59.290019 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:41:59.290020 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:41:59.290234 (+ 214us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:41:59.290348 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0808 04:41:59.290698 (+ 350us) server_negotiation.cc:299] Negotiation successful
0808 04:41:59.290842 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260808 04:41:59.294739 916 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59060:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 04:41:59.299233 916 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 04:41:59.326052 1464 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:41:59.317373 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.194:35913 (local address 127.0.0.1:46086)
0808 04:41:59.319433 (+ 2060us) negotiation.cc:107] Waiting for socket to connect
0808 04:41:59.319498 (+ 65us) client_negotiation.cc:174] Beginning negotiation
0808 04:41:59.319655 (+ 157us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:41:59.320624 (+ 969us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:41:59.320630 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:41:59.320655 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 04:41:59.320811 (+ 156us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:41:59.320819 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:41:59.322463 (+ 1644us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:41:59.322467 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:41:59.323974 (+ 1507us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:41:59.323986 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:41:59.325397 (+ 1411us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:41:59.325402 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:41:59.325533 (+ 131us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:41:59.325601 (+ 68us) client_negotiation.cc:769] Sending connection context
0808 04:41:59.325720 (+ 119us) client_negotiation.cc:240] Negotiation successful
0808 04:41:59.325867 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1845,"thread_start_us":121,"threads_started":1}
I20260808 04:41:59.326828 1465 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:41:59.317569 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46086 (local address 127.20.240.194:35913)
0808 04:41:59.319107 (+ 1538us) server_negotiation.cc:206] Beginning negotiation
0808 04:41:59.319115 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 04:41:59.319855 (+ 740us) server_negotiation.cc:407] Connection header received
0808 04:41:59.319963 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:41:59.319973 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:41:59.320231 (+ 258us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:41:59.320399 (+ 168us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 04:41:59.321042 (+ 643us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:41:59.322316 (+ 1274us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:41:59.324132 (+ 1816us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:41:59.325021 (+ 889us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:41:59.325170 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:41:59.325329 (+ 159us) server_negotiation.cc:1035] Waiting for connection context
0808 04:41:59.326512 (+ 1183us) server_negotiation.cc:299] Negotiation successful
0808 04:41:59.326648 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1405,"thread_start_us":222,"threads_started":1}
I20260808 04:41:59.330870 1227 tablet_service.cc:1467] Processing CreateTablet for tablet 186cb41760784e279df966f2dbf6bdae (DEFAULT_TABLE table=test-table [id=7cb4fa45fefa4778b6ef18865ea65c7d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 04:41:59.334508 1468 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:41:59.318340 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.193:40863 (local address 127.0.0.1:43802)
0808 04:41:59.326938 (+ 8598us) negotiation.cc:107] Waiting for socket to connect
0808 04:41:59.326959 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0808 04:41:59.327071 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:41:59.327918 (+ 847us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:41:59.327921 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:41:59.327939 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 04:41:59.328043 (+ 104us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:41:59.328049 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:41:59.329926 (+ 1877us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:41:59.329930 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:41:59.331183 (+ 1253us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:41:59.331195 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:41:59.333976 (+ 2781us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:41:59.333980 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:41:59.334105 (+ 125us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:41:59.334144 (+ 39us) client_negotiation.cc:769] Sending connection context
0808 04:41:59.334230 (+ 86us) client_negotiation.cc:240] Negotiation successful
0808 04:41:59.334323 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":8511,"thread_start_us":267,"threads_started":1}
I20260808 04:41:59.335721 1467 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:41:59.318760 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43802 (local address 127.20.240.193:40863)
0808 04:41:59.326734 (+ 7974us) server_negotiation.cc:206] Beginning negotiation
0808 04:41:59.326742 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 04:41:59.327193 (+ 451us) server_negotiation.cc:407] Connection header received
0808 04:41:59.327297 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:41:59.327305 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:41:59.327576 (+ 271us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:41:59.327741 (+ 165us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 04:41:59.328188 (+ 447us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:41:59.329787 (+ 1599us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:41:59.332684 (+ 2897us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:41:59.333605 (+ 921us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:41:59.333743 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:41:59.333894 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0808 04:41:59.335454 (+ 1560us) server_negotiation.cc:299] Negotiation successful
0808 04:41:59.335583 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":7844,"thread_start_us":106,"threads_started":1}
I20260808 04:41:59.337955 1227 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 186cb41760784e279df966f2dbf6bdae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:41:59.341486 1076 tablet_service.cc:1467] Processing CreateTablet for tablet 186cb41760784e279df966f2dbf6bdae (DEFAULT_TABLE table=test-table [id=7cb4fa45fefa4778b6ef18865ea65c7d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 04:41:59.342865 1076 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 186cb41760784e279df966f2dbf6bdae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:41:59.349253 1470 tablet_bootstrap.cc:492] T 186cb41760784e279df966f2dbf6bdae P 261c23717439443ca2b408789b573f2d: Bootstrap starting.
I20260808 04:41:59.351902 1470 tablet_bootstrap.cc:654] T 186cb41760784e279df966f2dbf6bdae P 261c23717439443ca2b408789b573f2d: Neither blocks nor log segments found. Creating new log.
I20260808 04:41:59.352843 1470 log.cc:824] T 186cb41760784e279df966f2dbf6bdae P 261c23717439443ca2b408789b573f2d: Log is configured to *not* fsync() on all Append() calls
I20260808 04:41:59.357744 1466 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:41:59.318997 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.195:38671 (local address 127.0.0.1:53242)
0808 04:41:59.329333 (+ 10336us) negotiation.cc:107] Waiting for socket to connect
0808 04:41:59.329350 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 04:41:59.329447 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:41:59.349238 (+ 19791us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:41:59.349243 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:41:59.349271 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 04:41:59.349480 (+ 209us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:41:59.349491 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:41:59.354702 (+ 5211us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:41:59.354706 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:41:59.355998 (+ 1292us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:41:59.356011 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:41:59.357293 (+ 1282us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:41:59.357298 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:41:59.357398 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:41:59.357430 (+ 32us) client_negotiation.cc:769] Sending connection context
0808 04:41:59.357488 (+ 58us) client_negotiation.cc:240] Negotiation successful
0808 04:41:59.357572 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":10261,"thread_start_us":92,"threads_started":1}
I20260808 04:41:59.358765 1469 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:41:59.319438 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53242 (local address 127.20.240.195:38671)
0808 04:41:59.348086 (+ 28648us) server_negotiation.cc:206] Beginning negotiation
0808 04:41:59.348100 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0808 04:41:59.348132 (+ 32us) server_negotiation.cc:407] Connection header received
0808 04:41:59.348223 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:41:59.348229 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:41:59.348503 (+ 274us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:41:59.348699 (+ 196us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 04:41:59.353263 (+ 4564us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:41:59.354536 (+ 1273us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:41:59.356206 (+ 1670us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:41:59.357093 (+ 887us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:41:59.358291 (+ 1198us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:41:59.358450 (+ 159us) server_negotiation.cc:1035] Waiting for connection context
0808 04:41:59.358506 (+ 56us) server_negotiation.cc:299] Negotiation successful
0808 04:41:59.358607 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28515,"thread_start_us":144,"threads_started":1}
I20260808 04:41:59.361428 1470 tablet_bootstrap.cc:492] T 186cb41760784e279df966f2dbf6bdae P 261c23717439443ca2b408789b573f2d: No bootstrap required, opened a new log
I20260808 04:41:59.361685 1470 ts_tablet_manager.cc:1397] T 186cb41760784e279df966f2dbf6bdae P 261c23717439443ca2b408789b573f2d: Time spent bootstrapping tablet: real 0.013s user 0.006s sys 0.000s
I20260808 04:41:59.361661 1471 tablet_bootstrap.cc:492] T 186cb41760784e279df966f2dbf6bdae P feceee543b3c43a8b8c7ad79fce3e542: Bootstrap starting.
I20260808 04:41:59.362289 1375 tablet_service.cc:1467] Processing CreateTablet for tablet 186cb41760784e279df966f2dbf6bdae (DEFAULT_TABLE table=test-table [id=7cb4fa45fefa4778b6ef18865ea65c7d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 04:41:59.363493 1375 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 186cb41760784e279df966f2dbf6bdae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:41:59.364900 1471 tablet_bootstrap.cc:654] T 186cb41760784e279df966f2dbf6bdae P feceee543b3c43a8b8c7ad79fce3e542: Neither blocks nor log segments found. Creating new log.
I20260808 04:41:59.366031 1471 log.cc:824] T 186cb41760784e279df966f2dbf6bdae P feceee543b3c43a8b8c7ad79fce3e542: Log is configured to *not* fsync() on all Append() calls
I20260808 04:41:59.367492 1470 raft_consensus.cc:348] T 186cb41760784e279df966f2dbf6bdae P 261c23717439443ca2b408789b573f2d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "261c23717439443ca2b408789b573f2d" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 35913 } } peers { permanent_uuid: "feceee543b3c43a8b8c7ad79fce3e542" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 40863 } } peers { permanent_uuid: "c50dc43c7a1045f287e0324d0f3e658a" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 38671 } }
I20260808 04:41:59.367846 1470 raft_consensus.cc:374] T 186cb41760784e279df966f2dbf6bdae P 261c23717439443ca2b408789b573f2d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:41:59.367911 1470 raft_consensus.cc:729] T 186cb41760784e279df966f2dbf6bdae P 261c23717439443ca2b408789b573f2d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 261c23717439443ca2b408789b573f2d, State: Initialized, Role: FOLLOWER
I20260808 04:41:59.368777 1470 consensus_queue.cc:260] T 186cb41760784e279df966f2dbf6bdae P 261c23717439443ca2b408789b573f2d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "261c23717439443ca2b408789b573f2d" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 35913 } } peers { permanent_uuid: "feceee543b3c43a8b8c7ad79fce3e542" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 40863 } } peers { permanent_uuid: "c50dc43c7a1045f287e0324d0f3e658a" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 38671 } }
I20260808 04:41:59.370368 1470 ts_tablet_manager.cc:1428] T 186cb41760784e279df966f2dbf6bdae P 261c23717439443ca2b408789b573f2d: Time spent starting tablet: real 0.009s user 0.007s sys 0.000s
I20260808 04:41:59.370874 1302 heartbeater.cc:503] Master 127.20.240.254:43875 was elected leader, sending a full tablet report...
I20260808 04:41:59.371145 1150 heartbeater.cc:503] Master 127.20.240.254:43875 was elected leader, sending a full tablet report...
I20260808 04:41:59.373538 1475 tablet_bootstrap.cc:492] T 186cb41760784e279df966f2dbf6bdae P c50dc43c7a1045f287e0324d0f3e658a: Bootstrap starting.
I20260808 04:41:59.376534 1475 tablet_bootstrap.cc:654] T 186cb41760784e279df966f2dbf6bdae P c50dc43c7a1045f287e0324d0f3e658a: Neither blocks nor log segments found. Creating new log.
I20260808 04:41:59.377468 1475 log.cc:824] T 186cb41760784e279df966f2dbf6bdae P c50dc43c7a1045f287e0324d0f3e658a: Log is configured to *not* fsync() on all Append() calls
I20260808 04:41:59.379776 1475 tablet_bootstrap.cc:492] T 186cb41760784e279df966f2dbf6bdae P c50dc43c7a1045f287e0324d0f3e658a: No bootstrap required, opened a new log
I20260808 04:41:59.380044 1471 tablet_bootstrap.cc:492] T 186cb41760784e279df966f2dbf6bdae P feceee543b3c43a8b8c7ad79fce3e542: No bootstrap required, opened a new log
I20260808 04:41:59.380169 1475 ts_tablet_manager.cc:1397] T 186cb41760784e279df966f2dbf6bdae P c50dc43c7a1045f287e0324d0f3e658a: Time spent bootstrapping tablet: real 0.007s user 0.006s sys 0.000s
I20260808 04:41:59.380257 1471 ts_tablet_manager.cc:1397] T 186cb41760784e279df966f2dbf6bdae P feceee543b3c43a8b8c7ad79fce3e542: Time spent bootstrapping tablet: real 0.019s user 0.000s sys 0.006s
I20260808 04:41:59.386372 1471 raft_consensus.cc:348] T 186cb41760784e279df966f2dbf6bdae P feceee543b3c43a8b8c7ad79fce3e542 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "261c23717439443ca2b408789b573f2d" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 35913 } } peers { permanent_uuid: "feceee543b3c43a8b8c7ad79fce3e542" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 40863 } } peers { permanent_uuid: "c50dc43c7a1045f287e0324d0f3e658a" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 38671 } }
I20260808 04:41:59.386795 1471 raft_consensus.cc:374] T 186cb41760784e279df966f2dbf6bdae P feceee543b3c43a8b8c7ad79fce3e542 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:41:59.386870 1471 raft_consensus.cc:729] T 186cb41760784e279df966f2dbf6bdae P feceee543b3c43a8b8c7ad79fce3e542 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: feceee543b3c43a8b8c7ad79fce3e542, State: Initialized, Role: FOLLOWER
I20260808 04:41:59.387446 1471 consensus_queue.cc:260] T 186cb41760784e279df966f2dbf6bdae P feceee543b3c43a8b8c7ad79fce3e542 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "261c23717439443ca2b408789b573f2d" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 35913 } } peers { permanent_uuid: "feceee543b3c43a8b8c7ad79fce3e542" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 40863 } } peers { permanent_uuid: "c50dc43c7a1045f287e0324d0f3e658a" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 38671 } }
I20260808 04:41:59.388921 1471 ts_tablet_manager.cc:1428] T 186cb41760784e279df966f2dbf6bdae P feceee543b3c43a8b8c7ad79fce3e542: Time spent starting tablet: real 0.009s user 0.005s sys 0.004s
I20260808 04:41:59.389846 1475 raft_consensus.cc:348] T 186cb41760784e279df966f2dbf6bdae P c50dc43c7a1045f287e0324d0f3e658a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "261c23717439443ca2b408789b573f2d" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 35913 } } peers { permanent_uuid: "feceee543b3c43a8b8c7ad79fce3e542" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 40863 } } peers { permanent_uuid: "c50dc43c7a1045f287e0324d0f3e658a" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 38671 } }
I20260808 04:41:59.390110 1475 raft_consensus.cc:374] T 186cb41760784e279df966f2dbf6bdae P c50dc43c7a1045f287e0324d0f3e658a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:41:59.390172 1475 raft_consensus.cc:729] T 186cb41760784e279df966f2dbf6bdae P c50dc43c7a1045f287e0324d0f3e658a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c50dc43c7a1045f287e0324d0f3e658a, State: Initialized, Role: FOLLOWER
I20260808 04:41:59.390669 1475 consensus_queue.cc:260] T 186cb41760784e279df966f2dbf6bdae P c50dc43c7a1045f287e0324d0f3e658a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "261c23717439443ca2b408789b573f2d" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 35913 } } peers { permanent_uuid: "feceee543b3c43a8b8c7ad79fce3e542" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 40863 } } peers { permanent_uuid: "c50dc43c7a1045f287e0324d0f3e658a" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 38671 } }
I20260808 04:41:59.391876 1475 ts_tablet_manager.cc:1428] T 186cb41760784e279df966f2dbf6bdae P c50dc43c7a1045f287e0324d0f3e658a: Time spent starting tablet: real 0.012s user 0.000s sys 0.007s
I20260808 04:41:59.392280 1449 heartbeater.cc:503] Master 127.20.240.254:43875 was elected leader, sending a full tablet report...
W20260808 04:41:59.480289 1304 tablet.cc:2369] T 186cb41760784e279df966f2dbf6bdae P 261c23717439443ca2b408789b573f2d: Can't schedule compaction. Clean time has not been advanced past its initial value.
Aug 08 04:41:59 dist-test-slave-vxj2 krb5kdc[382](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164118, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.240.254@KRBTEST.COM for HTTP/127.20.240.212@KRBTEST.COM
W20260808 04:41:59.499871 1450 tablet.cc:2369] T 186cb41760784e279df966f2dbf6bdae P c50dc43c7a1045f287e0324d0f3e658a: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 04:41:59.579579 1152 tablet.cc:2369] T 186cb41760784e279df966f2dbf6bdae P feceee543b3c43a8b8c7ad79fce3e542: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 04:41:59.586483 1478 raft_consensus.cc:482] T 186cb41760784e279df966f2dbf6bdae P c50dc43c7a1045f287e0324d0f3e658a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 04:41:59.586742 1478 raft_consensus.cc:504] T 186cb41760784e279df966f2dbf6bdae P c50dc43c7a1045f287e0324d0f3e658a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "261c23717439443ca2b408789b573f2d" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 35913 } } peers { permanent_uuid: "feceee543b3c43a8b8c7ad79fce3e542" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 40863 } } peers { permanent_uuid: "c50dc43c7a1045f287e0324d0f3e658a" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 38671 } }
I20260808 04:41:59.588230 1478 leader_election.cc:288] T 186cb41760784e279df966f2dbf6bdae P c50dc43c7a1045f287e0324d0f3e658a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 261c23717439443ca2b408789b573f2d (127.20.240.194:35913), feceee543b3c43a8b8c7ad79fce3e542 (127.20.240.193:40863)
I20260808 04:41:59.594619 1452 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:41:59.588661 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.194:35913 (local address 127.20.240.195:47993)
0808 04:41:59.589353 (+ 692us) negotiation.cc:107] Waiting for socket to connect
0808 04:41:59.589368 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 04:41:59.589470 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:41:59.590135 (+ 665us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:41:59.590138 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:41:59.590161 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 04:41:59.590353 (+ 192us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:41:59.590364 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:41:59.591443 (+ 1079us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:41:59.591447 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:41:59.592723 (+ 1276us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:41:59.592735 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:41:59.594109 (+ 1374us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:41:59.594113 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:41:59.594266 (+ 153us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:41:59.594292 (+ 26us) client_negotiation.cc:769] Sending connection context
0808 04:41:59.594377 (+ 85us) client_negotiation.cc:240] Negotiation successful
0808 04:41:59.594467 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":607}
I20260808 04:41:59.595924 1465 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:41:59.589362 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.240.195:47993 (local address 127.20.240.194:35913)
0808 04:41:59.589502 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0808 04:41:59.589507 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 04:41:59.589526 (+ 19us) server_negotiation.cc:407] Connection header received
0808 04:41:59.589589 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:41:59.589592 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:41:59.589643 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:41:59.589773 (+ 130us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 04:41:59.590514 (+ 741us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:41:59.591298 (+ 784us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:41:59.592890 (+ 1592us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:41:59.593631 (+ 741us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:41:59.593775 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:41:59.593841 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0808 04:41:59.595698 (+ 1857us) server_negotiation.cc:299] Negotiation successful
0808 04:41:59.595783 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260808 04:41:59.596776 1248 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "186cb41760784e279df966f2dbf6bdae" candidate_uuid: "c50dc43c7a1045f287e0324d0f3e658a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "261c23717439443ca2b408789b573f2d" is_pre_election: true
I20260808 04:41:59.597128 1248 raft_consensus.cc:2454] T 186cb41760784e279df966f2dbf6bdae P 261c23717439443ca2b408789b573f2d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c50dc43c7a1045f287e0324d0f3e658a in term 0.
I20260808 04:41:59.597934 1327 leader_election.cc:302] T 186cb41760784e279df966f2dbf6bdae P c50dc43c7a1045f287e0324d0f3e658a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 261c23717439443ca2b408789b573f2d, c50dc43c7a1045f287e0324d0f3e658a; no voters:
I20260808 04:41:59.598516 1478 raft_consensus.cc:2781] T 186cb41760784e279df966f2dbf6bdae P c50dc43c7a1045f287e0324d0f3e658a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 04:41:59.598605 1478 raft_consensus.cc:482] T 186cb41760784e279df966f2dbf6bdae P c50dc43c7a1045f287e0324d0f3e658a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 04:41:59.598658 1478 raft_consensus.cc:3037] T 186cb41760784e279df966f2dbf6bdae P c50dc43c7a1045f287e0324d0f3e658a [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:41:59.599258 1452 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:41:59.588927 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.193:40863 (local address 127.20.240.195:40191)
0808 04:41:59.594807 (+ 5880us) negotiation.cc:107] Waiting for socket to connect
0808 04:41:59.594823 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 04:41:59.594913 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:41:59.595621 (+ 708us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:41:59.595625 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:41:59.595647 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 04:41:59.595729 (+ 82us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:41:59.595734 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:41:59.596750 (+ 1016us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:41:59.596753 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:41:59.597877 (+ 1124us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:41:59.597898 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:41:59.598856 (+ 958us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:41:59.598860 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:41:59.598959 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:41:59.598978 (+ 19us) client_negotiation.cc:769] Sending connection context
0808 04:41:59.599040 (+ 62us) client_negotiation.cc:240] Negotiation successful
0808 04:41:59.599106 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5812,"thread_start_us":89,"threads_started":1}
I20260808 04:41:59.599596 1467 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:41:59.589716 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.240.195:40191 (local address 127.20.240.193:40863)
0808 04:41:59.590069 (+ 353us) server_negotiation.cc:206] Beginning negotiation
0808 04:41:59.590074 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 04:41:59.595371 (+ 5297us) server_negotiation.cc:407] Connection header received
0808 04:41:59.595438 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:41:59.595441 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:41:59.595493 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:41:59.595578 (+ 85us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 04:41:59.595870 (+ 292us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:41:59.596616 (+ 746us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:41:59.598033 (+ 1417us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:41:59.598617 (+ 584us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:41:59.598704 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:41:59.598763 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0808 04:41:59.599404 (+ 641us) server_negotiation.cc:299] Negotiation successful
0808 04:41:59.599484 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":267}
I20260808 04:41:59.600194 1478 raft_consensus.cc:504] T 186cb41760784e279df966f2dbf6bdae P c50dc43c7a1045f287e0324d0f3e658a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "261c23717439443ca2b408789b573f2d" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 35913 } } peers { permanent_uuid: "feceee543b3c43a8b8c7ad79fce3e542" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 40863 } } peers { permanent_uuid: "c50dc43c7a1045f287e0324d0f3e658a" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 38671 } }
I20260808 04:41:59.600564 1478 leader_election.cc:288] T 186cb41760784e279df966f2dbf6bdae P c50dc43c7a1045f287e0324d0f3e658a [CANDIDATE]: Term 1 election: Requested vote from peers 261c23717439443ca2b408789b573f2d (127.20.240.194:35913), feceee543b3c43a8b8c7ad79fce3e542 (127.20.240.193:40863)
I20260808 04:41:59.602130 1091 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "186cb41760784e279df966f2dbf6bdae" candidate_uuid: "c50dc43c7a1045f287e0324d0f3e658a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "feceee543b3c43a8b8c7ad79fce3e542" is_pre_election: true
I20260808 04:41:59.602483 1091 raft_consensus.cc:2454] T 186cb41760784e279df966f2dbf6bdae P feceee543b3c43a8b8c7ad79fce3e542 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c50dc43c7a1045f287e0324d0f3e658a in term 0.
I20260808 04:41:59.602850 1097 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "186cb41760784e279df966f2dbf6bdae" candidate_uuid: "c50dc43c7a1045f287e0324d0f3e658a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "feceee543b3c43a8b8c7ad79fce3e542"
I20260808 04:41:59.602957 1097 raft_consensus.cc:3037] T 186cb41760784e279df966f2dbf6bdae P feceee543b3c43a8b8c7ad79fce3e542 [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:41:59.604310 1097 raft_consensus.cc:2454] T 186cb41760784e279df966f2dbf6bdae P feceee543b3c43a8b8c7ad79fce3e542 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c50dc43c7a1045f287e0324d0f3e658a in term 1.
I20260808 04:41:59.604666 1327 leader_election.cc:302] T 186cb41760784e279df966f2dbf6bdae P c50dc43c7a1045f287e0324d0f3e658a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c50dc43c7a1045f287e0324d0f3e658a, feceee543b3c43a8b8c7ad79fce3e542; no voters:
I20260808 04:41:59.604954 1248 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "186cb41760784e279df966f2dbf6bdae" candidate_uuid: "c50dc43c7a1045f287e0324d0f3e658a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "261c23717439443ca2b408789b573f2d"
I20260808 04:41:59.605090 1248 raft_consensus.cc:3037] T 186cb41760784e279df966f2dbf6bdae P 261c23717439443ca2b408789b573f2d [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:41:59.605270 1478 raft_consensus.cc:2781] T 186cb41760784e279df966f2dbf6bdae P c50dc43c7a1045f287e0324d0f3e658a [term 1 FOLLOWER]: Leader election won for term 1
I20260808 04:41:59.605497 1478 raft_consensus.cc:686] T 186cb41760784e279df966f2dbf6bdae P c50dc43c7a1045f287e0324d0f3e658a [term 1 LEADER]: Becoming Leader. State: Replica: c50dc43c7a1045f287e0324d0f3e658a, State: Running, Role: LEADER
I20260808 04:41:59.605868 1478 consensus_queue.cc:237] T 186cb41760784e279df966f2dbf6bdae P c50dc43c7a1045f287e0324d0f3e658a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "261c23717439443ca2b408789b573f2d" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 35913 } } peers { permanent_uuid: "feceee543b3c43a8b8c7ad79fce3e542" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 40863 } } peers { permanent_uuid: "c50dc43c7a1045f287e0324d0f3e658a" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 38671 } }
I20260808 04:41:59.606556 1248 raft_consensus.cc:2454] T 186cb41760784e279df966f2dbf6bdae P 261c23717439443ca2b408789b573f2d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c50dc43c7a1045f287e0324d0f3e658a in term 1.
I20260808 04:41:59.609555 916 catalog_manager.cc:5495] T 186cb41760784e279df966f2dbf6bdae P c50dc43c7a1045f287e0324d0f3e658a reported cstate change: term changed from 0 to 1, leader changed from <none> to c50dc43c7a1045f287e0324d0f3e658a (127.20.240.195). New cstate: current_term: 1 leader_uuid: "c50dc43c7a1045f287e0324d0f3e658a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "261c23717439443ca2b408789b573f2d" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 35913 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "feceee543b3c43a8b8c7ad79fce3e542" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 40863 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c50dc43c7a1045f287e0324d0f3e658a" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 38671 } health_report { overall_health: HEALTHY } } }
I20260808 04:41:59.689311 1469 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:41:59.683076 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53250 (local address 127.20.240.195:38671)
0808 04:41:59.683245 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0808 04:41:59.683264 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0808 04:41:59.683289 (+ 25us) server_negotiation.cc:407] Connection header received
0808 04:41:59.683517 (+ 228us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:41:59.683521 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:41:59.683594 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:41:59.683704 (+ 110us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 04:41:59.684271 (+ 567us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:41:59.685198 (+ 927us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:41:59.686659 (+ 1461us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:41:59.687048 (+ 389us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:41:59.687160 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:41:59.687632 (+ 472us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 04:41:59.688288 (+ 656us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 04:41:59.688415 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0808 04:41:59.689022 (+ 607us) server_negotiation.cc:299] Negotiation successful
0808 04:41:59.689090 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260808 04:41:59.697387 1097 raft_consensus.cc:1261] T 186cb41760784e279df966f2dbf6bdae P feceee543b3c43a8b8c7ad79fce3e542 [term 1 FOLLOWER]: Refusing update from remote peer c50dc43c7a1045f287e0324d0f3e658a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 04:41:59.698216 1483 consensus_queue.cc:1035] T 186cb41760784e279df966f2dbf6bdae P c50dc43c7a1045f287e0324d0f3e658a [LEADER]: Connected to new peer: Peer: permanent_uuid: "feceee543b3c43a8b8c7ad79fce3e542" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 40863 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 04:41:59.699837 1248 raft_consensus.cc:1261] T 186cb41760784e279df966f2dbf6bdae P 261c23717439443ca2b408789b573f2d [term 1 FOLLOWER]: Refusing update from remote peer c50dc43c7a1045f287e0324d0f3e658a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 04:41:59.700436 1483 consensus_queue.cc:1035] T 186cb41760784e279df966f2dbf6bdae P c50dc43c7a1045f287e0324d0f3e658a [LEADER]: Connected to new peer: Peer: permanent_uuid: "261c23717439443ca2b408789b573f2d" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 35913 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 04:41:59.718225 1487 mvcc.cc:205] Tried to move back new op lower bound from 7316128234270302208 to 7316128233909374976. Current Snapshot: MvccSnapshot[applied={T|T < 7316128234270302208}]
I20260808 04:41:59.722707 1488 mvcc.cc:205] Tried to move back new op lower bound from 7316128234270302208 to 7316128233909374976. Current Snapshot: MvccSnapshot[applied={T|T < 7316128234270302208}]
I20260808 04:41:59.724956 1490 mvcc.cc:205] Tried to move back new op lower bound from 7316128234270302208 to 7316128233909374976. Current Snapshot: MvccSnapshot[applied={T|T < 7316128234270302208}]
I20260808 04:41:59.734695 916 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59060:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 04:41:59.734902 916 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59060:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 04:41:59.737612 916 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 7200556f03b8469faee3736204c84b7d: Sending DeleteTablet for 3 replicas of tablet 186cb41760784e279df966f2dbf6bdae
I20260808 04:41:59.738554 1227 tablet_service.cc:1514] Processing DeleteTablet for tablet 186cb41760784e279df966f2dbf6bdae with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 04:41:59 UTC) from {username='kudu', principal='kudu/127.20.240.254@KRBTEST.COM'} at 127.0.0.1:46086
I20260808 04:41:59.738865 1076 tablet_service.cc:1514] Processing DeleteTablet for tablet 186cb41760784e279df966f2dbf6bdae with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 04:41:59 UTC) from {username='kudu', principal='kudu/127.20.240.254@KRBTEST.COM'} at 127.0.0.1:43802
I20260808 04:41:59.739354 1375 tablet_service.cc:1514] Processing DeleteTablet for tablet 186cb41760784e279df966f2dbf6bdae with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 04:41:59 UTC) from {username='kudu', principal='kudu/127.20.240.254@KRBTEST.COM'} at 127.0.0.1:53242
I20260808 04:41:59.740568 21443 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu with pid 1003
I20260808 04:41:59.754447 1501 tablet_replica.cc:330] T 186cb41760784e279df966f2dbf6bdae P c50dc43c7a1045f287e0324d0f3e658a: stopping tablet replica
I20260808 04:41:59.754920 1501 raft_consensus.cc:2229] T 186cb41760784e279df966f2dbf6bdae P c50dc43c7a1045f287e0324d0f3e658a [term 1 LEADER]: Raft consensus shutting down.
I20260808 04:41:59.755441 1501 raft_consensus.cc:2258] T 186cb41760784e279df966f2dbf6bdae P c50dc43c7a1045f287e0324d0f3e658a [term 1 FOLLOWER]: Raft consensus is shut down!
W20260808 04:41:59.756206 897 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.20.240.193:40863 (error 108)
I20260808 04:41:59.757360 21443 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu with pid 1159
I20260808 04:41:59.762989 1501 ts_tablet_manager.cc:1905] T 186cb41760784e279df966f2dbf6bdae P c50dc43c7a1045f287e0324d0f3e658a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 04:41:59.766630 1501 ts_tablet_manager.cc:1918] T 186cb41760784e279df966f2dbf6bdae P c50dc43c7a1045f287e0324d0f3e658a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 04:41:59.766832 1501 log.cc:1196] T 186cb41760784e279df966f2dbf6bdae P c50dc43c7a1045f287e0324d0f3e658a: Deleting WAL directory at /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786164000593138-21443-0/minicluster-data/ts-2/wal/wals/186cb41760784e279df966f2dbf6bdae
I20260808 04:41:59.767349 1501 ts_tablet_manager.cc:1939] T 186cb41760784e279df966f2dbf6bdae P c50dc43c7a1045f287e0324d0f3e658a: Deleting consensus metadata
I20260808 04:41:59.768514 1466 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:41:59.768088 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.193:40863 (local address 127.0.0.1:43818)
0808 04:41:59.768318 (+ 230us) negotiation.cc:107] Waiting for socket to connect
0808 04:41:59.768409 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.240.193:40863: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":140}
W20260808 04:41:59.768853 897 catalog_manager.cc:4584] TS feceee543b3c43a8b8c7ad79fce3e542 (127.20.240.193:40863): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 186cb41760784e279df966f2dbf6bdae: Network error: Client connection negotiation failed: client connection to 127.20.240.193:40863: connect: Connection refused (error 111)
I20260808 04:41:59.770807 897 catalog_manager.cc:4841] TS c50dc43c7a1045f287e0324d0f3e658a (127.20.240.195:38671): tablet 186cb41760784e279df966f2dbf6bdae (table test-table [id=7cb4fa45fefa4778b6ef18865ea65c7d]) successfully deleted
I20260808 04:41:59.798221 1466 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:41:59.797846 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.194:35913 (local address 127.0.0.1:46092)
0808 04:41:59.798048 (+ 202us) negotiation.cc:107] Waiting for socket to connect
0808 04:41:59.798106 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.240.194:35913: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":119}
I20260808 04:41:59.809360 21443 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu with pid 1308
I20260808 04:41:59.819726 21443 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu with pid 878
I20260808 04:41:59.830504 21443 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260808 04:42:00.176777 21443 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260808 04:42:00.176944 21443 mini_ranger.cc:66] Stopping Ranger...
I20260808 04:42:00.522466 21443 mini_ranger.cc:68] Stopped Ranger
2026-08-08 04:42:00.522 UTC [417] LOG: received smart shutdown request
2026-08-08 04:42:00.527 UTC [417] LOG: background worker "logical replication launcher" (PID 426) exited with exit code 1
2026-08-08 04:42:00.527 UTC [421] LOG: shutting down
2026-08-08 04:42:00.738 UTC [417] LOG: database system is shut down
2026-08-08T04:42:00Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegration (52707 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers
Loading random data
Initializing database '/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164000593138-21443-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 04:42:00 dist-test-slave-vxj2 krb5kdc[1511](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 04:42:00 dist-test-slave-vxj2 krb5kdc[1511](info): set up 2 sockets
Aug 08 04:42:00 dist-test-slave-vxj2 krb5kdc[1511](info): commencing operation
krb5kdc: starting...
W20260808 04:42:01.959419 21443 mini_kdc.cc:121] Time spent starting KDC: real 1.069s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164000593138-21443-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164000593138-21443-0/krb5kdc/test-user.keytab.
Aug 08 04:42:02 dist-test-slave-vxj2 krb5kdc[1511](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164122, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T04:42:02Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T04:42:02Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.20.240.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.20.240.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.20.240.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164000593138-21443-0/krb5kdc/rangeradmin_127.20.240.212@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.20.240.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164000593138-21443-0/krb5kdc/rangeradmin_127.20.240.212@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.20.240.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.20.240.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.20.240.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164000593138-21443-0/krb5kdc/rangerlookup_127.20.240.212@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.20.240.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164000593138-21443-0/krb5kdc/rangerlookup_127.20.240.212@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.20.240.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.20.240.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.20.240.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164000593138-21443-0/krb5kdc/HTTP_127.20.240.212@KRBTEST.COM.keytab.
Entry for principal HTTP/127.20.240.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164000593138-21443-0/krb5kdc/HTTP_127.20.240.212@KRBTEST.COM.keytab.
I20260808 04:42:02.148524 21443 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164000593138-21443-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskgby_Qd/build/debug/bin/postgres/pg_ctl -D /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164000593138-21443-0/minicluster-data/postgres -l logfile start
2026-08-08 04:42:04.892 UTC [1543] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-08 04:42:04.892 UTC [1543] LOG: listening on IPv4 address "127.20.240.212", port 37151
2026-08-08 04:42:04.896 UTC [1543] LOG: listening on Unix socket "/tmp/.s.PGSQL.37151"
2026-08-08 04:42:04.918 UTC [1546] LOG: database system was shut down at 2026-08-08 04:42:03 UTC
2026-08-08 04:42:04.923 UTC [1543] LOG: database system is ready to accept connections
I20260808 04:42:05.917126 21443 mini_postgres.cc:96] Postgres bound to 37151
2026-08-08 04:42:05.924 UTC [1554] FATAL: database "slave" does not exist
127.20.240.212:37151 - accepting connections
I20260808 04:42:05.924942 21443 mini_ranger.cc:161] Starting Ranger...
I20260808 04:42:05.941510 21443 mini_ranger.cc:84] Created miniranger Postgres user
I20260808 04:42:06.518831 21443 mini_ranger.cc:87] Created ranger Postgres database
I20260808 04:42:06.518908 21443 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164000593138-21443-0/minicluster-data/ranger-admin
2026-08-08 04:42:06,797 [I] DB FLAVOR :POSTGRES
2026-08-08 04:42:06,798 [I] --------- Verifying Ranger DB connection ---------
2026-08-08 04:42:06,798 [I] Checking connection..
2026-08-08 04:42:06,798 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskgby_Qd/build/debug/bin/postgresql.jar:/tmp/dist-test-taskgby_Qd/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.240.212:37151/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-08 04:42:07,056 [I] Checking connection passed.
2026-08-08 04:42:07,057 [I] --------- Verifying version history table ---------
2026-08-08 04:42:07,057 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskgby_Qd/build/debug/bin/postgresql.jar:/tmp/dist-test-taskgby_Qd/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.240.212:37151/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-08 04:42:07,321 [I] Table x_db_version_h does not exist in database ranger
2026-08-08 04:42:07,322 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskgby_Qd/build/debug/bin/postgresql.jar:/tmp/dist-test-taskgby_Qd/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.240.212:37151/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-08 04:42:07,581 [I] Table x_db_version_h does not exist in database ranger
2026-08-08 04:42:07,581 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-08 04:42:07,581 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskgby_Qd/build/debug/bin/postgresql.jar:/tmp/dist-test-taskgby_Qd/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.240.212:37151/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskgby_Qd/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-08 04:42:07.832 UTC [1625] WARNING: there is no transaction in progress
2026-08-08 04:42:07,840 [I] create_dbversion_catalog.sql file imported successfully
2026-08-08 04:42:07,840 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskgby_Qd/build/debug/bin/postgresql.jar:/tmp/dist-test-taskgby_Qd/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.240.212:37151/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-08 04:42:08,104 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-08 04:42:08,104 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-08 04:42:08,105 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskgby_Qd/build/debug/bin/postgresql.jar:/tmp/dist-test-taskgby_Qd/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.240.212:37151/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-08 04:42:08,363 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskgby_Qd/build/debug/bin/postgresql.jar:/tmp/dist-test-taskgby_Qd/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.240.212:37151/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-08 04:42:08,641 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskgby_Qd/build/debug/bin/postgresql.jar:/tmp/dist-test-taskgby_Qd/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.240.212:37151/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-vxj2.c.gcp-upstream.internal','N') ;"
2026-08-08 04:42:08,897 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskgby_Qd/build/debug/bin/postgresql.jar:/tmp/dist-test-taskgby_Qd/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.240.212:37151/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-08 04:42:09,149 [I] Table x_portal_user does not exist in database ranger
2026-08-08 04:42:09,149 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskgby_Qd/build/debug/bin/postgresql.jar:/tmp/dist-test-taskgby_Qd/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.240.212:37151/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-08 04:42:09,439 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-08 04:42:09,439 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskgby_Qd/build/debug/bin/postgresql.jar:/tmp/dist-test-taskgby_Qd/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.240.212:37151/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-08 04:42:09,693 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskgby_Qd/build/debug/bin/postgresql.jar:/tmp/dist-test-taskgby_Qd/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.240.212:37151/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-08 04:42:09,930 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-08 04:42:09,930 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskgby_Qd/build/debug/bin/postgresql.jar:/tmp/dist-test-taskgby_Qd/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.240.212:37151/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskgby_Qd/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-08 04:42:10.988 UTC [1743] WARNING: there is no transaction in progress
2026-08-08 04:42:11.007 UTC [1743] WARNING: there is no transaction in progress
2026-08-08 04:42:11.026 UTC [1743] WARNING: there is no transaction in progress
2026-08-08 04:42:11.043 UTC [1743] WARNING: there is no transaction in progress
2026-08-08 04:42:11.061 UTC [1743] WARNING: there is no transaction in progress
2026-08-08 04:42:11.083 UTC [1743] WARNING: there is no transaction in progress
2026-08-08 04:42:11.157 UTC [1743] WARNING: there is no transaction in progress
2026-08-08 04:42:11.165 UTC [1743] WARNING: there is no transaction in progress
2026-08-08 04:42:11.182 UTC [1743] WARNING: there is no transaction in progress
2026-08-08 04:42:11.194 UTC [1743] WARNING: there is no transaction in progress
2026-08-08 04:42:11.206 UTC [1743] WARNING: there is no transaction in progress
2026-08-08 04:42:11.222 UTC [1743] WARNING: there is no transaction in progress
2026-08-08 04:42:11.233 UTC [1743] WARNING: there is no transaction in progress
2026-08-08 04:42:11.242 UTC [1743] WARNING: there is no transaction in progress
2026-08-08 04:42:11.249 UTC [1743] WARNING: there is no transaction in progress
2026-08-08 04:42:11.256 UTC [1743] WARNING: there is no transaction in progress
2026-08-08 04:42:11,987 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-08 04:42:11,988 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskgby_Qd/build/debug/bin/postgresql.jar:/tmp/dist-test-taskgby_Qd/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.240.212:37151/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-08 04:42:12,237 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-08 04:42:12,237 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskgby_Qd/build/debug/bin/postgresql.jar:/tmp/dist-test-taskgby_Qd/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.240.212:37151/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-08 04:42:12,501 [I] Table x_portal_user already exists in database 'ranger'
2026-08-08 04:42:12,501 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskgby_Qd/build/debug/bin/postgresql.jar:/tmp/dist-test-taskgby_Qd/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.240.212:37151/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-08 04:42:12,763 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-08 04:42:12,763 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskgby_Qd/build/debug/bin/postgresql.jar:/tmp/dist-test-taskgby_Qd/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.240.212:37151/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-08 04:42:13,035 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskgby_Qd/build/debug/bin/postgresql.jar:/tmp/dist-test-taskgby_Qd/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.240.212:37151/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-08 04:42:13,284 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskgby_Qd/build/debug/bin/postgresql.jar:/tmp/dist-test-taskgby_Qd/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.240.212:37151/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-vxj2.c.gcp-upstream.internal';"
2026-08-08 04:42:13,528 [I] CORE_DB_SCHEMA import status has been updated
2026-08-08 04:42:13,529 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskgby_Qd/build/debug/bin/postgresql.jar:/tmp/dist-test-taskgby_Qd/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.240.212:37151/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-08 04:42:13,772 [I] DB_PATCHES have already been applied
I20260808 04:42:13.779052 21443 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164000593138-21443-0/minicluster-data/ranger-admin:/tmp/dist-test-taskgby_Qd/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskgby_Qd/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskgby_Qd/build/debug/bin/postgresql.jar:/tmp/dist-test-taskgby_Qd/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260808 04:42:13.779129 21443 mini_ranger.cc:193] Using host: 127.20.240.212
I20260808 04:42:13.783015 21443 mini_ranger.cc:227] Ranger admin URL: http://127.20.240.212:37675
Aug 08, 2026 4:42:14 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 08, 2026 4:42:14 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 08, 2026 4:42:14 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164000593138-21443-0/minicluster-data/ranger-admin/ews/webapp
Aug 08, 2026 4:42:14 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164000593138-21443-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 08, 2026 4:42:14 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164000593138-21443-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 08, 2026 4:42:14 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164000593138-21443-0/minicluster-data/ranger-admin/ews/webapp].
Aug 08, 2026 4:42:14 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260808 04:42:14.978559 21443 mini_ranger.cc:160] Time spent starting Ranger: real 9.054s user 0.003s sys 0.008s
Aug 08, 2026 4:42:35 AM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 08, 2026 4:42:35 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.PublicAPIsv2
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.UserREST
Aug 08, 2026 4:42:35 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 08, 2026 4:42:36 AM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 08, 2026 4:42:36 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 08, 2026 4:42:36 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 08, 2026 4:42:36 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 08, 2026 4:42:36 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 08, 2026 4:42:36 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 08, 2026 4:42:36 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 08, 2026 4:42:36 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 08, 2026 4:42:36 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 08, 2026 4:42:36 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 08, 2026 4:42:36 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 08, 2026 4:42:36 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 08, 2026 4:42:36 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 08, 2026 4:42:36 AM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 08, 2026 4:42:36 AM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260808 04:42:37.613090 21443 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.20.240.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.20.240.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.20.240.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164000593138-21443-0/krb5kdc/rangerkms_127.20.240.212@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.20.240.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164000593138-21443-0/krb5kdc/rangerkms_127.20.240.212@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.20.240.212@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.20.240.212@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.20.240.212@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164000593138-21443-0/krb5kdc/HTTP_127.20.240.212@KRBTEST.COM.keytab.
Entry for principal HTTP/127.20.240.212@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164000593138-21443-0/krb5kdc/HTTP_127.20.240.212@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 08 04:42:37 dist-test-slave-vxj2 krb5kdc[1511](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164157, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260808 04:42:37.710346 21443 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260808 04:42:37.721314 21443 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260808 04:42:38.765643 21443 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260808 04:42:38.765735 21443 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164000593138-21443-0/minicluster-data/ranger-kms
I20260808 04:42:38.765758 21443 mini_ranger_kms.cc:227] Using postgres at 127.20.240.212:37151
2026-08-08 04:42:38,941 [I] DB FLAVOR :POSTGRES
2026-08-08 04:42:38,942 [I] --------- Verifying Ranger DB connection ---------
2026-08-08 04:42:38,942 [I] Checking connection
2026-08-08 04:42:38,942 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskgby_Qd/build/debug/bin/postgresql.jar:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164000593138-21443-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.240.212:37151/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-08 04:42:39,197 [I] connection success
2026-08-08 04:42:39,197 [I] --------- Verifying Ranger DB tables ---------
2026-08-08 04:42:39,197 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-08 04:42:39,198 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskgby_Qd/build/debug/bin/postgresql.jar:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164000593138-21443-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.240.212:37151/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-08 04:42:39,463 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-08 04:42:39,464 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-08 04:42:39,464 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-08 04:42:39,464 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskgby_Qd/build/debug/bin/postgresql.jar:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164000593138-21443-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.240.212:37151/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164000593138-21443-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-08 04:42:39,776 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260808 04:42:40.262527 21443 mini_ranger_kms.cc:310] Created kms service
I20260808 04:42:40.504184 21443 mini_ranger_kms.cc:326] Created kudu user
I20260808 04:42:40.553177 21443 mini_ranger_kms.cc:343] Created rangerkms user
Aug 08 04:42:40 dist-test-slave-vxj2 krb5kdc[1511](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164157, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.20.240.212@KRBTEST.COM
I20260808 04:42:41.017894 21443 mini_ranger_kms.cc:384] Added ranger policy
I20260808 04:42:41.018078 21443 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164000593138-21443-0/minicluster-data/ranger-kms:/tmp/dist-test-taskgby_Qd/build/debug/bin/postgresql.jar:/tmp/dist-test-taskgby_Qd/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskgby_Qd/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260808 04:42:41.018105 21443 mini_ranger_kms.cc:240] Using host: 127.20.240.212
I20260808 04:42:41.022555 21443 mini_ranger_kms.cc:276] Ranger KMS PID: 1939
I20260808 04:42:41.022660 21443 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.20.240.212:36957
Aug 08, 2026 4:42:42 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 08, 2026 4:42:42 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 08, 2026 4:42:42 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164000593138-21443-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 08, 2026 4:42:42 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164000593138-21443-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 08, 2026 4:42:42 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164000593138-21443-0/minicluster-data/ranger-kms/ews/webapp].
Aug 08, 2026 4:42:42 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
Aug 08 04:42:43 dist-test-slave-vxj2 krb5kdc[1511](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786164163, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.20.240.212@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:42:43.463366 21443 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 5.753s user 0.009s sys 0.151s
I20260808 04:42:43.463514 21443 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260808 04:42:43.463593 21443 mini_ranger_kms.cc:401] 127.20.240.212:36957/kms/v1/keys
Aug 08 04:42:43 dist-test-slave-vxj2 krb5kdc[1511](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164163, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.20.240.212@KRBTEST.COM for HTTP/127.20.240.212@KRBTEST.COM
Aug 08 04:42:44 dist-test-slave-vxj2 krb5kdc[1511](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164163, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.20.240.212@KRBTEST.COM for HTTP/127.20.240.212@KRBTEST.COM
Aug 08 04:42:46 dist-test-slave-vxj2 krb5kdc[1511](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164166, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.20.240.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.240.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.240.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.254.keytab.
Entry for principal kudu/127.20.240.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.254.keytab.
I20260808 04:42:46.653649 21443 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
/tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164000593138-21443-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164000593138-21443-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164000593138-21443-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164000593138-21443-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.240.254:39319
--webserver_interface=127.20.240.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.254.keytab
--principal=kudu/127.20.240.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.240.212:43765
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.240.254:39319
--ranger_config_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164000593138-21443-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.20.240.212:36957/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164000593138-21443-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164000593138-21443-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164000593138-21443-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 04:42:46.769723 1991 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:42:46.770007 1991 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:42:46.770047 1991 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:42:46.774269 1991 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 04:42:46.774349 1991 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:42:46.774370 1991 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:42:46.774387 1991 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 04:42:46.774432 1991 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 04:42:46.780438 1991 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.240.212:43765
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164000593138-21443-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164000593138-21443-0/minicluster-data/master-0/wal
--ranger_kms_url=127.20.240.212:36957/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.20.240.254:39319
--ranger_config_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164000593138-21443-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.254.keytab
--principal=kudu/127.20.240.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.240.254:39319
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164000593138-21443-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.240.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1991
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164000593138-21443-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 04:05:18 UTC on ccycloud.quasar-drfdgt.root.comops.site
build id 4574101
I20260808 04:42:46.781702 1991 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:42:46.782775 1991 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:42:46.792236 1996 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:42:46.792359 1997 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:42:46.792451 1991 server_base.cc:1034] running on GCE node
W20260808 04:42:46.792259 1999 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:42:46.793442 1991 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:42:46.794967 1991 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:42:46.796173 1991 hybrid_clock.cc:648] HybridClock initialized: now 1786164166796147 us; error 48 us; skew 500 ppm
Aug 08 04:42:46 dist-test-slave-vxj2 krb5kdc[1511](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164166, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.240.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:42:46.804553 1991 init.cc:377] Logged in from keytab as kudu/127.20.240.254@KRBTEST.COM (short username kudu)
I20260808 04:42:46.805707 1991 webserver.cc:460] Webserver started at http://127.20.240.254:35293/ using document root <none> and password file <none>
I20260808 04:42:46.806314 1991 fs_manager.cc:359] Metadata directory not provided
I20260808 04:42:46.806406 1991 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:42:46.806674 1991 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 08 04:42:46 dist-test-slave-vxj2 krb5kdc[1511](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164166, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.240.254@KRBTEST.COM for HTTP/127.20.240.212@KRBTEST.COM
I20260808 04:42:46.856750 1991 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164000593138-21443-0/minicluster-data/master-0/data/instance:
uuid: "04eb95e4ee644cf09b965e748e45002f"
format_stamp: "Formatted at 2026-08-08 04:42:46 on dist-test-slave-vxj2"
server_key: "8d7923ffd446aa4de979c21b1e3fef2d"
server_key_iv: "bc250194619c59f1ded8667cdd32ffd4"
server_key_version: "kuduclusterkey@0"
I20260808 04:42:46.857474 1991 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164000593138-21443-0/minicluster-data/master-0/wal/instance:
uuid: "04eb95e4ee644cf09b965e748e45002f"
format_stamp: "Formatted at 2026-08-08 04:42:46 on dist-test-slave-vxj2"
server_key: "8d7923ffd446aa4de979c21b1e3fef2d"
server_key_iv: "bc250194619c59f1ded8667cdd32ffd4"
server_key_version: "kuduclusterkey@0"
I20260808 04:42:46.861634 1991 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260808 04:42:46.877709 2006 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:42:46.879506 1991 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 04:42:46.879679 1991 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164000593138-21443-0/minicluster-data/master-0/data,/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164000593138-21443-0/minicluster-data/master-0/wal
uuid: "04eb95e4ee644cf09b965e748e45002f"
format_stamp: "Formatted at 2026-08-08 04:42:46 on dist-test-slave-vxj2"
server_key: "8d7923ffd446aa4de979c21b1e3fef2d"
server_key_iv: "bc250194619c59f1ded8667cdd32ffd4"
server_key_version: "kuduclusterkey@0"
I20260808 04:42:46.879839 1991 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164000593138-21443-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164000593138-21443-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164000593138-21443-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:42:46.910255 1991 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:42:46.913872 1991 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:42:46.914079 1991 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:42:46.922960 1991 rpc_server.cc:307] RPC server started. Bound to: 127.20.240.254:39319
I20260808 04:42:46.922989 2068 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.240.254:39319 every 8 connection(s)
I20260808 04:42:46.924213 1991 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164000593138-21443-0/minicluster-data/master-0/data/info.pb
I20260808 04:42:46.927426 2069 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:42:46.932581 21443 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu as pid 1991
I20260808 04:42:46.932777 21443 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164000593138-21443-0/minicluster-data/master-0/wal/instance
I20260808 04:42:46.933080 21443 external_mini_cluster.cc:1428] Setting key a75309d5fe6c8067c353e8313415c507
I20260808 04:42:46.933635 2069 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 04eb95e4ee644cf09b965e748e45002f: Bootstrap starting.
I20260808 04:42:46.936271 2069 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 04eb95e4ee644cf09b965e748e45002f: Neither blocks nor log segments found. Creating new log.
I20260808 04:42:46.937178 2069 log.cc:824] T 00000000000000000000000000000000 P 04eb95e4ee644cf09b965e748e45002f: Log is configured to *not* fsync() on all Append() calls
I20260808 04:42:46.939512 2069 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 04eb95e4ee644cf09b965e748e45002f: No bootstrap required, opened a new log
I20260808 04:42:46.943753 2069 raft_consensus.cc:348] T 00000000000000000000000000000000 P 04eb95e4ee644cf09b965e748e45002f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "04eb95e4ee644cf09b965e748e45002f" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 39319 } }
Aug 08 04:42:46 dist-test-slave-vxj2 krb5kdc[1511](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164166, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.240.254@KRBTEST.COM
I20260808 04:42:46.944053 2069 raft_consensus.cc:374] T 00000000000000000000000000000000 P 04eb95e4ee644cf09b965e748e45002f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:42:46.944118 2069 raft_consensus.cc:729] T 00000000000000000000000000000000 P 04eb95e4ee644cf09b965e748e45002f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04eb95e4ee644cf09b965e748e45002f, State: Initialized, Role: FOLLOWER
I20260808 04:42:46.944658 2069 consensus_queue.cc:260] T 00000000000000000000000000000000 P 04eb95e4ee644cf09b965e748e45002f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "04eb95e4ee644cf09b965e748e45002f" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 39319 } }
I20260808 04:42:46.944840 2069 raft_consensus.cc:388] T 00000000000000000000000000000000 P 04eb95e4ee644cf09b965e748e45002f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 04:42:46.944906 2069 raft_consensus.cc:482] T 00000000000000000000000000000000 P 04eb95e4ee644cf09b965e748e45002f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 04:42:46.945021 2069 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 04eb95e4ee644cf09b965e748e45002f [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:42:46.946298 2069 raft_consensus.cc:504] T 00000000000000000000000000000000 P 04eb95e4ee644cf09b965e748e45002f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "04eb95e4ee644cf09b965e748e45002f" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 39319 } }
I20260808 04:42:46.946739 2069 leader_election.cc:302] T 00000000000000000000000000000000 P 04eb95e4ee644cf09b965e748e45002f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 04eb95e4ee644cf09b965e748e45002f; no voters:
I20260808 04:42:46.947197 2069 leader_election.cc:288] T 00000000000000000000000000000000 P 04eb95e4ee644cf09b965e748e45002f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 04:42:46.947312 2074 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 04eb95e4ee644cf09b965e748e45002f [term 1 FOLLOWER]: Leader election won for term 1
I20260808 04:42:46.947589 2074 raft_consensus.cc:686] T 00000000000000000000000000000000 P 04eb95e4ee644cf09b965e748e45002f [term 1 LEADER]: Becoming Leader. State: Replica: 04eb95e4ee644cf09b965e748e45002f, State: Running, Role: LEADER
I20260808 04:42:46.947937 2074 consensus_queue.cc:237] T 00000000000000000000000000000000 P 04eb95e4ee644cf09b965e748e45002f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "04eb95e4ee644cf09b965e748e45002f" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 39319 } }
I20260808 04:42:46.948840 2069 sys_catalog.cc:564] T 00000000000000000000000000000000 P 04eb95e4ee644cf09b965e748e45002f [sys.catalog]: configured and running, proceeding with master startup.
I20260808 04:42:46.949420 2074 sys_catalog.cc:455] T 00000000000000000000000000000000 P 04eb95e4ee644cf09b965e748e45002f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "04eb95e4ee644cf09b965e748e45002f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "04eb95e4ee644cf09b965e748e45002f" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 39319 } } }
I20260808 04:42:46.949548 2074 sys_catalog.cc:458] T 00000000000000000000000000000000 P 04eb95e4ee644cf09b965e748e45002f [sys.catalog]: This master's current role is: LEADER
I20260808 04:42:46.949757 2074 sys_catalog.cc:455] T 00000000000000000000000000000000 P 04eb95e4ee644cf09b965e748e45002f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 04eb95e4ee644cf09b965e748e45002f. Latest consensus state: current_term: 1 leader_uuid: "04eb95e4ee644cf09b965e748e45002f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "04eb95e4ee644cf09b965e748e45002f" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 39319 } } }
I20260808 04:42:46.949836 2074 sys_catalog.cc:458] T 00000000000000000000000000000000 P 04eb95e4ee644cf09b965e748e45002f [sys.catalog]: This master's current role is: LEADER
I20260808 04:42:46.950107 2079 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 04:42:46.951649 2072 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:42:46.934639 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41702 (local address 127.20.240.254:39319)
0808 04:42:46.935166 (+ 527us) server_negotiation.cc:206] Beginning negotiation
0808 04:42:46.935186 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0808 04:42:46.935234 (+ 48us) server_negotiation.cc:407] Connection header received
0808 04:42:46.936114 (+ 880us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:42:46.936140 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:42:46.936582 (+ 442us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:42:46.936953 (+ 371us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:42:46.937923 (+ 970us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:42:46.939372 (+ 1449us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:42:46.940595 (+ 1223us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:42:46.941405 (+ 810us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:42:46.941560 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:42:46.944693 (+ 3133us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:42:46.944699 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:42:46.944719 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:42:46.944753 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:42:46.946932 (+ 2179us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:42:46.947828 (+ 896us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:42:46.947835 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:42:46.947842 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:42:46.948000 (+ 158us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:42:46.948432 (+ 432us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:42:46.948435 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:42:46.948437 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:42:46.949022 (+ 585us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:42:46.949249 (+ 227us) server_negotiation.cc:1035] Waiting for connection context
0808 04:42:46.950091 (+ 842us) server_negotiation.cc:299] Negotiation successful
0808 04:42:46.950438 (+ 347us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":364,"thread_start_us":179,"threads_started":1}
I20260808 04:42:46.953817 2079 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 04:42:46.954313 2069 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164000593138-21443-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260808 04:42:46.963160 2092 mvcc.cc:205] Tried to move back new op lower bound from 7316128427869474816 to 7316128427819687936. Current Snapshot: MvccSnapshot[applied={T|T < 7316128427869474816}]
I20260808 04:42:46.971717 2079 catalog_manager.cc:1347] Generated new cluster ID: d46066939d09461a922a82543990b0a3
I20260808 04:42:46.971809 2079 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 04:42:46.992720 2079 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 04:42:46.994207 2079 catalog_manager.cc:1504] Loading token signing keys...
I20260808 04:42:47.002935 2079 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 04eb95e4ee644cf09b965e748e45002f: Generated new TSK 0
I20260808 04:42:47.003860 2079 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.20.240.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.240.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.240.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.193.keytab.
Entry for principal kudu/127.20.240.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.193.keytab.
I20260808 04:42:47.790952 21443 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
/tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164000593138-21443-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164000593138-21443-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164000593138-21443-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164000593138-21443-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.20.240.212:36957/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.240.193:0
--local_ip_for_outbound_sockets=127.20.240.193
--webserver_interface=127.20.240.193
--webserver_port=0
--tserver_master_addrs=127.20.240.254:39319
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.193.keytab
--principal=kudu/127.20.240.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.240.212:43765
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164000593138-21443-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164000593138-21443-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164000593138-21443-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 04:42:47.955505 2117 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:42:47.955993 2117 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:42:47.956101 2117 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:42:47.962037 2117 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:42:47.962178 2117 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:42:47.962473 2117 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.240.193
I20260808 04:42:47.970765 2117 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.240.212:43765
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164000593138-21443-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164000593138-21443-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.20.240.212:36957/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.193.keytab
--principal=kudu/127.20.240.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.240.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164000593138-21443-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.240.193
--webserver_port=0
--tserver_master_addrs=127.20.240.254:39319
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2117
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.240.193
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164000593138-21443-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 04:05:18 UTC on ccycloud.quasar-drfdgt.root.comops.site
build id 4574101
I20260808 04:42:47.972244 2117 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:42:47.973663 2117 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260808 04:42:47.987505 2117 server_base.cc:1034] running on GCE node
W20260808 04:42:47.987326 2127 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:42:47.987831 2125 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:42:47.988199 2124 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:42:47.988749 2117 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:42:47.989589 2117 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:42:47.992897 2117 hybrid_clock.cc:648] HybridClock initialized: now 1786164167992752 us; error 143 us; skew 500 ppm
Aug 08 04:42:47 dist-test-slave-vxj2 krb5kdc[1511](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164167, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.240.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:42:47.999440 2117 init.cc:377] Logged in from keytab as kudu/127.20.240.193@KRBTEST.COM (short username kudu)
I20260808 04:42:48.000914 2117 webserver.cc:460] Webserver started at http://127.20.240.193:45619/ using document root <none> and password file <none>
I20260808 04:42:48.001756 2117 fs_manager.cc:359] Metadata directory not provided
I20260808 04:42:48.001920 2117 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:42:48.002209 2117 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 08 04:42:47 dist-test-slave-vxj2 krb5kdc[1511](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164167, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.240.193@KRBTEST.COM for HTTP/127.20.240.212@KRBTEST.COM
I20260808 04:42:48.026023 2117 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164000593138-21443-0/minicluster-data/ts-0/data/instance:
uuid: "6ee9fe18dabf4c9b8a17a7ac3859f444"
format_stamp: "Formatted at 2026-08-08 04:42:48 on dist-test-slave-vxj2"
server_key: "b12fb8149a60399ad1cf4318f1271c68"
server_key_iv: "5bc4d8ad55cb22c8b5d14c87fb3af1a0"
server_key_version: "kuduclusterkey@0"
I20260808 04:42:48.026942 2117 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164000593138-21443-0/minicluster-data/ts-0/wal/instance:
uuid: "6ee9fe18dabf4c9b8a17a7ac3859f444"
format_stamp: "Formatted at 2026-08-08 04:42:48 on dist-test-slave-vxj2"
server_key: "b12fb8149a60399ad1cf4318f1271c68"
server_key_iv: "5bc4d8ad55cb22c8b5d14c87fb3af1a0"
server_key_version: "kuduclusterkey@0"
I20260808 04:42:48.033793 2117 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.000s
I20260808 04:42:48.053792 2137 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:42:48.055637 2117 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.002s sys 0.000s
I20260808 04:42:48.055840 2117 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164000593138-21443-0/minicluster-data/ts-0/data,/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164000593138-21443-0/minicluster-data/ts-0/wal
uuid: "6ee9fe18dabf4c9b8a17a7ac3859f444"
format_stamp: "Formatted at 2026-08-08 04:42:48 on dist-test-slave-vxj2"
server_key: "b12fb8149a60399ad1cf4318f1271c68"
server_key_iv: "5bc4d8ad55cb22c8b5d14c87fb3af1a0"
server_key_version: "kuduclusterkey@0"
I20260808 04:42:48.056013 2117 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164000593138-21443-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164000593138-21443-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164000593138-21443-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:42:48.096823 2117 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:42:48.100778 2117 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:42:48.100996 2117 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:42:48.102023 2117 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 04:42:48.103250 2117 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 04:42:48.103327 2117 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 04:42:48.103396 2117 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 04:42:48.103425 2117 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 04:42:48.118448 2117 rpc_server.cc:307] RPC server started. Bound to: 127.20.240.193:35549
I20260808 04:42:48.118469 2264 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.240.193:35549 every 8 connection(s)
I20260808 04:42:48.120077 2117 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164000593138-21443-0/minicluster-data/ts-0/data/info.pb
I20260808 04:42:48.122342 21443 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu as pid 2117
I20260808 04:42:48.122507 21443 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164000593138-21443-0/minicluster-data/ts-0/wal/instance
I20260808 04:42:48.122855 21443 external_mini_cluster.cc:1428] Setting key 9b05923eb04a13b0fbe56932db0d3642
Aug 08 04:42:48 dist-test-slave-vxj2 krb5kdc[1511](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164167, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.240.193@KRBTEST.COM for kudu/127.20.240.254@KRBTEST.COM
I20260808 04:42:48.143960 2267 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:42:48.124978 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.240.193:35189 (local address 127.20.240.254:39319)
0808 04:42:48.129286 (+ 4308us) server_negotiation.cc:206] Beginning negotiation
0808 04:42:48.129291 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 04:42:48.129308 (+ 17us) server_negotiation.cc:407] Connection header received
0808 04:42:48.129359 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:42:48.129361 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:42:48.129414 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:42:48.129507 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:42:48.131385 (+ 1878us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:42:48.132276 (+ 891us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:42:48.134326 (+ 2050us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:42:48.134705 (+ 379us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:42:48.134835 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:42:48.138471 (+ 3636us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:42:48.138476 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:42:48.138479 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:42:48.138512 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:42:48.140670 (+ 2158us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:42:48.141488 (+ 818us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:42:48.141492 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:42:48.141494 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:42:48.141593 (+ 99us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:42:48.142043 (+ 450us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:42:48.142047 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:42:48.142048 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:42:48.142300 (+ 252us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:42:48.142398 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0808 04:42:48.143596 (+ 1198us) server_negotiation.cc:299] Negotiation successful
0808 04:42:48.143762 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":4161,"thread_start_us":122,"threads_started":1}
I20260808 04:42:48.146057 2268 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:42:48.125653 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:39319 (local address 127.20.240.193:35189)
0808 04:42:48.127727 (+ 2074us) negotiation.cc:107] Waiting for socket to connect
0808 04:42:48.127816 (+ 89us) client_negotiation.cc:174] Beginning negotiation
0808 04:42:48.128789 (+ 973us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:42:48.129900 (+ 1111us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:42:48.129911 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:42:48.130367 (+ 456us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:42:48.131165 (+ 798us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:42:48.131189 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:42:48.132491 (+ 1302us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:42:48.132496 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:42:48.134123 (+ 1627us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:42:48.134137 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:42:48.135068 (+ 931us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:42:48.135074 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:42:48.135356 (+ 282us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:42:48.136140 (+ 784us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:42:48.136164 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:42:48.138181 (+ 2017us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:42:48.140871 (+ 2690us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:42:48.140879 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:42:48.140900 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:42:48.141351 (+ 451us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:42:48.141695 (+ 344us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:42:48.141699 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:42:48.141701 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:42:48.141923 (+ 222us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:42:48.142459 (+ 536us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:42:48.142467 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:42:48.142892 (+ 425us) client_negotiation.cc:769] Sending connection context
0808 04:42:48.143124 (+ 232us) client_negotiation.cc:240] Negotiation successful
0808 04:42:48.144764 (+ 1640us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1797,"thread_start_us":162,"threads_started":1}
I20260808 04:42:48.147945 2265 heartbeater.cc:347] Connected to a master server at 127.20.240.254:39319
I20260808 04:42:48.148228 2265 heartbeater.cc:464] Registering TS with master...
I20260808 04:42:48.148939 2265 heartbeater.cc:511] Master 127.20.240.254:39319 requested a full tablet report, sending...
I20260808 04:42:48.151216 2026 ts_manager.cc:194] Registered new tserver with Master: 6ee9fe18dabf4c9b8a17a7ac3859f444 (127.20.240.193:35549)
I20260808 04:42:48.152863 2026 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.240.193@KRBTEST.COM'} at 127.20.240.193:35189
WARNING: no policy specified for kudu/127.20.240.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.240.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.240.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.194.keytab.
Entry for principal kudu/127.20.240.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.194.keytab.
I20260808 04:42:48.181206 21443 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
/tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164000593138-21443-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164000593138-21443-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164000593138-21443-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164000593138-21443-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.20.240.212:36957/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.240.194:0
--local_ip_for_outbound_sockets=127.20.240.194
--webserver_interface=127.20.240.194
--webserver_port=0
--tserver_master_addrs=127.20.240.254:39319
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.194.keytab
--principal=kudu/127.20.240.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.240.212:43765
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164000593138-21443-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164000593138-21443-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164000593138-21443-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 08 04:42:48 dist-test-slave-vxj2 krb5kdc[1511](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786164168, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.240.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
W20260808 04:42:48.344183 2271 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:42:48.344619 2271 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:42:48.344702 2271 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:42:48.350195 2271 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:42:48.350292 2271 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:42:48.350382 2271 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.240.194
I20260808 04:42:48.356685 2271 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.240.212:43765
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164000593138-21443-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164000593138-21443-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.20.240.212:36957/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.194.keytab
--principal=kudu/127.20.240.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.240.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164000593138-21443-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.240.194
--webserver_port=0
--tserver_master_addrs=127.20.240.254:39319
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2271
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.240.194
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164000593138-21443-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 04:05:18 UTC on ccycloud.quasar-drfdgt.root.comops.site
build id 4574101
I20260808 04:42:48.357899 2271 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:42:48.359083 2271 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:42:48.372215 2278 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:42:48.372339 2281 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:42:48.372228 2279 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:42:48.374745 2271 server_base.cc:1034] running on GCE node
I20260808 04:42:48.375356 2271 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:42:48.376231 2271 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:42:48.377442 2271 hybrid_clock.cc:648] HybridClock initialized: now 1786164168377415 us; error 61 us; skew 500 ppm
Aug 08 04:42:48 dist-test-slave-vxj2 krb5kdc[1511](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164168, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.240.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:42:48.380854 2271 init.cc:377] Logged in from keytab as kudu/127.20.240.194@KRBTEST.COM (short username kudu)
I20260808 04:42:48.381973 2271 webserver.cc:460] Webserver started at http://127.20.240.194:40589/ using document root <none> and password file <none>
I20260808 04:42:48.382579 2271 fs_manager.cc:359] Metadata directory not provided
I20260808 04:42:48.382678 2271 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:42:48.382922 2271 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 08 04:42:48 dist-test-slave-vxj2 krb5kdc[1511](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164168, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.240.194@KRBTEST.COM for HTTP/127.20.240.212@KRBTEST.COM
I20260808 04:42:48.411717 2271 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164000593138-21443-0/minicluster-data/ts-1/data/instance:
uuid: "1d751d805fca470bae48412c8043f947"
format_stamp: "Formatted at 2026-08-08 04:42:48 on dist-test-slave-vxj2"
server_key: "2746a44a32b6dd7e8a08e5e2bdf4f139"
server_key_iv: "e0276bea181e7e19ed23dbdc453ccfdb"
server_key_version: "kuduclusterkey@0"
I20260808 04:42:48.412662 2271 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164000593138-21443-0/minicluster-data/ts-1/wal/instance:
uuid: "1d751d805fca470bae48412c8043f947"
format_stamp: "Formatted at 2026-08-08 04:42:48 on dist-test-slave-vxj2"
server_key: "2746a44a32b6dd7e8a08e5e2bdf4f139"
server_key_iv: "e0276bea181e7e19ed23dbdc453ccfdb"
server_key_version: "kuduclusterkey@0"
I20260808 04:42:48.419529 2271 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.003s
I20260808 04:42:48.442178 2290 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:42:48.444120 2271 fs_manager.cc:725] Time spent opening block manager: real 0.007s user 0.003s sys 0.000s
I20260808 04:42:48.444291 2271 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164000593138-21443-0/minicluster-data/ts-1/data,/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164000593138-21443-0/minicluster-data/ts-1/wal
uuid: "1d751d805fca470bae48412c8043f947"
format_stamp: "Formatted at 2026-08-08 04:42:48 on dist-test-slave-vxj2"
server_key: "2746a44a32b6dd7e8a08e5e2bdf4f139"
server_key_iv: "e0276bea181e7e19ed23dbdc453ccfdb"
server_key_version: "kuduclusterkey@0"
I20260808 04:42:48.444504 2271 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164000593138-21443-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164000593138-21443-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164000593138-21443-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:42:48.479971 2271 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:42:48.484066 2271 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:42:48.484306 2271 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:42:48.485210 2271 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 04:42:48.486440 2271 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 04:42:48.486552 2271 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 04:42:48.486618 2271 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 04:42:48.486651 2271 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 04:42:48.499868 2271 rpc_server.cc:307] RPC server started. Bound to: 127.20.240.194:41479
I20260808 04:42:48.499912 2413 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.240.194:41479 every 8 connection(s)
I20260808 04:42:48.500867 2271 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164000593138-21443-0/minicluster-data/ts-1/data/info.pb
I20260808 04:42:48.507155 21443 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu as pid 2271
I20260808 04:42:48.507315 21443 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164000593138-21443-0/minicluster-data/ts-1/wal/instance
I20260808 04:42:48.507628 21443 external_mini_cluster.cc:1428] Setting key 0d6c8e60189cf754a022cfc897dedb13
Aug 08 04:42:48 dist-test-slave-vxj2 krb5kdc[1511](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164168, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.240.194@KRBTEST.COM for kudu/127.20.240.254@KRBTEST.COM
I20260808 04:42:48.517279 2267 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:42:48.503064 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.240.194:42787 (local address 127.20.240.254:39319)
0808 04:42:48.503237 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0808 04:42:48.503242 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 04:42:48.504203 (+ 961us) server_negotiation.cc:407] Connection header received
0808 04:42:48.505513 (+ 1310us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:42:48.505517 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:42:48.505568 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:42:48.505649 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:42:48.507303 (+ 1654us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:42:48.508097 (+ 794us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:42:48.509684 (+ 1587us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:42:48.510035 (+ 351us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:42:48.510149 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:42:48.513025 (+ 2876us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:42:48.513031 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:42:48.513033 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:42:48.513062 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:42:48.514916 (+ 1854us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:42:48.515580 (+ 664us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:42:48.515584 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:42:48.515586 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:42:48.515675 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:42:48.516042 (+ 367us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:42:48.516046 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:42:48.516048 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:42:48.516257 (+ 209us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:42:48.516373 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0808 04:42:48.516913 (+ 540us) server_negotiation.cc:299] Negotiation successful
0808 04:42:48.517065 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260808 04:42:48.518253 2416 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:42:48.503440 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:39319 (local address 127.20.240.194:42787)
0808 04:42:48.503998 (+ 558us) negotiation.cc:107] Waiting for socket to connect
0808 04:42:48.504061 (+ 63us) client_negotiation.cc:174] Beginning negotiation
0808 04:42:48.505220 (+ 1159us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:42:48.505897 (+ 677us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:42:48.505908 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:42:48.506309 (+ 401us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:42:48.507061 (+ 752us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:42:48.507102 (+ 41us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:42:48.508274 (+ 1172us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:42:48.508277 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:42:48.509540 (+ 1263us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:42:48.509552 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:42:48.510224 (+ 672us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:42:48.510231 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:42:48.510509 (+ 278us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:42:48.511263 (+ 754us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:42:48.511292 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:42:48.512817 (+ 1525us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:42:48.515060 (+ 2243us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:42:48.515068 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:42:48.515089 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:42:48.515470 (+ 381us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:42:48.515773 (+ 303us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:42:48.515777 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:42:48.515780 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:42:48.515942 (+ 162us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:42:48.516377 (+ 435us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:42:48.516386 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:42:48.516666 (+ 280us) client_negotiation.cc:769] Sending connection context
0808 04:42:48.516881 (+ 215us) client_negotiation.cc:240] Negotiation successful
0808 04:42:48.517263 (+ 382us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":320,"thread_start_us":133,"threads_started":1}
WARNING: no policy specified for kudu/127.20.240.195@KRBTEST.COM; defaulting to no policy
I20260808 04:42:48.519786 2414 heartbeater.cc:347] Connected to a master server at 127.20.240.254:39319
I20260808 04:42:48.520071 2414 heartbeater.cc:464] Registering TS with master...
I20260808 04:42:48.520644 2414 heartbeater.cc:511] Master 127.20.240.254:39319 requested a full tablet report, sending...
I20260808 04:42:48.521903 2026 ts_manager.cc:194] Registered new tserver with Master: 1d751d805fca470bae48412c8043f947 (127.20.240.194:41479)
I20260808 04:42:48.522509 2026 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.240.194@KRBTEST.COM'} at 127.20.240.194:42787
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.240.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.240.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.195.keytab.
Entry for principal kudu/127.20.240.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.195.keytab.
I20260808 04:42:48.548612 21443 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
/tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164000593138-21443-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164000593138-21443-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164000593138-21443-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164000593138-21443-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.20.240.212:36957/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.240.195:0
--local_ip_for_outbound_sockets=127.20.240.195
--webserver_interface=127.20.240.195
--webserver_port=0
--tserver_master_addrs=127.20.240.254:39319
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.195.keytab
--principal=kudu/127.20.240.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.240.212:43765
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164000593138-21443-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164000593138-21443-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164000593138-21443-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 08 04:42:48 dist-test-slave-vxj2 krb5kdc[1511](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164168, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.240.254@KRBTEST.COM for HTTP/127.20.240.212@KRBTEST.COM
W20260808 04:42:48.720867 2419 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:42:48.721410 2419 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:42:48.721529 2419 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:42:48.727898 2419 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:42:48.728096 2419 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:42:48.728282 2419 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.240.195
I20260808 04:42:48.738868 2419 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.240.212:43765
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164000593138-21443-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164000593138-21443-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.20.240.212:36957/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.195.keytab
--principal=kudu/127.20.240.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.240.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164000593138-21443-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.240.195
--webserver_port=0
--tserver_master_addrs=127.20.240.254:39319
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2419
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.240.195
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164000593138-21443-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 04:05:18 UTC on ccycloud.quasar-drfdgt.root.comops.site
build id 4574101
I20260808 04:42:48.740660 2419 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:42:48.742234 2419 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:42:48.755596 2425 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:42:48.755577 2424 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:42:48.756426 2427 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:42:48.756448 2419 server_base.cc:1034] running on GCE node
I20260808 04:42:48.756873 2419 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:42:48.757601 2419 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:42:48.789276 2419 hybrid_clock.cc:648] HybridClock initialized: now 1786164168789157 us; error 163 us; skew 500 ppm
Aug 08 04:42:48 dist-test-slave-vxj2 krb5kdc[1511](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164168, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.240.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:42:48.793498 2419 init.cc:377] Logged in from keytab as kudu/127.20.240.195@KRBTEST.COM (short username kudu)
I20260808 04:42:48.794751 2419 webserver.cc:460] Webserver started at http://127.20.240.195:37077/ using document root <none> and password file <none>
I20260808 04:42:48.795552 2419 fs_manager.cc:359] Metadata directory not provided
I20260808 04:42:48.795686 2419 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:42:48.795960 2419 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 08 04:42:48 dist-test-slave-vxj2 krb5kdc[1511](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164168, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.240.195@KRBTEST.COM for HTTP/127.20.240.212@KRBTEST.COM
I20260808 04:42:48.812997 2419 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164000593138-21443-0/minicluster-data/ts-2/data/instance:
uuid: "e66665c7fa5c4cd7b74280b0bcbf06e2"
format_stamp: "Formatted at 2026-08-08 04:42:48 on dist-test-slave-vxj2"
server_key: "e0a0c1d73fad518bdc1068e66d2ff250"
server_key_iv: "ea511bb6510fb034389c3d30e603b676"
server_key_version: "kuduclusterkey@0"
I20260808 04:42:48.819813 2419 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164000593138-21443-0/minicluster-data/ts-2/wal/instance:
uuid: "e66665c7fa5c4cd7b74280b0bcbf06e2"
format_stamp: "Formatted at 2026-08-08 04:42:48 on dist-test-slave-vxj2"
server_key: "e0a0c1d73fad518bdc1068e66d2ff250"
server_key_iv: "ea511bb6510fb034389c3d30e603b676"
server_key_version: "kuduclusterkey@0"
I20260808 04:42:48.826381 2419 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.000s
I20260808 04:42:48.852304 2434 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:42:48.854235 2419 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.000s
I20260808 04:42:48.854380 2419 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164000593138-21443-0/minicluster-data/ts-2/data,/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164000593138-21443-0/minicluster-data/ts-2/wal
uuid: "e66665c7fa5c4cd7b74280b0bcbf06e2"
format_stamp: "Formatted at 2026-08-08 04:42:48 on dist-test-slave-vxj2"
server_key: "e0a0c1d73fad518bdc1068e66d2ff250"
server_key_iv: "ea511bb6510fb034389c3d30e603b676"
server_key_version: "kuduclusterkey@0"
I20260808 04:42:48.854525 2419 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164000593138-21443-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164000593138-21443-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164000593138-21443-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:42:48.896335 2419 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:42:48.900511 2419 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:42:48.900792 2419 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:42:48.901585 2419 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 04:42:48.902674 2419 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 04:42:48.902803 2419 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 04:42:48.902902 2419 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 04:42:48.903167 2419 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 04:42:48.917311 2419 rpc_server.cc:307] RPC server started. Bound to: 127.20.240.195:39757
I20260808 04:42:48.918555 2419 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164000593138-21443-0/minicluster-data/ts-2/data/info.pb
I20260808 04:42:48.920135 2560 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.240.195:39757 every 8 connection(s)
I20260808 04:42:48.924382 21443 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu as pid 2419
I20260808 04:42:48.924518 21443 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164000593138-21443-0/minicluster-data/ts-2/wal/instance
I20260808 04:42:48.924814 21443 external_mini_cluster.cc:1428] Setting key ca8aebfd15877ba1f63a42cc4705d87a
Aug 08 04:42:48 dist-test-slave-vxj2 krb5kdc[1511](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164168, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.240.195@KRBTEST.COM for kudu/127.20.240.254@KRBTEST.COM
I20260808 04:42:48.938683 2267 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:42:48.921047 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.240.195:45869 (local address 127.20.240.254:39319)
0808 04:42:48.921216 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0808 04:42:48.921221 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 04:42:48.922468 (+ 1247us) server_negotiation.cc:407] Connection header received
0808 04:42:48.923771 (+ 1303us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:42:48.923775 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:42:48.923834 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:42:48.923887 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:42:48.926955 (+ 3068us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:42:48.927803 (+ 848us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:42:48.929719 (+ 1916us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:42:48.930074 (+ 355us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:42:48.930156 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:42:48.933759 (+ 3603us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:42:48.933764 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:42:48.933767 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:42:48.933801 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:42:48.935645 (+ 1844us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:42:48.936540 (+ 895us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:42:48.936544 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:42:48.936546 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:42:48.936655 (+ 109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:42:48.937178 (+ 523us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:42:48.937182 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:42:48.937184 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:42:48.937443 (+ 259us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:42:48.937549 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0808 04:42:48.938359 (+ 810us) server_negotiation.cc:299] Negotiation successful
0808 04:42:48.938505 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260808 04:42:48.940443 2563 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:42:48.921633 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:39319 (local address 127.20.240.195:45869)
0808 04:42:48.922259 (+ 626us) negotiation.cc:107] Waiting for socket to connect
0808 04:42:48.922324 (+ 65us) client_negotiation.cc:174] Beginning negotiation
0808 04:42:48.923500 (+ 1176us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:42:48.925576 (+ 2076us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:42:48.925587 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:42:48.925988 (+ 401us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:42:48.926763 (+ 775us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:42:48.926785 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:42:48.927990 (+ 1205us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:42:48.927999 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:42:48.929533 (+ 1534us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:42:48.929549 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:42:48.930414 (+ 865us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:42:48.930418 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:42:48.930650 (+ 232us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:42:48.931442 (+ 792us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:42:48.931465 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:42:48.933468 (+ 2003us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:42:48.935843 (+ 2375us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:42:48.935852 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:42:48.935875 (+ 23us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:42:48.936359 (+ 484us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:42:48.936775 (+ 416us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:42:48.936780 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:42:48.936782 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:42:48.937022 (+ 240us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:42:48.937620 (+ 598us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:42:48.937627 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:42:48.938042 (+ 415us) client_negotiation.cc:769] Sending connection context
0808 04:42:48.938871 (+ 829us) client_negotiation.cc:240] Negotiation successful
0808 04:42:48.939287 (+ 416us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":382,"thread_start_us":174,"threads_started":1}
I20260808 04:42:48.941957 2561 heartbeater.cc:347] Connected to a master server at 127.20.240.254:39319
I20260808 04:42:48.942232 2561 heartbeater.cc:464] Registering TS with master...
I20260808 04:42:48.942875 2561 heartbeater.cc:511] Master 127.20.240.254:39319 requested a full tablet report, sending...
I20260808 04:42:48.944156 2026 ts_manager.cc:194] Registered new tserver with Master: e66665c7fa5c4cd7b74280b0bcbf06e2 (127.20.240.195:39757)
I20260808 04:42:48.944940 2026 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.240.195@KRBTEST.COM'} at 127.20.240.195:45869
I20260808 04:42:48.951316 21443 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 04:42:48.952086 21443 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu with pid 2117
I20260808 04:42:48.971762 21443 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu with pid 2271
I20260808 04:42:48.979007 21443 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu with pid 2419
I20260808 04:42:48.987154 21443 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu with pid 1991
I20260808 04:42:48.995775 21443 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
/tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164000593138-21443-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164000593138-21443-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164000593138-21443-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164000593138-21443-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.240.254:39319
--webserver_interface=127.20.240.254
--webserver_port=35293
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.254.keytab
--principal=kudu/127.20.240.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.240.212:43765
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.240.254:39319
--ranger_config_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164000593138-21443-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.20.240.212:36957/kms
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.20.240.212:36957/kms with env {KRB5CCNAME=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164000593138-21443-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164000593138-21443-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164000593138-21443-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 04:42:49.114235 2564 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:42:49.114601 2564 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:42:49.114646 2564 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:42:49.118983 2564 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 04:42:49.119069 2564 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:42:49.119091 2564 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:42:49.119107 2564 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 04:42:49.119123 2564 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 04:42:49.125133 2564 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.240.212:43765
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164000593138-21443-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164000593138-21443-0/minicluster-data/master-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.20.240.212:36957/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.20.240.254:39319
--ranger_config_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164000593138-21443-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.254.keytab
--principal=kudu/127.20.240.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.240.254:39319
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164000593138-21443-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.240.254
--webserver_port=35293
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2564
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164000593138-21443-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 04:05:18 UTC on ccycloud.quasar-drfdgt.root.comops.site
build id 4574101
I20260808 04:42:49.126345 2564 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:42:49.127410 2564 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:42:49.136495 2572 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:42:49.136480 2569 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:42:49.136540 2564 server_base.cc:1034] running on GCE node
W20260808 04:42:49.136479 2570 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:42:49.137635 2564 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:42:49.138857 2564 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:42:49.140089 2564 hybrid_clock.cc:648] HybridClock initialized: now 1786164169140068 us; error 37 us; skew 500 ppm
Aug 08 04:42:49 dist-test-slave-vxj2 krb5kdc[1511](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164169, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.240.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:42:49.143278 2564 init.cc:377] Logged in from keytab as kudu/127.20.240.254@KRBTEST.COM (short username kudu)
I20260808 04:42:49.144243 2564 webserver.cc:460] Webserver started at http://127.20.240.254:35293/ using document root <none> and password file <none>
I20260808 04:42:49.144819 2564 fs_manager.cc:359] Metadata directory not provided
I20260808 04:42:49.144920 2564 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 08 04:42:49 dist-test-slave-vxj2 krb5kdc[1511](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164169, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.240.254@KRBTEST.COM for HTTP/127.20.240.212@KRBTEST.COM
I20260808 04:42:49.232069 2564 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.000s
I20260808 04:42:49.234983 2581 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:42:49.236464 2564 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260808 04:42:49.236644 2564 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164000593138-21443-0/minicluster-data/master-0/data,/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164000593138-21443-0/minicluster-data/master-0/wal
uuid: "04eb95e4ee644cf09b965e748e45002f"
format_stamp: "Formatted at 2026-08-08 04:42:46 on dist-test-slave-vxj2"
server_key: "8d7923ffd446aa4de979c21b1e3fef2d"
server_key_iv: "bc250194619c59f1ded8667cdd32ffd4"
server_key_version: "kuduclusterkey@0"
I20260808 04:42:49.237385 2564 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164000593138-21443-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164000593138-21443-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164000593138-21443-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:42:49.260708 2564 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:42:49.264062 2564 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:42:49.264292 2564 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:42:49.272938 2564 rpc_server.cc:307] RPC server started. Bound to: 127.20.240.254:39319
I20260808 04:42:49.272941 2642 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.240.254:39319 every 8 connection(s)
I20260808 04:42:49.274485 2564 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164000593138-21443-0/minicluster-data/master-0/data/info.pb
I20260808 04:42:49.274830 21443 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu as pid 2564
I20260808 04:42:49.275357 21443 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
/tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164000593138-21443-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164000593138-21443-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164000593138-21443-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164000593138-21443-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.20.240.212:36957/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.240.193:35549
--local_ip_for_outbound_sockets=127.20.240.193
--tserver_master_addrs=127.20.240.254:39319
--webserver_port=45619
--webserver_interface=127.20.240.193
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.193.keytab
--principal=kudu/127.20.240.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.240.212:43765
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.20.240.212:36957/kms with env {KRB5CCNAME=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164000593138-21443-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164000593138-21443-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164000593138-21443-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 04:42:49.280231 2643 sys_catalog.cc:263] Verifying existing consensus state
I20260808 04:42:49.282426 2643 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 04eb95e4ee644cf09b965e748e45002f: Bootstrap starting.
I20260808 04:42:49.301472 2643 log.cc:824] T 00000000000000000000000000000000 P 04eb95e4ee644cf09b965e748e45002f: Log is configured to *not* fsync() on all Append() calls
I20260808 04:42:49.309227 2643 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 04eb95e4ee644cf09b965e748e45002f: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 04:42:49.309752 2643 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 04eb95e4ee644cf09b965e748e45002f: Bootstrap complete.
I20260808 04:42:49.314556 2643 raft_consensus.cc:348] T 00000000000000000000000000000000 P 04eb95e4ee644cf09b965e748e45002f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "04eb95e4ee644cf09b965e748e45002f" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 39319 } }
I20260808 04:42:49.315057 2643 raft_consensus.cc:729] T 00000000000000000000000000000000 P 04eb95e4ee644cf09b965e748e45002f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04eb95e4ee644cf09b965e748e45002f, State: Initialized, Role: FOLLOWER
I20260808 04:42:49.315829 2643 consensus_queue.cc:260] T 00000000000000000000000000000000 P 04eb95e4ee644cf09b965e748e45002f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "04eb95e4ee644cf09b965e748e45002f" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 39319 } }
I20260808 04:42:49.316015 2643 raft_consensus.cc:388] T 00000000000000000000000000000000 P 04eb95e4ee644cf09b965e748e45002f [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 04:42:49.316089 2643 raft_consensus.cc:482] T 00000000000000000000000000000000 P 04eb95e4ee644cf09b965e748e45002f [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 04:42:49.316198 2643 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 04eb95e4ee644cf09b965e748e45002f [term 1 FOLLOWER]: Advancing to term 2
I20260808 04:42:49.319455 2643 raft_consensus.cc:504] T 00000000000000000000000000000000 P 04eb95e4ee644cf09b965e748e45002f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "04eb95e4ee644cf09b965e748e45002f" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 39319 } }
I20260808 04:42:49.319927 2643 leader_election.cc:302] T 00000000000000000000000000000000 P 04eb95e4ee644cf09b965e748e45002f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 04eb95e4ee644cf09b965e748e45002f; no voters:
I20260808 04:42:49.320371 2643 leader_election.cc:288] T 00000000000000000000000000000000 P 04eb95e4ee644cf09b965e748e45002f [CANDIDATE]: Term 2 election: Requested vote from peers
I20260808 04:42:49.320576 2647 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 04eb95e4ee644cf09b965e748e45002f [term 2 FOLLOWER]: Leader election won for term 2
I20260808 04:42:49.320869 2647 raft_consensus.cc:686] T 00000000000000000000000000000000 P 04eb95e4ee644cf09b965e748e45002f [term 2 LEADER]: Becoming Leader. State: Replica: 04eb95e4ee644cf09b965e748e45002f, State: Running, Role: LEADER
I20260808 04:42:49.321337 2647 consensus_queue.cc:237] T 00000000000000000000000000000000 P 04eb95e4ee644cf09b965e748e45002f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "04eb95e4ee644cf09b965e748e45002f" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 39319 } }
I20260808 04:42:49.322014 2643 sys_catalog.cc:564] T 00000000000000000000000000000000 P 04eb95e4ee644cf09b965e748e45002f [sys.catalog]: configured and running, proceeding with master startup.
I20260808 04:42:49.322638 2647 sys_catalog.cc:455] T 00000000000000000000000000000000 P 04eb95e4ee644cf09b965e748e45002f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "04eb95e4ee644cf09b965e748e45002f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "04eb95e4ee644cf09b965e748e45002f" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 39319 } } }
I20260808 04:42:49.322885 2647 sys_catalog.cc:458] T 00000000000000000000000000000000 P 04eb95e4ee644cf09b965e748e45002f [sys.catalog]: This master's current role is: LEADER
I20260808 04:42:49.323189 2647 sys_catalog.cc:455] T 00000000000000000000000000000000 P 04eb95e4ee644cf09b965e748e45002f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 04eb95e4ee644cf09b965e748e45002f. Latest consensus state: current_term: 2 leader_uuid: "04eb95e4ee644cf09b965e748e45002f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "04eb95e4ee644cf09b965e748e45002f" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 39319 } } }
I20260808 04:42:49.323482 2647 sys_catalog.cc:458] T 00000000000000000000000000000000 P 04eb95e4ee644cf09b965e748e45002f [sys.catalog]: This master's current role is: LEADER
I20260808 04:42:49.323840 2655 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 04:42:49.327817 2655 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 04:42:49.328428 2643 ranger_client.cc:318] Using overwritten properties file: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164000593138-21443-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260808 04:42:49.328816 2655 catalog_manager.cc:1259] Loaded cluster ID: d46066939d09461a922a82543990b0a3
I20260808 04:42:49.328933 2655 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 04:42:49.331626 2655 catalog_manager.cc:1504] Loading token signing keys...
I20260808 04:42:49.332512 2655 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 04eb95e4ee644cf09b965e748e45002f: Loaded TSK: 0
I20260808 04:42:49.334156 2655 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260808 04:42:49.478547 2645 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:42:49.478930 2645 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:42:49.479018 2645 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:42:49.485615 2645 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:42:49.485719 2645 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:42:49.485832 2645 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.240.193
I20260808 04:42:49.494546 2645 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.240.212:43765
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164000593138-21443-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164000593138-21443-0/minicluster-data/ts-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.20.240.212:36957/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.193.keytab
--principal=kudu/127.20.240.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.240.193:35549
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164000593138-21443-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.240.193
--webserver_port=45619
--tserver_master_addrs=127.20.240.254:39319
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2645
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.240.193
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164000593138-21443-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 04:05:18 UTC on ccycloud.quasar-drfdgt.root.comops.site
build id 4574101
I20260808 04:42:49.495959 2645 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:42:49.497363 2645 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:42:49.515861 2688 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:42:49.517952 2684 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:42:49.518558 2686 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:42:49.520990 2645 server_base.cc:1034] running on GCE node
I20260808 04:42:49.522081 2645 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:42:49.523041 2645 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:42:49.524210 2645 hybrid_clock.cc:648] HybridClock initialized: now 1786164169524134 us; error 97 us; skew 500 ppm
Aug 08 04:42:49 dist-test-slave-vxj2 krb5kdc[1511](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164169, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.240.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:42:49.532253 2645 init.cc:377] Logged in from keytab as kudu/127.20.240.193@KRBTEST.COM (short username kudu)
I20260808 04:42:49.533677 2645 webserver.cc:460] Webserver started at http://127.20.240.193:45619/ using document root <none> and password file <none>
I20260808 04:42:49.534531 2645 fs_manager.cc:359] Metadata directory not provided
I20260808 04:42:49.534665 2645 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 08 04:42:49 dist-test-slave-vxj2 krb5kdc[1511](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164169, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.240.193@KRBTEST.COM for HTTP/127.20.240.212@KRBTEST.COM
I20260808 04:42:49.571743 2645 fs_manager.cc:709] Time spent opening directory manager: real 0.007s user 0.003s sys 0.000s
I20260808 04:42:49.575664 2696 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:42:49.577538 2645 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.000s
I20260808 04:42:49.577679 2645 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164000593138-21443-0/minicluster-data/ts-0/data,/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164000593138-21443-0/minicluster-data/ts-0/wal
uuid: "6ee9fe18dabf4c9b8a17a7ac3859f444"
format_stamp: "Formatted at 2026-08-08 04:42:48 on dist-test-slave-vxj2"
server_key: "b12fb8149a60399ad1cf4318f1271c68"
server_key_iv: "5bc4d8ad55cb22c8b5d14c87fb3af1a0"
server_key_version: "kuduclusterkey@0"
I20260808 04:42:49.578801 2645 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164000593138-21443-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164000593138-21443-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164000593138-21443-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:42:49.597919 2645 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:42:49.602274 2645 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:42:49.602576 2645 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:42:49.603519 2645 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 04:42:49.604805 2645 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 04:42:49.605003 2645 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 04:42:49.605188 2645 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 04:42:49.605309 2645 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 04:42:49.618221 2645 rpc_server.cc:307] RPC server started. Bound to: 127.20.240.193:35549
I20260808 04:42:49.618299 2820 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.240.193:35549 every 8 connection(s)
I20260808 04:42:49.619853 2645 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164000593138-21443-0/minicluster-data/ts-0/data/info.pb
I20260808 04:42:49.629779 21443 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu as pid 2645
I20260808 04:42:49.630278 21443 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
/tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164000593138-21443-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164000593138-21443-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164000593138-21443-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164000593138-21443-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.20.240.212:36957/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.240.194:41479
--local_ip_for_outbound_sockets=127.20.240.194
--tserver_master_addrs=127.20.240.254:39319
--webserver_port=40589
--webserver_interface=127.20.240.194
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.194.keytab
--principal=kudu/127.20.240.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.240.212:43765
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.20.240.212:36957/kms with env {KRB5CCNAME=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164000593138-21443-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164000593138-21443-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164000593138-21443-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 08 04:42:49 dist-test-slave-vxj2 krb5kdc[1511](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164169, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.240.193@KRBTEST.COM for kudu/127.20.240.254@KRBTEST.COM
I20260808 04:42:49.643411 2824 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:42:49.623020 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:39319 (local address 127.20.240.193:45677)
0808 04:42:49.624216 (+ 1196us) negotiation.cc:107] Waiting for socket to connect
0808 04:42:49.624259 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0808 04:42:49.625373 (+ 1114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:42:49.627382 (+ 2009us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:42:49.627391 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:42:49.627775 (+ 384us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:42:49.628453 (+ 678us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:42:49.628476 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:42:49.630825 (+ 2349us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:42:49.630829 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:42:49.632271 (+ 1442us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:42:49.632284 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:42:49.633726 (+ 1442us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:42:49.633731 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:42:49.633953 (+ 222us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:42:49.634710 (+ 757us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:42:49.634736 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:42:49.636563 (+ 1827us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:42:49.639263 (+ 2700us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:42:49.639270 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:42:49.639285 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:42:49.639658 (+ 373us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:42:49.640101 (+ 443us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:42:49.640105 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:42:49.640108 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:42:49.640297 (+ 189us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:42:49.641220 (+ 923us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:42:49.641227 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:42:49.641679 (+ 452us) client_negotiation.cc:769] Sending connection context
0808 04:42:49.641899 (+ 220us) client_negotiation.cc:240] Negotiation successful
0808 04:42:49.642268 (+ 369us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":990,"thread_start_us":157,"threads_started":1}
I20260808 04:42:49.645531 2823 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:42:49.622847 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.240.193:45677 (local address 127.20.240.254:39319)
0808 04:42:49.624039 (+ 1192us) server_negotiation.cc:206] Beginning negotiation
0808 04:42:49.624065 (+ 26us) server_negotiation.cc:399] Waiting for connection header
0808 04:42:49.624408 (+ 343us) server_negotiation.cc:407] Connection header received
0808 04:42:49.625992 (+ 1584us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:42:49.626007 (+ 15us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:42:49.626449 (+ 442us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:42:49.626832 (+ 383us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:42:49.628675 (+ 1843us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:42:49.630649 (+ 1974us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:42:49.632443 (+ 1794us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:42:49.633257 (+ 814us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:42:49.633460 (+ 203us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:42:49.636821 (+ 3361us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:42:49.636828 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:42:49.636848 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:42:49.636884 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:42:49.639113 (+ 2229us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:42:49.639808 (+ 695us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:42:49.639815 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:42:49.639820 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:42:49.639975 (+ 155us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:42:49.640434 (+ 459us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:42:49.640437 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:42:49.640439 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:42:49.640970 (+ 531us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:42:49.641102 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0808 04:42:49.644195 (+ 3093us) server_negotiation.cc:299] Negotiation successful
0808 04:42:49.644537 (+ 342us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":992,"thread_start_us":128,"threads_started":1}
I20260808 04:42:49.649487 2821 heartbeater.cc:347] Connected to a master server at 127.20.240.254:39319
I20260808 04:42:49.649756 2821 heartbeater.cc:464] Registering TS with master...
I20260808 04:42:49.650425 2821 heartbeater.cc:511] Master 127.20.240.254:39319 requested a full tablet report, sending...
W20260808 04:42:49.652940 2821 heartbeater.cc:644] Failed to heartbeat to 127.20.240.254:39319 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260808 04:42:49.653092 2821 heartbeater.cc:464] Registering TS with master...
I20260808 04:42:49.653352 2821 heartbeater.cc:511] Master 127.20.240.254:39319 requested a full tablet report, sending...
I20260808 04:42:49.654301 2821 heartbeater.cc:464] Registering TS with master...
I20260808 04:42:49.654524 2821 heartbeater.cc:511] Master 127.20.240.254:39319 requested a full tablet report, sending...
W20260808 04:42:49.655313 2821 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260808 04:42:49.804306 2825 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:42:49.804697 2825 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:42:49.804759 2825 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:42:49.810761 2825 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:42:49.810876 2825 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:42:49.810964 2825 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.240.194
I20260808 04:42:49.819643 2825 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.240.212:43765
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164000593138-21443-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164000593138-21443-0/minicluster-data/ts-1/wal
--ranger_kms_url=invalid.host:1234/kms,127.20.240.212:36957/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.194.keytab
--principal=kudu/127.20.240.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.240.194:41479
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164000593138-21443-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.240.194
--webserver_port=40589
--tserver_master_addrs=127.20.240.254:39319
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2825
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.240.194
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164000593138-21443-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 04:05:18 UTC on ccycloud.quasar-drfdgt.root.comops.site
build id 4574101
I20260808 04:42:49.821398 2825 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:42:49.822962 2825 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:42:49.837634 2833 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:42:49.837793 2830 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:42:49.838052 2831 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:42:49.839748 2825 server_base.cc:1034] running on GCE node
I20260808 04:42:49.840406 2825 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:42:49.841418 2825 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:42:49.842634 2825 hybrid_clock.cc:648] HybridClock initialized: now 1786164169842598 us; error 62 us; skew 500 ppm
Aug 08 04:42:49 dist-test-slave-vxj2 krb5kdc[1511](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164169, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.240.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:42:49.846097 2825 init.cc:377] Logged in from keytab as kudu/127.20.240.194@KRBTEST.COM (short username kudu)
I20260808 04:42:49.847283 2825 webserver.cc:460] Webserver started at http://127.20.240.194:40589/ using document root <none> and password file <none>
I20260808 04:42:49.847980 2825 fs_manager.cc:359] Metadata directory not provided
I20260808 04:42:49.848107 2825 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 08 04:42:49 dist-test-slave-vxj2 krb5kdc[1511](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164169, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.240.194@KRBTEST.COM for HTTP/127.20.240.212@KRBTEST.COM
I20260808 04:42:49.869918 2825 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.002s sys 0.001s
I20260808 04:42:49.873067 2842 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:42:49.874662 2825 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.003s
I20260808 04:42:49.874794 2825 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164000593138-21443-0/minicluster-data/ts-1/data,/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164000593138-21443-0/minicluster-data/ts-1/wal
uuid: "1d751d805fca470bae48412c8043f947"
format_stamp: "Formatted at 2026-08-08 04:42:48 on dist-test-slave-vxj2"
server_key: "2746a44a32b6dd7e8a08e5e2bdf4f139"
server_key_iv: "e0276bea181e7e19ed23dbdc453ccfdb"
server_key_version: "kuduclusterkey@0"
I20260808 04:42:49.875524 2825 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164000593138-21443-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164000593138-21443-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164000593138-21443-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:42:49.889573 2825 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:42:49.893716 2825 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:42:49.893973 2825 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:42:49.894822 2825 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 04:42:49.896023 2825 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 04:42:49.896101 2825 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 04:42:49.896181 2825 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 04:42:49.896221 2825 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 04:42:49.910804 2825 rpc_server.cc:307] RPC server started. Bound to: 127.20.240.194:41479
I20260808 04:42:49.916738 2968 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.240.194:41479 every 8 connection(s)
I20260808 04:42:49.917909 2825 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164000593138-21443-0/minicluster-data/ts-1/data/info.pb
I20260808 04:42:49.926931 21443 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu as pid 2825
I20260808 04:42:49.927466 21443 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
/tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164000593138-21443-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164000593138-21443-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164000593138-21443-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164000593138-21443-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.20.240.212:36957/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.240.195:39757
--local_ip_for_outbound_sockets=127.20.240.195
--tserver_master_addrs=127.20.240.254:39319
--webserver_port=37077
--webserver_interface=127.20.240.195
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.195.keytab
--principal=kudu/127.20.240.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.240.212:43765
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.20.240.212:36957/kms with env {KRB5CCNAME=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164000593138-21443-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164000593138-21443-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164000593138-21443-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 08 04:42:49 dist-test-slave-vxj2 krb5kdc[1511](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164169, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.240.194@KRBTEST.COM for kudu/127.20.240.254@KRBTEST.COM
I20260808 04:42:49.949120 2823 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:42:49.923819 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.240.194:58141 (local address 127.20.240.254:39319)
0808 04:42:49.923982 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0808 04:42:49.923987 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 04:42:49.927643 (+ 3656us) server_negotiation.cc:407] Connection header received
0808 04:42:49.929401 (+ 1758us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:42:49.929407 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:42:49.929484 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:42:49.929547 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:42:49.932207 (+ 2660us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:42:49.933189 (+ 982us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:42:49.939409 (+ 6220us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:42:49.939881 (+ 472us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:42:49.940002 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:42:49.943810 (+ 3808us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:42:49.943815 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:42:49.943819 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:42:49.943863 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:42:49.945847 (+ 1984us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:42:49.946699 (+ 852us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:42:49.946704 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:42:49.946706 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:42:49.946828 (+ 122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:42:49.947339 (+ 511us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:42:49.947344 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:42:49.947346 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:42:49.947772 (+ 426us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:42:49.947878 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0808 04:42:49.948726 (+ 848us) server_negotiation.cc:299] Negotiation successful
0808 04:42:49.948916 (+ 190us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260808 04:42:49.951509 2971 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:42:49.924324 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:39319 (local address 127.20.240.194:58141)
0808 04:42:49.927424 (+ 3100us) negotiation.cc:107] Waiting for socket to connect
0808 04:42:49.927501 (+ 77us) client_negotiation.cc:174] Beginning negotiation
0808 04:42:49.929028 (+ 1527us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:42:49.930042 (+ 1014us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:42:49.930056 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:42:49.930475 (+ 419us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:42:49.931193 (+ 718us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:42:49.931215 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:42:49.937332 (+ 6117us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:42:49.937338 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:42:49.939150 (+ 1812us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:42:49.939172 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:42:49.940310 (+ 1138us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:42:49.940314 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:42:49.940554 (+ 240us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:42:49.941433 (+ 879us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:42:49.941457 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:42:49.943525 (+ 2068us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:42:49.946043 (+ 2518us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:42:49.946051 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:42:49.946074 (+ 23us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:42:49.946538 (+ 464us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:42:49.946970 (+ 432us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:42:49.946976 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:42:49.946981 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:42:49.947203 (+ 222us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:42:49.947963 (+ 760us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:42:49.947972 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:42:49.948382 (+ 410us) client_negotiation.cc:769] Sending connection context
0808 04:42:49.949706 (+ 1324us) client_negotiation.cc:240] Negotiation successful
0808 04:42:49.950278 (+ 572us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2810,"thread_start_us":185,"threads_started":1}
I20260808 04:42:49.953370 2969 heartbeater.cc:347] Connected to a master server at 127.20.240.254:39319
I20260808 04:42:49.953652 2969 heartbeater.cc:464] Registering TS with master...
I20260808 04:42:49.954337 2969 heartbeater.cc:511] Master 127.20.240.254:39319 requested a full tablet report, sending...
W20260808 04:42:49.956362 2969 heartbeater.cc:644] Failed to heartbeat to 127.20.240.254:39319 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260808 04:42:49.956501 2969 heartbeater.cc:464] Registering TS with master...
I20260808 04:42:49.956704 2969 heartbeater.cc:511] Master 127.20.240.254:39319 requested a full tablet report, sending...
I20260808 04:42:49.957850 2969 heartbeater.cc:464] Registering TS with master...
I20260808 04:42:49.958060 2969 heartbeater.cc:511] Master 127.20.240.254:39319 requested a full tablet report, sending...
W20260808 04:42:49.958976 2969 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260808 04:42:50.081503 2972 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:42:50.081789 2972 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:42:50.081871 2972 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:42:50.087749 2972 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:42:50.087860 2972 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:42:50.087956 2972 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.240.195
I20260808 04:42:50.095695 2972 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.240.212:43765
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164000593138-21443-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164000593138-21443-0/minicluster-data/ts-2/wal
--ranger_kms_url=invalid.host:1234/kms,127.20.240.212:36957/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.195.keytab
--principal=kudu/127.20.240.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.240.195:39757
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164000593138-21443-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.240.195
--webserver_port=37077
--tserver_master_addrs=127.20.240.254:39319
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2972
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.240.195
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164000593138-21443-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 04:05:18 UTC on ccycloud.quasar-drfdgt.root.comops.site
build id 4574101
I20260808 04:42:50.096968 2972 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:42:50.098088 2972 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:42:50.108968 2982 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:42:50.108968 2979 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:42:50.108995 2985 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:42:50.115010 2972 server_base.cc:1034] running on GCE node
I20260808 04:42:50.115634 2972 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:42:50.116536 2972 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:42:50.117942 2972 hybrid_clock.cc:648] HybridClock initialized: now 1786164170117911 us; error 56 us; skew 500 ppm
Aug 08 04:42:50 dist-test-slave-vxj2 krb5kdc[1511](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164170, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.240.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:42:50.123699 2972 init.cc:377] Logged in from keytab as kudu/127.20.240.195@KRBTEST.COM (short username kudu)
I20260808 04:42:50.125260 2972 webserver.cc:460] Webserver started at http://127.20.240.195:37077/ using document root <none> and password file <none>
I20260808 04:42:50.126266 2972 fs_manager.cc:359] Metadata directory not provided
I20260808 04:42:50.126401 2972 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 08 04:42:50 dist-test-slave-vxj2 krb5kdc[1511](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164170, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.240.195@KRBTEST.COM for HTTP/127.20.240.212@KRBTEST.COM
I20260808 04:42:50.153258 2972 fs_manager.cc:709] Time spent opening directory manager: real 0.009s user 0.001s sys 0.003s
I20260808 04:42:50.156803 2994 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:42:50.158643 2972 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.000s
I20260808 04:42:50.158787 2972 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164000593138-21443-0/minicluster-data/ts-2/data,/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164000593138-21443-0/minicluster-data/ts-2/wal
uuid: "e66665c7fa5c4cd7b74280b0bcbf06e2"
format_stamp: "Formatted at 2026-08-08 04:42:48 on dist-test-slave-vxj2"
server_key: "e0a0c1d73fad518bdc1068e66d2ff250"
server_key_iv: "ea511bb6510fb034389c3d30e603b676"
server_key_version: "kuduclusterkey@0"
I20260808 04:42:50.159567 2972 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164000593138-21443-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164000593138-21443-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164000593138-21443-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:42:50.190500 2972 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:42:50.194046 2972 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:42:50.194278 2972 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:42:50.194933 2972 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 04:42:50.195940 2972 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 04:42:50.196004 2972 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 04:42:50.196063 2972 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 04:42:50.196087 2972 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 04:42:50.209720 2972 rpc_server.cc:307] RPC server started. Bound to: 127.20.240.195:39757
I20260808 04:42:50.209767 3122 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.240.195:39757 every 8 connection(s)
I20260808 04:42:50.210996 2972 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164000593138-21443-0/minicluster-data/ts-2/data/info.pb
I20260808 04:42:50.213541 21443 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu as pid 2972
Aug 08 04:42:50 dist-test-slave-vxj2 krb5kdc[1511](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164170, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.240.195@KRBTEST.COM for kudu/127.20.240.254@KRBTEST.COM
I20260808 04:42:50.232216 2823 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:42:50.216303 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.240.195:40345 (local address 127.20.240.254:39319)
0808 04:42:50.217119 (+ 816us) server_negotiation.cc:206] Beginning negotiation
0808 04:42:50.217124 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 04:42:50.217141 (+ 17us) server_negotiation.cc:407] Connection header received
0808 04:42:50.217209 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:42:50.217212 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:42:50.217267 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:42:50.217382 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:42:50.218863 (+ 1481us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:42:50.219642 (+ 779us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:42:50.221464 (+ 1822us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:42:50.221844 (+ 380us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:42:50.221979 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:42:50.225439 (+ 3460us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:42:50.225443 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:42:50.225446 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:42:50.225484 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:42:50.227487 (+ 2003us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:42:50.229589 (+ 2102us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:42:50.229593 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:42:50.229595 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:42:50.229697 (+ 102us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:42:50.230168 (+ 471us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:42:50.230172 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:42:50.230174 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:42:50.230423 (+ 249us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:42:50.230515 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0808 04:42:50.231867 (+ 1352us) server_negotiation.cc:299] Negotiation successful
0808 04:42:50.232035 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":701}
I20260808 04:42:50.234189 3125 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:42:50.215041 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:39319 (local address 127.20.240.195:40345)
0808 04:42:50.215674 (+ 633us) negotiation.cc:107] Waiting for socket to connect
0808 04:42:50.215735 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0808 04:42:50.216869 (+ 1134us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:42:50.217590 (+ 721us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:42:50.217601 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:42:50.217977 (+ 376us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:42:50.218668 (+ 691us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:42:50.218687 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:42:50.219826 (+ 1139us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:42:50.219829 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:42:50.221348 (+ 1519us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:42:50.221361 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:42:50.222061 (+ 700us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:42:50.222066 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:42:50.222414 (+ 348us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:42:50.223388 (+ 974us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:42:50.223421 (+ 33us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:42:50.225145 (+ 1724us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:42:50.228930 (+ 3785us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:42:50.228939 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:42:50.228962 (+ 23us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:42:50.229452 (+ 490us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:42:50.229816 (+ 364us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:42:50.229819 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:42:50.229821 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:42:50.230045 (+ 224us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:42:50.230594 (+ 549us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:42:50.230601 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:42:50.231002 (+ 401us) client_negotiation.cc:769] Sending connection context
0808 04:42:50.232498 (+ 1496us) client_negotiation.cc:240] Negotiation successful
0808 04:42:50.232946 (+ 448us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":381,"thread_start_us":163,"threads_started":1}
I20260808 04:42:50.235677 3123 heartbeater.cc:347] Connected to a master server at 127.20.240.254:39319
I20260808 04:42:50.235986 3123 heartbeater.cc:464] Registering TS with master...
I20260808 04:42:50.236662 3123 heartbeater.cc:511] Master 127.20.240.254:39319 requested a full tablet report, sending...
W20260808 04:42:50.238533 3123 heartbeater.cc:644] Failed to heartbeat to 127.20.240.254:39319 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260808 04:42:50.238696 3123 heartbeater.cc:464] Registering TS with master...
I20260808 04:42:50.238896 3123 heartbeater.cc:511] Master 127.20.240.254:39319 requested a full tablet report, sending...
I20260808 04:42:50.239176 3128 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:42:50.220669 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41718 (local address 127.20.240.254:39319)
0808 04:42:50.221004 (+ 335us) server_negotiation.cc:206] Beginning negotiation
0808 04:42:50.221016 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 04:42:50.221336 (+ 320us) server_negotiation.cc:407] Connection header received
0808 04:42:50.222128 (+ 792us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:42:50.222133 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:42:50.222186 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:42:50.222290 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:42:50.225513 (+ 3223us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:42:50.227097 (+ 1584us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:42:50.228896 (+ 1799us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:42:50.229313 (+ 417us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:42:50.229446 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:42:50.233466 (+ 4020us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:42:50.233471 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:42:50.233474 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:42:50.233508 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:42:50.235619 (+ 2111us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:42:50.236304 (+ 685us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:42:50.236308 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:42:50.236310 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:42:50.236421 (+ 111us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:42:50.236841 (+ 420us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:42:50.236845 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:42:50.236847 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:42:50.237116 (+ 269us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:42:50.237382 (+ 266us) server_negotiation.cc:1035] Waiting for connection context
0808 04:42:50.238793 (+ 1411us) server_negotiation.cc:299] Negotiation successful
0808 04:42:50.238954 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":254,"thread_start_us":131,"threads_started":1}
I20260808 04:42:50.239931 3123 heartbeater.cc:464] Registering TS with master...
I20260808 04:42:50.240121 3123 heartbeater.cc:511] Master 127.20.240.254:39319 requested a full tablet report, sending...
W20260808 04:42:50.241297 3123 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
Aug 08 04:42:50 dist-test-slave-vxj2 krb5kdc[1511](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786164170, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.240.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:42:50.655589 2821 heartbeater.cc:464] Registering TS with master...
I20260808 04:42:50.655941 2821 heartbeater.cc:511] Master 127.20.240.254:39319 requested a full tablet report, sending...
I20260808 04:42:50.657270 2600 ts_manager.cc:194] Registered new tserver with Master: 6ee9fe18dabf4c9b8a17a7ac3859f444 (127.20.240.193:35549)
I20260808 04:42:50.658641 2600 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.240.193@KRBTEST.COM'} at 127.20.240.193:45677
I20260808 04:42:50.959203 2969 heartbeater.cc:464] Registering TS with master...
I20260808 04:42:50.959537 2969 heartbeater.cc:511] Master 127.20.240.254:39319 requested a full tablet report, sending...
I20260808 04:42:50.960379 2600 ts_manager.cc:194] Registered new tserver with Master: 1d751d805fca470bae48412c8043f947 (127.20.240.194:41479)
I20260808 04:42:50.960994 2600 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.240.194@KRBTEST.COM'} at 127.20.240.194:58141
Aug 08 04:42:51 dist-test-slave-vxj2 krb5kdc[1511](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164170, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.240.254@KRBTEST.COM for HTTP/127.20.240.212@KRBTEST.COM
I20260808 04:42:51.241573 3123 heartbeater.cc:464] Registering TS with master...
I20260808 04:42:51.241933 3123 heartbeater.cc:511] Master 127.20.240.254:39319 requested a full tablet report, sending...
I20260808 04:42:51.242690 2597 ts_manager.cc:194] Registered new tserver with Master: e66665c7fa5c4cd7b74280b0bcbf06e2 (127.20.240.195:39757)
I20260808 04:42:51.243521 2597 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.240.195@KRBTEST.COM'} at 127.20.240.195:40345
I20260808 04:42:51.255333 21443 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 04:42:51.268348 3148 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:42:51.257254 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41728 (local address 127.20.240.254:39319)
0808 04:42:51.257583 (+ 329us) server_negotiation.cc:206] Beginning negotiation
0808 04:42:51.257588 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 04:42:51.257644 (+ 56us) server_negotiation.cc:407] Connection header received
0808 04:42:51.257832 (+ 188us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:42:51.257836 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:42:51.257898 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:42:51.258002 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:42:51.258890 (+ 888us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:42:51.259748 (+ 858us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:42:51.261000 (+ 1252us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:42:51.261420 (+ 420us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:42:51.261577 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:42:51.263558 (+ 1981us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:42:51.263562 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:42:51.263565 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:42:51.263600 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:42:51.265636 (+ 2036us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:42:51.266329 (+ 693us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:42:51.266333 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:42:51.266334 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:42:51.266517 (+ 183us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:42:51.266862 (+ 345us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:42:51.266865 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:42:51.266867 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:42:51.267110 (+ 243us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:42:51.267248 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0808 04:42:51.268012 (+ 764us) server_negotiation.cc:299] Negotiation successful
0808 04:42:51.268156 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":240,"thread_start_us":84,"threads_started":1}
I20260808 04:42:51.273176 2597 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41728:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 04:42:51.278187 2597 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 04:42:51.300561 3155 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:42:51.291428 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.193:35549 (local address 127.0.0.1:46656)
0808 04:42:51.293919 (+ 2491us) negotiation.cc:107] Waiting for socket to connect
0808 04:42:51.293934 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 04:42:51.294021 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:42:51.295158 (+ 1137us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:42:51.295165 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:42:51.295187 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 04:42:51.295331 (+ 144us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:42:51.295338 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:42:51.296903 (+ 1565us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:42:51.296907 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:42:51.298819 (+ 1912us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:42:51.298827 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:42:51.299991 (+ 1164us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:42:51.299994 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:42:51.300106 (+ 112us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:42:51.300153 (+ 47us) client_negotiation.cc:769] Sending connection context
0808 04:42:51.300237 (+ 84us) client_negotiation.cc:240] Negotiation successful
0808 04:42:51.300352 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2429,"thread_start_us":123,"threads_started":1}
I20260808 04:42:51.302284 3158 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:42:51.292762 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46656 (local address 127.20.240.193:35549)
0808 04:42:51.294246 (+ 1484us) server_negotiation.cc:206] Beginning negotiation
0808 04:42:51.294253 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 04:42:51.294277 (+ 24us) server_negotiation.cc:407] Connection header received
0808 04:42:51.294354 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:42:51.294359 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:42:51.294597 (+ 238us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:42:51.294735 (+ 138us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 04:42:51.295477 (+ 742us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:42:51.296723 (+ 1246us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:42:51.298971 (+ 2248us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:42:51.299853 (+ 882us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:42:51.301787 (+ 1934us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:42:51.301957 (+ 170us) server_negotiation.cc:1035] Waiting for connection context
0808 04:42:51.302016 (+ 59us) server_negotiation.cc:299] Negotiation successful
0808 04:42:51.302132 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1384,"thread_start_us":83,"threads_started":1}
I20260808 04:42:51.302770 3154 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:42:51.291376 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.195:39757 (local address 127.0.0.1:51426)
0808 04:42:51.293290 (+ 1914us) negotiation.cc:107] Waiting for socket to connect
0808 04:42:51.293352 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0808 04:42:51.293493 (+ 141us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:42:51.297997 (+ 4504us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:42:51.298000 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:42:51.298020 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 04:42:51.298129 (+ 109us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:42:51.298136 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:42:51.299764 (+ 1628us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:42:51.299768 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:42:51.300932 (+ 1164us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:42:51.300945 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:42:51.302330 (+ 1385us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:42:51.302335 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:42:51.302449 (+ 114us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:42:51.302477 (+ 28us) client_negotiation.cc:769] Sending connection context
0808 04:42:51.302535 (+ 58us) client_negotiation.cc:240] Negotiation successful
0808 04:42:51.302606 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1674,"thread_start_us":129,"threads_started":1}
I20260808 04:42:51.303623 3157 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:42:51.292439 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51426 (local address 127.20.240.195:39757)
0808 04:42:51.297421 (+ 4982us) server_negotiation.cc:206] Beginning negotiation
0808 04:42:51.297430 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 04:42:51.297460 (+ 30us) server_negotiation.cc:407] Connection header received
0808 04:42:51.297548 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:42:51.297554 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:42:51.297818 (+ 264us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:42:51.298306 (+ 488us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 04:42:51.298463 (+ 157us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:42:51.299591 (+ 1128us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:42:51.301130 (+ 1539us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:42:51.302139 (+ 1009us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:42:51.303128 (+ 989us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:42:51.303289 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0808 04:42:51.303355 (+ 66us) server_negotiation.cc:299] Negotiation successful
0808 04:42:51.303467 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":4848,"thread_start_us":80,"threads_started":1}
I20260808 04:42:51.304888 3159 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:42:51.293362 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.194:41479 (local address 127.0.0.1:58096)
0808 04:42:51.298498 (+ 5136us) negotiation.cc:107] Waiting for socket to connect
0808 04:42:51.298513 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 04:42:51.298605 (+ 92us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:42:51.299295 (+ 690us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:42:51.299298 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:42:51.299314 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 04:42:51.299406 (+ 92us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:42:51.299411 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:42:51.300710 (+ 1299us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:42:51.300715 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:42:51.301781 (+ 1066us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:42:51.301791 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:42:51.304488 (+ 2697us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:42:51.304492 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:42:51.304596 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:42:51.304619 (+ 23us) client_negotiation.cc:769] Sending connection context
0808 04:42:51.304693 (+ 74us) client_negotiation.cc:240] Negotiation successful
0808 04:42:51.304760 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5071,"thread_start_us":98,"threads_started":1}
I20260808 04:42:51.305639 2730 tablet_service.cc:1467] Processing CreateTablet for tablet 91526cc803604f02b93028887e28f9aa (DEFAULT_TABLE table=test-table [id=b987b68c727d47e8bdeffb602f3b85fc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 04:42:51.306879 2730 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 91526cc803604f02b93028887e28f9aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:42:51.306488 3047 tablet_service.cc:1467] Processing CreateTablet for tablet 91526cc803604f02b93028887e28f9aa (DEFAULT_TABLE table=test-table [id=b987b68c727d47e8bdeffb602f3b85fc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 04:42:51.307523 3047 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 91526cc803604f02b93028887e28f9aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:42:51.307972 3160 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:42:51.293518 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58096 (local address 127.20.240.194:41479)
0808 04:42:51.293854 (+ 336us) server_negotiation.cc:206] Beginning negotiation
0808 04:42:51.293863 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 04:42:51.298707 (+ 4844us) server_negotiation.cc:407] Connection header received
0808 04:42:51.298793 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:42:51.298798 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:42:51.298992 (+ 194us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:42:51.299121 (+ 129us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 04:42:51.299532 (+ 411us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:42:51.300577 (+ 1045us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:42:51.303407 (+ 2830us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:42:51.304155 (+ 748us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:42:51.304293 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:42:51.304408 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0808 04:42:51.307704 (+ 3296us) server_negotiation.cc:299] Negotiation successful
0808 04:42:51.307832 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":222,"thread_start_us":114,"threads_started":1}
I20260808 04:42:51.310811 2891 tablet_service.cc:1467] Processing CreateTablet for tablet 91526cc803604f02b93028887e28f9aa (DEFAULT_TABLE table=test-table [id=b987b68c727d47e8bdeffb602f3b85fc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 04:42:51.311872 2891 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 91526cc803604f02b93028887e28f9aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:42:51.317829 3161 tablet_bootstrap.cc:492] T 91526cc803604f02b93028887e28f9aa P e66665c7fa5c4cd7b74280b0bcbf06e2: Bootstrap starting.
I20260808 04:42:51.319221 3163 tablet_bootstrap.cc:492] T 91526cc803604f02b93028887e28f9aa P 1d751d805fca470bae48412c8043f947: Bootstrap starting.
I20260808 04:42:51.320343 3161 tablet_bootstrap.cc:654] T 91526cc803604f02b93028887e28f9aa P e66665c7fa5c4cd7b74280b0bcbf06e2: Neither blocks nor log segments found. Creating new log.
I20260808 04:42:51.321259 3161 log.cc:824] T 91526cc803604f02b93028887e28f9aa P e66665c7fa5c4cd7b74280b0bcbf06e2: Log is configured to *not* fsync() on all Append() calls
I20260808 04:42:51.322023 3162 tablet_bootstrap.cc:492] T 91526cc803604f02b93028887e28f9aa P 6ee9fe18dabf4c9b8a17a7ac3859f444: Bootstrap starting.
I20260808 04:42:51.323210 3163 tablet_bootstrap.cc:654] T 91526cc803604f02b93028887e28f9aa P 1d751d805fca470bae48412c8043f947: Neither blocks nor log segments found. Creating new log.
I20260808 04:42:51.324434 3162 tablet_bootstrap.cc:654] T 91526cc803604f02b93028887e28f9aa P 6ee9fe18dabf4c9b8a17a7ac3859f444: Neither blocks nor log segments found. Creating new log.
I20260808 04:42:51.325832 3162 log.cc:824] T 91526cc803604f02b93028887e28f9aa P 6ee9fe18dabf4c9b8a17a7ac3859f444: Log is configured to *not* fsync() on all Append() calls
I20260808 04:42:51.328141 3163 log.cc:824] T 91526cc803604f02b93028887e28f9aa P 1d751d805fca470bae48412c8043f947: Log is configured to *not* fsync() on all Append() calls
I20260808 04:42:51.331048 3162 tablet_bootstrap.cc:492] T 91526cc803604f02b93028887e28f9aa P 6ee9fe18dabf4c9b8a17a7ac3859f444: No bootstrap required, opened a new log
I20260808 04:42:51.331171 3161 tablet_bootstrap.cc:492] T 91526cc803604f02b93028887e28f9aa P e66665c7fa5c4cd7b74280b0bcbf06e2: No bootstrap required, opened a new log
I20260808 04:42:51.331424 3162 ts_tablet_manager.cc:1397] T 91526cc803604f02b93028887e28f9aa P 6ee9fe18dabf4c9b8a17a7ac3859f444: Time spent bootstrapping tablet: real 0.010s user 0.007s sys 0.000s
I20260808 04:42:51.331425 3161 ts_tablet_manager.cc:1397] T 91526cc803604f02b93028887e28f9aa P e66665c7fa5c4cd7b74280b0bcbf06e2: Time spent bootstrapping tablet: real 0.014s user 0.004s sys 0.000s
I20260808 04:42:51.335800 3162 raft_consensus.cc:348] T 91526cc803604f02b93028887e28f9aa P 6ee9fe18dabf4c9b8a17a7ac3859f444 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e66665c7fa5c4cd7b74280b0bcbf06e2" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 39757 } } peers { permanent_uuid: "6ee9fe18dabf4c9b8a17a7ac3859f444" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 35549 } } peers { permanent_uuid: "1d751d805fca470bae48412c8043f947" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 41479 } }
I20260808 04:42:51.336318 3162 raft_consensus.cc:374] T 91526cc803604f02b93028887e28f9aa P 6ee9fe18dabf4c9b8a17a7ac3859f444 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:42:51.336429 3162 raft_consensus.cc:729] T 91526cc803604f02b93028887e28f9aa P 6ee9fe18dabf4c9b8a17a7ac3859f444 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ee9fe18dabf4c9b8a17a7ac3859f444, State: Initialized, Role: FOLLOWER
I20260808 04:42:51.337083 3162 consensus_queue.cc:260] T 91526cc803604f02b93028887e28f9aa P 6ee9fe18dabf4c9b8a17a7ac3859f444 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e66665c7fa5c4cd7b74280b0bcbf06e2" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 39757 } } peers { permanent_uuid: "6ee9fe18dabf4c9b8a17a7ac3859f444" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 35549 } } peers { permanent_uuid: "1d751d805fca470bae48412c8043f947" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 41479 } }
I20260808 04:42:51.337872 3161 raft_consensus.cc:348] T 91526cc803604f02b93028887e28f9aa P e66665c7fa5c4cd7b74280b0bcbf06e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e66665c7fa5c4cd7b74280b0bcbf06e2" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 39757 } } peers { permanent_uuid: "6ee9fe18dabf4c9b8a17a7ac3859f444" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 35549 } } peers { permanent_uuid: "1d751d805fca470bae48412c8043f947" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 41479 } }
I20260808 04:42:51.338176 3161 raft_consensus.cc:374] T 91526cc803604f02b93028887e28f9aa P e66665c7fa5c4cd7b74280b0bcbf06e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:42:51.338239 3161 raft_consensus.cc:729] T 91526cc803604f02b93028887e28f9aa P e66665c7fa5c4cd7b74280b0bcbf06e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e66665c7fa5c4cd7b74280b0bcbf06e2, State: Initialized, Role: FOLLOWER
I20260808 04:42:51.338675 3162 ts_tablet_manager.cc:1428] T 91526cc803604f02b93028887e28f9aa P 6ee9fe18dabf4c9b8a17a7ac3859f444: Time spent starting tablet: real 0.007s user 0.006s sys 0.000s
I20260808 04:42:51.338773 3161 consensus_queue.cc:260] T 91526cc803604f02b93028887e28f9aa P e66665c7fa5c4cd7b74280b0bcbf06e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e66665c7fa5c4cd7b74280b0bcbf06e2" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 39757 } } peers { permanent_uuid: "6ee9fe18dabf4c9b8a17a7ac3859f444" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 35549 } } peers { permanent_uuid: "1d751d805fca470bae48412c8043f947" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 41479 } }
I20260808 04:42:51.339201 2821 heartbeater.cc:503] Master 127.20.240.254:39319 was elected leader, sending a full tablet report...
I20260808 04:42:51.339881 3161 ts_tablet_manager.cc:1428] T 91526cc803604f02b93028887e28f9aa P e66665c7fa5c4cd7b74280b0bcbf06e2: Time spent starting tablet: real 0.008s user 0.002s sys 0.006s
I20260808 04:42:51.340853 3123 heartbeater.cc:503] Master 127.20.240.254:39319 was elected leader, sending a full tablet report...
I20260808 04:42:51.344306 3163 tablet_bootstrap.cc:492] T 91526cc803604f02b93028887e28f9aa P 1d751d805fca470bae48412c8043f947: No bootstrap required, opened a new log
I20260808 04:42:51.344564 3163 ts_tablet_manager.cc:1397] T 91526cc803604f02b93028887e28f9aa P 1d751d805fca470bae48412c8043f947: Time spent bootstrapping tablet: real 0.025s user 0.000s sys 0.005s
I20260808 04:42:51.349582 3163 raft_consensus.cc:348] T 91526cc803604f02b93028887e28f9aa P 1d751d805fca470bae48412c8043f947 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e66665c7fa5c4cd7b74280b0bcbf06e2" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 39757 } } peers { permanent_uuid: "6ee9fe18dabf4c9b8a17a7ac3859f444" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 35549 } } peers { permanent_uuid: "1d751d805fca470bae48412c8043f947" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 41479 } }
I20260808 04:42:51.349970 3163 raft_consensus.cc:374] T 91526cc803604f02b93028887e28f9aa P 1d751d805fca470bae48412c8043f947 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:42:51.350042 3163 raft_consensus.cc:729] T 91526cc803604f02b93028887e28f9aa P 1d751d805fca470bae48412c8043f947 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d751d805fca470bae48412c8043f947, State: Initialized, Role: FOLLOWER
I20260808 04:42:51.350682 3163 consensus_queue.cc:260] T 91526cc803604f02b93028887e28f9aa P 1d751d805fca470bae48412c8043f947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e66665c7fa5c4cd7b74280b0bcbf06e2" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 39757 } } peers { permanent_uuid: "6ee9fe18dabf4c9b8a17a7ac3859f444" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 35549 } } peers { permanent_uuid: "1d751d805fca470bae48412c8043f947" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 41479 } }
I20260808 04:42:51.351926 3163 ts_tablet_manager.cc:1428] T 91526cc803604f02b93028887e28f9aa P 1d751d805fca470bae48412c8043f947: Time spent starting tablet: real 0.007s user 0.008s sys 0.000s
I20260808 04:42:51.352311 2969 heartbeater.cc:503] Master 127.20.240.254:39319 was elected leader, sending a full tablet report...
W20260808 04:42:51.374224 2822 tablet.cc:2369] T 91526cc803604f02b93028887e28f9aa P 6ee9fe18dabf4c9b8a17a7ac3859f444: Can't schedule compaction. Clean time has not been advanced past its initial value.
Aug 08 04:42:51 dist-test-slave-vxj2 krb5kdc[1511](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164170, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.240.254@KRBTEST.COM for HTTP/127.20.240.212@KRBTEST.COM
I20260808 04:42:51.407095 3171 raft_consensus.cc:482] T 91526cc803604f02b93028887e28f9aa P 1d751d805fca470bae48412c8043f947 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 04:42:51.407374 3171 raft_consensus.cc:504] T 91526cc803604f02b93028887e28f9aa P 1d751d805fca470bae48412c8043f947 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e66665c7fa5c4cd7b74280b0bcbf06e2" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 39757 } } peers { permanent_uuid: "6ee9fe18dabf4c9b8a17a7ac3859f444" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 35549 } } peers { permanent_uuid: "1d751d805fca470bae48412c8043f947" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 41479 } }
I20260808 04:42:51.408677 3171 leader_election.cc:288] T 91526cc803604f02b93028887e28f9aa P 1d751d805fca470bae48412c8043f947 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e66665c7fa5c4cd7b74280b0bcbf06e2 (127.20.240.195:39757), 6ee9fe18dabf4c9b8a17a7ac3859f444 (127.20.240.193:35549)
I20260808 04:42:51.414137 3157 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:42:51.409463 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.240.194:33851 (local address 127.20.240.195:39757)
0808 04:42:51.409582 (+ 119us) server_negotiation.cc:206] Beginning negotiation
0808 04:42:51.409586 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:42:51.409601 (+ 15us) server_negotiation.cc:407] Connection header received
0808 04:42:51.409658 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:42:51.409663 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:42:51.409708 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:42:51.409803 (+ 95us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 04:42:51.410167 (+ 364us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:42:51.410948 (+ 781us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:42:51.412674 (+ 1726us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:42:51.413369 (+ 695us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:42:51.413478 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:42:51.413534 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0808 04:42:51.413903 (+ 369us) server_negotiation.cc:299] Negotiation successful
0808 04:42:51.413991 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260808 04:42:51.414597 3173 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:42:51.408848 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.195:39757 (local address 127.20.240.194:33851)
0808 04:42:51.409215 (+ 367us) negotiation.cc:107] Waiting for socket to connect
0808 04:42:51.409231 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 04:42:51.409344 (+ 113us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:42:51.409821 (+ 477us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:42:51.409824 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:42:51.409844 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 04:42:51.410004 (+ 160us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:42:51.410011 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:42:51.411097 (+ 1086us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:42:51.411101 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:42:51.412504 (+ 1403us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:42:51.412519 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:42:51.413640 (+ 1121us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:42:51.413643 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:42:51.413752 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:42:51.413778 (+ 26us) client_negotiation.cc:769] Sending connection context
0808 04:42:51.414328 (+ 550us) client_negotiation.cc:240] Negotiation successful
0808 04:42:51.414428 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":249,"thread_start_us":146,"threads_started":1}
I20260808 04:42:51.415416 3071 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "91526cc803604f02b93028887e28f9aa" candidate_uuid: "1d751d805fca470bae48412c8043f947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e66665c7fa5c4cd7b74280b0bcbf06e2" is_pre_election: true
I20260808 04:42:51.415833 3071 raft_consensus.cc:2454] T 91526cc803604f02b93028887e28f9aa P e66665c7fa5c4cd7b74280b0bcbf06e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d751d805fca470bae48412c8043f947 in term 0.
I20260808 04:42:51.416422 2845 leader_election.cc:302] T 91526cc803604f02b93028887e28f9aa P 1d751d805fca470bae48412c8043f947 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d751d805fca470bae48412c8043f947, e66665c7fa5c4cd7b74280b0bcbf06e2; no voters:
I20260808 04:42:51.416762 3171 raft_consensus.cc:2781] T 91526cc803604f02b93028887e28f9aa P 1d751d805fca470bae48412c8043f947 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 04:42:51.416872 3171 raft_consensus.cc:482] T 91526cc803604f02b93028887e28f9aa P 1d751d805fca470bae48412c8043f947 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 04:42:51.416919 3171 raft_consensus.cc:3037] T 91526cc803604f02b93028887e28f9aa P 1d751d805fca470bae48412c8043f947 [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:42:51.418406 3171 raft_consensus.cc:504] T 91526cc803604f02b93028887e28f9aa P 1d751d805fca470bae48412c8043f947 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e66665c7fa5c4cd7b74280b0bcbf06e2" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 39757 } } peers { permanent_uuid: "6ee9fe18dabf4c9b8a17a7ac3859f444" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 35549 } } peers { permanent_uuid: "1d751d805fca470bae48412c8043f947" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 41479 } }
I20260808 04:42:51.418614 3158 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:42:51.409447 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.240.194:38027 (local address 127.20.240.193:35549)
0808 04:42:51.409576 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0808 04:42:51.409582 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 04:42:51.413642 (+ 4060us) server_negotiation.cc:407] Connection header received
0808 04:42:51.413865 (+ 223us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:42:51.413868 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:42:51.413927 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:42:51.413981 (+ 54us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 04:42:51.415435 (+ 1454us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:42:51.416239 (+ 804us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:42:51.417579 (+ 1340us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:42:51.418010 (+ 431us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:42:51.418156 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:42:51.418215 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0808 04:42:51.418410 (+ 195us) server_negotiation.cc:299] Negotiation successful
0808 04:42:51.418501 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260808 04:42:51.418632 3174 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:42:51.408957 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.193:35549 (local address 127.20.240.194:38027)
0808 04:42:51.413074 (+ 4117us) negotiation.cc:107] Waiting for socket to connect
0808 04:42:51.413094 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0808 04:42:51.413740 (+ 646us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:42:51.414634 (+ 894us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:42:51.414637 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:42:51.414659 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 04:42:51.415304 (+ 645us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:42:51.415312 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:42:51.416347 (+ 1035us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:42:51.416350 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:42:51.417443 (+ 1093us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:42:51.417454 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:42:51.418148 (+ 694us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:42:51.418152 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:42:51.418254 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:42:51.418287 (+ 33us) client_negotiation.cc:769] Sending connection context
0808 04:42:51.418376 (+ 89us) client_negotiation.cc:240] Negotiation successful
0808 04:42:51.418471 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4025,"thread_start_us":107,"threads_started":1}
I20260808 04:42:51.418830 3171 leader_election.cc:288] T 91526cc803604f02b93028887e28f9aa P 1d751d805fca470bae48412c8043f947 [CANDIDATE]: Term 1 election: Requested vote from peers e66665c7fa5c4cd7b74280b0bcbf06e2 (127.20.240.195:39757), 6ee9fe18dabf4c9b8a17a7ac3859f444 (127.20.240.193:35549)
I20260808 04:42:51.419303 2760 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "91526cc803604f02b93028887e28f9aa" candidate_uuid: "1d751d805fca470bae48412c8043f947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ee9fe18dabf4c9b8a17a7ac3859f444" is_pre_election: true
I20260808 04:42:51.419621 3071 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "91526cc803604f02b93028887e28f9aa" candidate_uuid: "1d751d805fca470bae48412c8043f947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e66665c7fa5c4cd7b74280b0bcbf06e2"
I20260808 04:42:51.419669 2760 raft_consensus.cc:2454] T 91526cc803604f02b93028887e28f9aa P 6ee9fe18dabf4c9b8a17a7ac3859f444 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d751d805fca470bae48412c8043f947 in term 0.
I20260808 04:42:51.419775 3071 raft_consensus.cc:3037] T 91526cc803604f02b93028887e28f9aa P e66665c7fa5c4cd7b74280b0bcbf06e2 [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:42:51.419317 2755 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "91526cc803604f02b93028887e28f9aa" candidate_uuid: "1d751d805fca470bae48412c8043f947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ee9fe18dabf4c9b8a17a7ac3859f444"
I20260808 04:42:51.421277 3071 raft_consensus.cc:2454] T 91526cc803604f02b93028887e28f9aa P e66665c7fa5c4cd7b74280b0bcbf06e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d751d805fca470bae48412c8043f947 in term 1.
I20260808 04:42:51.421425 2755 raft_consensus.cc:3037] T 91526cc803604f02b93028887e28f9aa P 6ee9fe18dabf4c9b8a17a7ac3859f444 [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:42:51.421649 2845 leader_election.cc:302] T 91526cc803604f02b93028887e28f9aa P 1d751d805fca470bae48412c8043f947 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d751d805fca470bae48412c8043f947, e66665c7fa5c4cd7b74280b0bcbf06e2; no voters:
I20260808 04:42:51.421947 3171 raft_consensus.cc:2781] T 91526cc803604f02b93028887e28f9aa P 1d751d805fca470bae48412c8043f947 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 04:42:51.422224 3171 raft_consensus.cc:686] T 91526cc803604f02b93028887e28f9aa P 1d751d805fca470bae48412c8043f947 [term 1 LEADER]: Becoming Leader. State: Replica: 1d751d805fca470bae48412c8043f947, State: Running, Role: LEADER
I20260808 04:42:51.422627 3171 consensus_queue.cc:237] T 91526cc803604f02b93028887e28f9aa P 1d751d805fca470bae48412c8043f947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e66665c7fa5c4cd7b74280b0bcbf06e2" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 39757 } } peers { permanent_uuid: "6ee9fe18dabf4c9b8a17a7ac3859f444" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 35549 } } peers { permanent_uuid: "1d751d805fca470bae48412c8043f947" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 41479 } }
I20260808 04:42:51.422825 2755 raft_consensus.cc:2454] T 91526cc803604f02b93028887e28f9aa P 6ee9fe18dabf4c9b8a17a7ac3859f444 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d751d805fca470bae48412c8043f947 in term 1.
W20260808 04:42:51.423497 2970 tablet.cc:2369] T 91526cc803604f02b93028887e28f9aa P 1d751d805fca470bae48412c8043f947: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 04:42:51.426785 2597 catalog_manager.cc:5495] T 91526cc803604f02b93028887e28f9aa P 1d751d805fca470bae48412c8043f947 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1d751d805fca470bae48412c8043f947 (127.20.240.194). New cstate: current_term: 1 leader_uuid: "1d751d805fca470bae48412c8043f947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e66665c7fa5c4cd7b74280b0bcbf06e2" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 39757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ee9fe18dabf4c9b8a17a7ac3859f444" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 35549 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1d751d805fca470bae48412c8043f947" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 41479 } health_report { overall_health: HEALTHY } } }
I20260808 04:42:51.461508 3160 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:42:51.455495 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58110 (local address 127.20.240.194:41479)
0808 04:42:51.455671 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0808 04:42:51.455676 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 04:42:51.456032 (+ 356us) server_negotiation.cc:407] Connection header received
0808 04:42:51.456239 (+ 207us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:42:51.456251 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:42:51.456334 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:42:51.456441 (+ 107us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 04:42:51.456854 (+ 413us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:42:51.457714 (+ 860us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:42:51.459037 (+ 1323us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:42:51.459390 (+ 353us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:42:51.459495 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:42:51.459957 (+ 462us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 04:42:51.460564 (+ 607us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 04:42:51.460687 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0808 04:42:51.461255 (+ 568us) server_negotiation.cc:299] Negotiation successful
0808 04:42:51.461326 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
W20260808 04:42:51.465137 3124 tablet.cc:2369] T 91526cc803604f02b93028887e28f9aa P e66665c7fa5c4cd7b74280b0bcbf06e2: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 04:42:51.474870 3071 raft_consensus.cc:1261] T 91526cc803604f02b93028887e28f9aa P e66665c7fa5c4cd7b74280b0bcbf06e2 [term 1 FOLLOWER]: Refusing update from remote peer 1d751d805fca470bae48412c8043f947: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 04:42:51.475703 3171 consensus_queue.cc:1035] T 91526cc803604f02b93028887e28f9aa P 1d751d805fca470bae48412c8043f947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e66665c7fa5c4cd7b74280b0bcbf06e2" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 39757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 04:42:51.477065 2755 raft_consensus.cc:1261] T 91526cc803604f02b93028887e28f9aa P 6ee9fe18dabf4c9b8a17a7ac3859f444 [term 1 FOLLOWER]: Refusing update from remote peer 1d751d805fca470bae48412c8043f947: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 04:42:51.479478 3171 consensus_queue.cc:1035] T 91526cc803604f02b93028887e28f9aa P 1d751d805fca470bae48412c8043f947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ee9fe18dabf4c9b8a17a7ac3859f444" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 35549 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 04:42:51.492417 3179 mvcc.cc:205] Tried to move back new op lower bound from 7316128446350163968 to 7316128446151262208. Current Snapshot: MvccSnapshot[applied={T|T < 7316128446350163968}]
I20260808 04:42:51.492623 3184 mvcc.cc:205] Tried to move back new op lower bound from 7316128446350163968 to 7316128446151262208. Current Snapshot: MvccSnapshot[applied={T|T < 7316128446350163968}]
I20260808 04:42:51.503685 3181 mvcc.cc:205] Tried to move back new op lower bound from 7316128446350163968 to 7316128446151262208. Current Snapshot: MvccSnapshot[applied={T|T < 7316128446350163968}]
I20260808 04:42:51.515332 2597 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41728:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 04:42:51.515581 2597 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41728:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 04:42:51.518891 2597 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 04eb95e4ee644cf09b965e748e45002f: Sending DeleteTablet for 3 replicas of tablet 91526cc803604f02b93028887e28f9aa
I20260808 04:42:51.520462 3047 tablet_service.cc:1514] Processing DeleteTablet for tablet 91526cc803604f02b93028887e28f9aa with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 04:42:51 UTC) from {username='kudu', principal='kudu/127.20.240.254@KRBTEST.COM'} at 127.0.0.1:51426
I20260808 04:42:51.521128 2730 tablet_service.cc:1514] Processing DeleteTablet for tablet 91526cc803604f02b93028887e28f9aa with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 04:42:51 UTC) from {username='kudu', principal='kudu/127.20.240.254@KRBTEST.COM'} at 127.0.0.1:46656
I20260808 04:42:51.522210 2891 tablet_service.cc:1514] Processing DeleteTablet for tablet 91526cc803604f02b93028887e28f9aa with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 04:42:51 UTC) from {username='kudu', principal='kudu/127.20.240.254@KRBTEST.COM'} at 127.0.0.1:58096
I20260808 04:42:51.523612 21443 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu with pid 2645
W20260808 04:42:51.537426 2583 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.20.240.193:35549 (error 108)
I20260808 04:42:51.538530 21443 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu with pid 2825
I20260808 04:42:51.547288 3159 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:42:51.546849 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.193:35549 (local address 127.0.0.1:46662)
0808 04:42:51.547082 (+ 233us) negotiation.cc:107] Waiting for socket to connect
0808 04:42:51.547174 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.240.193:35549: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":143}
W20260808 04:42:51.547576 2583 catalog_manager.cc:4584] TS 6ee9fe18dabf4c9b8a17a7ac3859f444 (127.20.240.193:35549): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 91526cc803604f02b93028887e28f9aa: Network error: Client connection negotiation failed: client connection to 127.20.240.193:35549: connect: Connection refused (error 111)
I20260808 04:42:51.548048 3190 tablet_replica.cc:330] T 91526cc803604f02b93028887e28f9aa P e66665c7fa5c4cd7b74280b0bcbf06e2: stopping tablet replica
I20260808 04:42:51.548527 3190 raft_consensus.cc:2229] T 91526cc803604f02b93028887e28f9aa P e66665c7fa5c4cd7b74280b0bcbf06e2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 04:42:51.548969 3190 raft_consensus.cc:2258] T 91526cc803604f02b93028887e28f9aa P e66665c7fa5c4cd7b74280b0bcbf06e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 04:42:51.551412 3190 ts_tablet_manager.cc:1905] T 91526cc803604f02b93028887e28f9aa P e66665c7fa5c4cd7b74280b0bcbf06e2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 04:42:51.555138 3190 ts_tablet_manager.cc:1918] T 91526cc803604f02b93028887e28f9aa P e66665c7fa5c4cd7b74280b0bcbf06e2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 04:42:51.555280 3190 log.cc:1196] T 91526cc803604f02b93028887e28f9aa P e66665c7fa5c4cd7b74280b0bcbf06e2: Deleting WAL directory at /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164000593138-21443-0/minicluster-data/ts-2/wal/wals/91526cc803604f02b93028887e28f9aa
I20260808 04:42:51.555649 3190 ts_tablet_manager.cc:1939] T 91526cc803604f02b93028887e28f9aa P e66665c7fa5c4cd7b74280b0bcbf06e2: Deleting consensus metadata
I20260808 04:42:51.557682 2584 catalog_manager.cc:4841] TS e66665c7fa5c4cd7b74280b0bcbf06e2 (127.20.240.195:39757): tablet 91526cc803604f02b93028887e28f9aa (table test-table [id=b987b68c727d47e8bdeffb602f3b85fc]) successfully deleted
W20260808 04:42:51.558807 3159 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 04:42:51.558185 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.194:41479 (local address 127.0.0.1:58118)
0808 04:42:51.558368 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0808 04:42:51.558383 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 04:42:51.558488 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:42:51.558685 (+ 197us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.240.194:41479: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":105}
I20260808 04:42:51.559489 21443 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu with pid 2972
I20260808 04:42:51.570669 21443 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu with pid 2564
I20260808 04:42:51.579320 21443 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260808 04:42:51.925330 21443 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260808 04:42:51.925510 21443 mini_ranger.cc:66] Stopping Ranger...
I20260808 04:42:52.271879 21443 mini_ranger.cc:68] Stopped Ranger
2026-08-08 04:42:52.272 UTC [1543] LOG: received smart shutdown request
2026-08-08 04:42:52.277 UTC [1543] LOG: background worker "logical replication launcher" (PID 1552) exited with exit code 1
2026-08-08 04:42:52.277 UTC [1547] LOG: shutting down
2026-08-08 04:42:52.474 UTC [1543] LOG: database system is shut down
2026-08-08T04:42:52Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers (51726 ms)
[ RUN ] SecurityITest.IPKICACert
Loading random data
Initializing database '/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786164000593138-21443-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 04:42:52 dist-test-slave-vxj2 krb5kdc[3202](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 04:42:52 dist-test-slave-vxj2 krb5kdc[3202](info): set up 2 sockets
Aug 08 04:42:52 dist-test-slave-vxj2 krb5kdc[3202](info): commencing operation
krb5kdc: starting...
W20260808 04:42:53.705240 21443 mini_kdc.cc:121] Time spent starting KDC: real 1.089s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786164000593138-21443-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786164000593138-21443-0/krb5kdc/test-user.keytab.
Aug 08 04:42:53 dist-test-slave-vxj2 krb5kdc[3202](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164173, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T04:42:53Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T04:42:53Z Disabled control of system clock
WARNING: no policy specified for kudu/127.20.240.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.240.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.240.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.254.keytab.
Entry for principal kudu/127.20.240.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.254.keytab.
I20260808 04:42:53.844693 21443 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
/tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786164000593138-21443-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786164000593138-21443-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786164000593138-21443-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786164000593138-21443-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.240.254:38093
--webserver_interface=127.20.240.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.254.keytab
--principal=kudu/127.20.240.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.240.212:44079
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.240.254:38093,127.20.240.253:41897,127.20.240.252:46795
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786164000593138-21443-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786164000593138-21443-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786164000593138-21443-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 04:42:53.971674 3216 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:42:53.972021 3216 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:42:53.972153 3216 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:42:53.976641 3216 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 04:42:53.976775 3216 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:42:53.976811 3216 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:42:53.976850 3216 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 04:42:53.976887 3216 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 04:42:53.982847 3216 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.240.212:44079
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786164000593138-21443-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786164000593138-21443-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.240.254:38093,127.20.240.253:41897,127.20.240.252:46795
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.254.keytab
--principal=kudu/127.20.240.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.240.254:38093
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786164000593138-21443-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.240.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3216
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786164000593138-21443-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 04:05:18 UTC on ccycloud.quasar-drfdgt.root.comops.site
build id 4574101
I20260808 04:42:53.984127 3216 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:42:53.985262 3216 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:42:53.994148 3226 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:42:53.994208 3222 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:42:53.994156 3223 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:42:53.994269 3216 server_base.cc:1034] running on GCE node
I20260808 04:42:53.995028 3216 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:42:53.996203 3216 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:42:53.997416 3216 hybrid_clock.cc:648] HybridClock initialized: now 1786164173997389 us; error 32 us; skew 500 ppm
Aug 08 04:42:53 dist-test-slave-vxj2 krb5kdc[3202](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164173, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.240.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:42:54.000470 3216 init.cc:377] Logged in from keytab as kudu/127.20.240.254@KRBTEST.COM (short username kudu)
I20260808 04:42:54.001582 3216 webserver.cc:460] Webserver started at http://127.20.240.254:40911/ using document root <none> and password file <none>
I20260808 04:42:54.002173 3216 fs_manager.cc:359] Metadata directory not provided
I20260808 04:42:54.002269 3216 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:42:54.002518 3216 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 04:42:54.004685 3216 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786164000593138-21443-0/minicluster-data/master-0/data/instance:
uuid: "33cbd6d790e8405ba6a46f516ee92c25"
format_stamp: "Formatted at 2026-08-08 04:42:53 on dist-test-slave-vxj2"
server_key: "694d159353da6b8e7c45afb02653570c"
server_key_iv: "cb16672ac841dbc431f9894b56808377"
server_key_version: "encryptionkey@0"
I20260808 04:42:54.005362 3216 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786164000593138-21443-0/minicluster-data/master-0/wal/instance:
uuid: "33cbd6d790e8405ba6a46f516ee92c25"
format_stamp: "Formatted at 2026-08-08 04:42:53 on dist-test-slave-vxj2"
server_key: "694d159353da6b8e7c45afb02653570c"
server_key_iv: "cb16672ac841dbc431f9894b56808377"
server_key_version: "encryptionkey@0"
I20260808 04:42:54.009479 3216 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260808 04:42:54.012344 3234 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:42:54.013971 3216 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 04:42:54.014150 3216 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786164000593138-21443-0/minicluster-data/master-0/data,/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786164000593138-21443-0/minicluster-data/master-0/wal
uuid: "33cbd6d790e8405ba6a46f516ee92c25"
format_stamp: "Formatted at 2026-08-08 04:42:53 on dist-test-slave-vxj2"
server_key: "694d159353da6b8e7c45afb02653570c"
server_key_iv: "cb16672ac841dbc431f9894b56808377"
server_key_version: "encryptionkey@0"
I20260808 04:42:54.014297 3216 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786164000593138-21443-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786164000593138-21443-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786164000593138-21443-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:42:54.032859 3216 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:42:54.036640 3216 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:42:54.036882 3216 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:42:54.044620 3216 rpc_server.cc:307] RPC server started. Bound to: 127.20.240.254:38093
I20260808 04:42:54.045010 3290 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.240.254:38093 every 8 connection(s)
I20260808 04:42:54.045732 3216 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786164000593138-21443-0/minicluster-data/master-0/data/info.pb
I20260808 04:42:54.048677 3291 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:42:54.052666 3291 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.240.254" port: 38093 } has no permanent_uuid. Determining permanent_uuid...
I20260808 04:42:54.053181 21443 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu as pid 3216
I20260808 04:42:54.053349 21443 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786164000593138-21443-0/minicluster-data/master-0/wal/instance
I20260808 04:42:54.053624 21443 external_mini_cluster.cc:1428] Setting key 43673fb979f041a4566f859a0c797d26
WARNING: no policy specified for kudu/127.20.240.253@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.240.253@KRBTEST.COM" created.
Aug 08 04:42:54 dist-test-slave-vxj2 krb5kdc[3202](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164173, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.240.254@KRBTEST.COM for kudu/127.20.240.254@KRBTEST.COM
I20260808 04:42:54.072566 3295 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:42:54.055275 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:38093 (local address 127.0.0.1:52752)
0808 04:42:54.055853 (+ 578us) negotiation.cc:107] Waiting for socket to connect
0808 04:42:54.055944 (+ 91us) client_negotiation.cc:174] Beginning negotiation
0808 04:42:54.057316 (+ 1372us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:42:54.058271 (+ 955us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:42:54.058280 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:42:54.058837 (+ 557us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:42:54.059265 (+ 428us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:42:54.059292 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:42:54.061249 (+ 1957us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:42:54.061252 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:42:54.062021 (+ 769us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:42:54.062030 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:42:54.063008 (+ 978us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:42:54.063012 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:42:54.063096 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:42:54.063687 (+ 591us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:42:54.063705 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:42:54.066845 (+ 3140us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:42:54.069385 (+ 2540us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:42:54.069395 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:42:54.069407 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:42:54.069640 (+ 233us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:42:54.069975 (+ 335us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:42:54.069979 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:42:54.069982 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:42:54.070097 (+ 115us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:42:54.070729 (+ 632us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:42:54.070736 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:42:54.070887 (+ 151us) client_negotiation.cc:769] Sending connection context
0808 04:42:54.071058 (+ 171us) client_negotiation.cc:240] Negotiation successful
0808 04:42:54.071470 (+ 412us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":318,"mutex_wait_us":119,"spinlock_wait_cycles":6912,"thread_start_us":131,"threads_started":1}
I20260808 04:42:54.072566 3296 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:42:54.056043 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52752 (local address 127.20.240.254:38093)
0808 04:42:54.056336 (+ 293us) server_negotiation.cc:206] Beginning negotiation
0808 04:42:54.056345 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 04:42:54.056384 (+ 39us) server_negotiation.cc:407] Connection header received
0808 04:42:54.057683 (+ 1299us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:42:54.057688 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:42:54.057896 (+ 208us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:42:54.058076 (+ 180us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:42:54.059482 (+ 1406us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:42:54.060997 (+ 1515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:42:54.062164 (+ 1167us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:42:54.062837 (+ 673us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:42:54.063044 (+ 207us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:42:54.067029 (+ 3985us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:42:54.067036 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:42:54.067047 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:42:54.067069 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:42:54.069273 (+ 2204us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:42:54.069760 (+ 487us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:42:54.069765 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:42:54.069767 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:42:54.069882 (+ 115us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:42:54.070195 (+ 313us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:42:54.070198 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:42:54.070199 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:42:54.070613 (+ 414us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:42:54.070761 (+ 148us) server_negotiation.cc:1035] Waiting for connection context
0808 04:42:54.071133 (+ 372us) server_negotiation.cc:299] Negotiation successful
0808 04:42:54.071413 (+ 280us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":5,"server-negotiator.queue_time_us":194,"thread_start_us":104,"threads_started":1}
I20260808 04:42:54.075505 3291 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.240.253" port: 41897 } has no permanent_uuid. Determining permanent_uuid...
I20260808 04:42:54.076254 3295 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:42:54.075981 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.253:41897 (local address 127.0.0.1:58546)
0808 04:42:54.076111 (+ 130us) negotiation.cc:107] Waiting for socket to connect
0808 04:42:54.076189 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.240.253:41897: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
W20260808 04:42:54.076530 3238 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.20.240.253:41897: connect: Connection refused (error 111)
I20260808 04:42:54.077545 3295 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:42:54.077340 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.253:41897 (local address 127.0.0.1:58550)
0808 04:42:54.077446 (+ 106us) negotiation.cc:107] Waiting for socket to connect
0808 04:42:54.077491 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.240.253:41897: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
W20260808 04:42:54.077849 3291 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.240.253:41897: Network error: Client connection negotiation failed: client connection to 127.20.240.253:41897: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.240.253 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.253.keytab.
Entry for principal kudu/127.20.240.253 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.253.keytab.
I20260808 04:42:54.084869 21443 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
/tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786164000593138-21443-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786164000593138-21443-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786164000593138-21443-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786164000593138-21443-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.240.253:41897
--webserver_interface=127.20.240.253
--webserver_port=0
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.253.keytab
--principal=kudu/127.20.240.253
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.240.212:44079
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.240.254:38093,127.20.240.253:41897,127.20.240.252:46795
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786164000593138-21443-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786164000593138-21443-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786164000593138-21443-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 04:42:54.127120 3291 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.240.253" port: 41897 } attempt: 1
I20260808 04:42:54.128176 3295 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:42:54.127851 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.253:41897 (local address 127.0.0.1:58564)
0808 04:42:54.128030 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0808 04:42:54.128095 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.240.253:41897: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":80}
I20260808 04:42:54.129047 3295 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:42:54.128755 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.253:41897 (local address 127.0.0.1:58576)
0808 04:42:54.128917 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0808 04:42:54.128978 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.240.253:41897: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":68}
W20260808 04:42:54.129305 3291 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.240.253:41897: Network error: Client connection negotiation failed: client connection to 127.20.240.253:41897: connect: Connection refused (error 111)
I20260808 04:42:54.197556 3291 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.240.253" port: 41897 } attempt: 2
I20260808 04:42:54.198472 3295 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:42:54.198159 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.253:41897 (local address 127.0.0.1:58590)
0808 04:42:54.198310 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0808 04:42:54.198381 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.240.253:41897: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":60}
I20260808 04:42:54.199376 3295 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:42:54.199083 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.253:41897 (local address 127.0.0.1:58594)
0808 04:42:54.199225 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0808 04:42:54.199304 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.240.253:41897: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
W20260808 04:42:54.199570 3291 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.240.253:41897: Network error: Client connection negotiation failed: client connection to 127.20.240.253:41897: connect: Connection refused (error 111)
W20260808 04:42:54.203956 3299 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:42:54.204257 3299 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:42:54.204345 3299 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:42:54.208671 3299 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 04:42:54.208762 3299 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:42:54.208784 3299 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:42:54.208815 3299 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 04:42:54.208866 3299 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 04:42:54.214752 3299 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.240.212:44079
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786164000593138-21443-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786164000593138-21443-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.20.240.254:38093,127.20.240.253:41897,127.20.240.252:46795
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.253.keytab
--principal=kudu/127.20.240.253
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.240.253:41897
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786164000593138-21443-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.20.240.253
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3299
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786164000593138-21443-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 04:05:18 UTC on ccycloud.quasar-drfdgt.root.comops.site
build id 4574101
I20260808 04:42:54.216006 3299 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:42:54.217136 3299 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:42:54.226881 3304 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:42:54.226925 3307 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:42:54.226992 3305 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:42:54.227371 3299 server_base.cc:1034] running on GCE node
I20260808 04:42:54.228055 3299 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:42:54.229408 3299 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:42:54.230600 3299 hybrid_clock.cc:648] HybridClock initialized: now 1786164174230584 us; error 30 us; skew 500 ppm
Aug 08 04:42:54 dist-test-slave-vxj2 krb5kdc[3202](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164174, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.240.253@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:42:54.234405 3299 init.cc:377] Logged in from keytab as kudu/127.20.240.253@KRBTEST.COM (short username kudu)
I20260808 04:42:54.235471 3299 webserver.cc:460] Webserver started at http://127.20.240.253:45147/ using document root <none> and password file <none>
I20260808 04:42:54.236166 3299 fs_manager.cc:359] Metadata directory not provided
I20260808 04:42:54.236276 3299 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:42:54.236543 3299 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 04:42:54.238945 3299 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786164000593138-21443-0/minicluster-data/master-1/data/instance:
uuid: "02655f2b250f4317a9055da1bc08085d"
format_stamp: "Formatted at 2026-08-08 04:42:54 on dist-test-slave-vxj2"
server_key: "e228a66f4c8b569ff6392847a59ac31b"
server_key_iv: "5cb7284ae6faf38fbc262875e1b778f4"
server_key_version: "encryptionkey@0"
I20260808 04:42:54.239609 3299 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786164000593138-21443-0/minicluster-data/master-1/wal/instance:
uuid: "02655f2b250f4317a9055da1bc08085d"
format_stamp: "Formatted at 2026-08-08 04:42:54 on dist-test-slave-vxj2"
server_key: "e228a66f4c8b569ff6392847a59ac31b"
server_key_iv: "5cb7284ae6faf38fbc262875e1b778f4"
server_key_version: "encryptionkey@0"
I20260808 04:42:54.243973 3299 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.003s
I20260808 04:42:54.246860 3316 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:42:54.248152 3299 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260808 04:42:54.248313 3299 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786164000593138-21443-0/minicluster-data/master-1/data,/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786164000593138-21443-0/minicluster-data/master-1/wal
uuid: "02655f2b250f4317a9055da1bc08085d"
format_stamp: "Formatted at 2026-08-08 04:42:54 on dist-test-slave-vxj2"
server_key: "e228a66f4c8b569ff6392847a59ac31b"
server_key_iv: "5cb7284ae6faf38fbc262875e1b778f4"
server_key_version: "encryptionkey@0"
I20260808 04:42:54.248449 3299 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786164000593138-21443-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786164000593138-21443-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786164000593138-21443-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:42:54.270002 3299 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:42:54.273782 3299 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:42:54.274032 3299 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:42:54.282176 3299 rpc_server.cc:307] RPC server started. Bound to: 127.20.240.253:41897
I20260808 04:42:54.282521 3375 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.240.253:41897 every 8 connection(s)
I20260808 04:42:54.283375 3299 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786164000593138-21443-0/minicluster-data/master-1/data/info.pb
I20260808 04:42:54.286551 3376 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:42:54.290767 3291 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.240.253" port: 41897 } attempt: 3
I20260808 04:42:54.290889 3376 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.240.254" port: 38093 } has no permanent_uuid. Determining permanent_uuid...
I20260808 04:42:54.292697 21443 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu as pid 3299
I20260808 04:42:54.292861 21443 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786164000593138-21443-0/minicluster-data/master-1/wal/instance
I20260808 04:42:54.293275 21443 external_mini_cluster.cc:1428] Setting key c8028c4566a17cb5dc13026d8fb0e931
Aug 08 04:42:54 dist-test-slave-vxj2 krb5kdc[3202](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164173, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.240.254@KRBTEST.COM for kudu/127.20.240.253@KRBTEST.COM
Aug 08 04:42:54 dist-test-slave-vxj2 krb5kdc[3202](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164174, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.240.253@KRBTEST.COM for kudu/127.20.240.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.20.240.252@KRBTEST.COM; defaulting to no policy
I20260808 04:42:54.307116 3295 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:42:54.291473 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.253:41897 (local address 127.0.0.1:58608)
0808 04:42:54.291663 (+ 190us) negotiation.cc:107] Waiting for socket to connect
0808 04:42:54.291684 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0808 04:42:54.291803 (+ 119us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:42:54.294526 (+ 2723us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:42:54.294530 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:42:54.294801 (+ 271us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:42:54.294955 (+ 154us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:42:54.294964 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:42:54.297113 (+ 2149us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:42:54.297120 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:42:54.298220 (+ 1100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:42:54.298237 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:42:54.299155 (+ 918us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:42:54.299159 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:42:54.299275 (+ 116us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:42:54.299940 (+ 665us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:42:54.299957 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:42:54.301881 (+ 1924us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:42:54.304437 (+ 2556us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:42:54.304441 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:42:54.304447 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:42:54.304842 (+ 395us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:42:54.305264 (+ 422us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:42:54.305270 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:42:54.305274 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:42:54.305382 (+ 108us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:42:54.306315 (+ 933us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:42:54.306319 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:42:54.306495 (+ 176us) client_negotiation.cc:769] Sending connection context
0808 04:42:54.306707 (+ 212us) client_negotiation.cc:240] Negotiation successful
0808 04:42:54.306890 (+ 183us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":74}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.240.252@KRBTEST.COM" created.
I20260808 04:42:54.308468 3296 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:42:54.293450 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52768 (local address 127.20.240.254:38093)
0808 04:42:54.293580 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0808 04:42:54.293585 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 04:42:54.294121 (+ 536us) server_negotiation.cc:407] Connection header received
0808 04:42:54.294474 (+ 353us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:42:54.294481 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:42:54.294554 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:42:54.294661 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:42:54.296178 (+ 1517us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:42:54.296891 (+ 713us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:42:54.298121 (+ 1230us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:42:54.298507 (+ 386us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:42:54.298635 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:42:54.303786 (+ 5151us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:42:54.303790 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:42:54.303793 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:42:54.303835 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:42:54.306268 (+ 2433us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:42:54.306809 (+ 541us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:42:54.306823 (+ 14us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:42:54.306825 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:42:54.306914 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:42:54.307250 (+ 336us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:42:54.307256 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:42:54.307258 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:42:54.307520 (+ 262us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:42:54.307630 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0808 04:42:54.308143 (+ 513us) server_negotiation.cc:299] Negotiation successful
0808 04:42:54.308279 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260808 04:42:54.308542 3379 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:42:54.293085 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:38093 (local address 127.0.0.1:52768)
0808 04:42:54.293939 (+ 854us) negotiation.cc:107] Waiting for socket to connect
0808 04:42:54.293996 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0808 04:42:54.294258 (+ 262us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:42:54.294753 (+ 495us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:42:54.294763 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:42:54.295278 (+ 515us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:42:54.295992 (+ 714us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:42:54.296007 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:42:54.297033 (+ 1026us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:42:54.297040 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:42:54.297972 (+ 932us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:42:54.297983 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:42:54.298720 (+ 737us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:42:54.298727 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:42:54.299002 (+ 275us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:42:54.299753 (+ 751us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:42:54.299801 (+ 48us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:42:54.303608 (+ 3807us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:42:54.306400 (+ 2792us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:42:54.306410 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:42:54.306416 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:42:54.306683 (+ 267us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:42:54.307025 (+ 342us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:42:54.307029 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:42:54.307032 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:42:54.307137 (+ 105us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:42:54.307695 (+ 558us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:42:54.307703 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:42:54.307876 (+ 173us) client_negotiation.cc:769] Sending connection context
0808 04:42:54.308030 (+ 154us) client_negotiation.cc:240] Negotiation successful
0808 04:42:54.308280 (+ 250us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":642,"mutex_wait_us":42,"spinlock_wait_cycles":3328,"thread_start_us":141,"threads_started":1}
I20260808 04:42:54.308555 3378 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:42:54.292169 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58608 (local address 127.20.240.253:41897)
0808 04:42:54.292732 (+ 563us) server_negotiation.cc:206] Beginning negotiation
0808 04:42:54.292751 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0808 04:42:54.292821 (+ 70us) server_negotiation.cc:407] Connection header received
0808 04:42:54.293845 (+ 1024us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:42:54.293872 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:42:54.294286 (+ 414us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:42:54.295150 (+ 864us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:42:54.295764 (+ 614us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:42:54.296935 (+ 1171us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:42:54.298363 (+ 1428us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:42:54.299017 (+ 654us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:42:54.299136 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:42:54.302057 (+ 2921us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:42:54.302064 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:42:54.302076 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:42:54.302099 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:42:54.304230 (+ 2131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:42:54.304961 (+ 731us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:42:54.304968 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:42:54.304976 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:42:54.305110 (+ 134us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:42:54.305654 (+ 544us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:42:54.305657 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:42:54.305659 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:42:54.306158 (+ 499us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:42:54.306354 (+ 196us) server_negotiation.cc:1035] Waiting for connection context
0808 04:42:54.306899 (+ 545us) server_negotiation.cc:299] Negotiation successful
0808 04:42:54.307280 (+ 381us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":74,"server-negotiator.queue_time_us":386,"spinlock_wait_cycles":1280,"thread_start_us":196,"threads_started":1}
I20260808 04:42:54.310909 3376 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.240.253" port: 41897 } has no permanent_uuid. Determining permanent_uuid...
I20260808 04:42:54.310925 3291 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.240.252" port: 46795 } has no permanent_uuid. Determining permanent_uuid...
I20260808 04:42:54.312305 3295 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:42:54.311937 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.252:46795 (local address 127.0.0.1:42678)
0808 04:42:54.312114 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0808 04:42:54.312197 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.240.252:46795: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":65}
I20260808 04:42:54.313278 3295 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:42:54.312874 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.252:46795 (local address 127.0.0.1:42682)
0808 04:42:54.313060 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0808 04:42:54.313129 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.240.252:46795: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":85}
W20260808 04:42:54.313429 3291 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.240.252:46795: Network error: Client connection negotiation failed: client connection to 127.20.240.252:46795: connect: Connection refused (error 111)
Aug 08 04:42:54 dist-test-slave-vxj2 krb5kdc[3202](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164174, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.240.253@KRBTEST.COM for kudu/127.20.240.253@KRBTEST.COM
I20260808 04:42:54.322043 3379 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:42:54.311551 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.253:41897 (local address 127.0.0.1:58618)
0808 04:42:54.311693 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0808 04:42:54.311712 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0808 04:42:54.311809 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:42:54.312304 (+ 495us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:42:54.312307 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:42:54.312528 (+ 221us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:42:54.312644 (+ 116us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:42:54.312650 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:42:54.313808 (+ 1158us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:42:54.313815 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:42:54.314955 (+ 1140us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:42:54.314972 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:42:54.315602 (+ 630us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:42:54.315607 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:42:54.315758 (+ 151us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:42:54.316379 (+ 621us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:42:54.316399 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:42:54.318201 (+ 1802us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:42:54.320254 (+ 2053us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:42:54.320257 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:42:54.320259 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:42:54.320473 (+ 214us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:42:54.320871 (+ 398us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:42:54.320873 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:42:54.320874 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:42:54.320956 (+ 82us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:42:54.321459 (+ 503us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:42:54.321461 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:42:54.321552 (+ 91us) client_negotiation.cc:769] Sending connection context
0808 04:42:54.321720 (+ 168us) client_negotiation.cc:240] Negotiation successful
0808 04:42:54.321878 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":58}
I20260808 04:42:54.322079 3378 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:42:54.311721 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58618 (local address 127.20.240.253:41897)
0808 04:42:54.312110 (+ 389us) server_negotiation.cc:206] Beginning negotiation
0808 04:42:54.312113 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 04:42:54.312125 (+ 12us) server_negotiation.cc:407] Connection header received
0808 04:42:54.312155 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:42:54.312157 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:42:54.312193 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:42:54.312293 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:42:54.312800 (+ 507us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:42:54.313673 (+ 873us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:42:54.315159 (+ 1486us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:42:54.315460 (+ 301us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:42:54.315555 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:42:54.318381 (+ 2826us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:42:54.318386 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:42:54.318390 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:42:54.318421 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:42:54.320108 (+ 1687us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:42:54.320570 (+ 462us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:42:54.320573 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:42:54.320574 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:42:54.320668 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:42:54.321060 (+ 392us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:42:54.321066 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:42:54.321072 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:42:54.321347 (+ 275us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:42:54.321437 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0808 04:42:54.321770 (+ 333us) server_negotiation.cc:299] Negotiation successful
0808 04:42:54.321944 (+ 174us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":52,"server-negotiator.queue_time_us":320}
I20260808 04:42:54.323004 3376 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.240.252" port: 46795 } has no permanent_uuid. Determining permanent_uuid...
I20260808 04:42:54.323815 3379 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:42:54.323558 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.252:46795 (local address 127.0.0.1:42686)
0808 04:42:54.323662 (+ 104us) negotiation.cc:107] Waiting for socket to connect
0808 04:42:54.323750 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.240.252:46795: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
W20260808 04:42:54.324548 3319 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.20.240.252:46795: connect: Connection refused (error 111)
I20260808 04:42:54.325665 3379 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:42:54.325438 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.252:46795 (local address 127.0.0.1:42688)
0808 04:42:54.325555 (+ 117us) negotiation.cc:107] Waiting for socket to connect
0808 04:42:54.325606 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.240.252:46795: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
W20260808 04:42:54.325984 3376 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.240.252:46795: Network error: Client connection negotiation failed: client connection to 127.20.240.252:46795: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.240.252 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.252.keytab.
Entry for principal kudu/127.20.240.252 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.252.keytab.
I20260808 04:42:54.329133 21443 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
/tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786164000593138-21443-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786164000593138-21443-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786164000593138-21443-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786164000593138-21443-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.240.252:46795
--webserver_interface=127.20.240.252
--webserver_port=0
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.252.keytab
--principal=kudu/127.20.240.252
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.240.212:44079
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.240.254:38093,127.20.240.253:41897,127.20.240.252:46795
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786164000593138-21443-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786164000593138-21443-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786164000593138-21443-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 04:42:54.344620 3291 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.240.252" port: 46795 } attempt: 1
I20260808 04:42:54.345680 3295 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:42:54.345347 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.252:46795 (local address 127.0.0.1:47860)
0808 04:42:54.345520 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0808 04:42:54.345591 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.240.252:46795: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":66}
I20260808 04:42:54.346598 3295 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:42:54.346336 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.252:46795 (local address 127.0.0.1:47864)
0808 04:42:54.346459 (+ 123us) negotiation.cc:107] Waiting for socket to connect
0808 04:42:54.346533 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.240.252:46795: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
W20260808 04:42:54.346786 3291 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.240.252:46795: Network error: Client connection negotiation failed: client connection to 127.20.240.252:46795: connect: Connection refused (error 111)
I20260808 04:42:54.375309 3376 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.240.252" port: 46795 } attempt: 1
I20260808 04:42:54.376278 3379 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:42:54.375960 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.252:46795 (local address 127.0.0.1:47872)
0808 04:42:54.376121 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0808 04:42:54.376196 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.240.252:46795: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":67}
I20260808 04:42:54.377130 3379 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:42:54.376890 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.252:46795 (local address 127.0.0.1:47874)
0808 04:42:54.377013 (+ 123us) negotiation.cc:107] Waiting for socket to connect
0808 04:42:54.377071 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.240.252:46795: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
W20260808 04:42:54.377346 3376 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.240.252:46795: Network error: Client connection negotiation failed: client connection to 127.20.240.252:46795: connect: Connection refused (error 111)
I20260808 04:42:54.422014 3291 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.240.252" port: 46795 } attempt: 2
I20260808 04:42:54.422984 3295 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:42:54.422647 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.252:46795 (local address 127.0.0.1:47878)
0808 04:42:54.422834 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0808 04:42:54.422897 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.240.252:46795: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":78}
I20260808 04:42:54.423722 3295 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:42:54.423503 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.252:46795 (local address 127.0.0.1:47880)
0808 04:42:54.423616 (+ 113us) negotiation.cc:107] Waiting for socket to connect
0808 04:42:54.423667 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.240.252:46795: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
W20260808 04:42:54.423849 3291 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.240.252:46795: Network error: Client connection negotiation failed: client connection to 127.20.240.252:46795: connect: Connection refused (error 111)
I20260808 04:42:54.445529 3376 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.240.252" port: 46795 } attempt: 2
I20260808 04:42:54.446452 3379 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:42:54.446153 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.252:46795 (local address 127.0.0.1:47882)
0808 04:42:54.446311 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0808 04:42:54.446376 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.240.252:46795: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":62}
I20260808 04:42:54.447229 3379 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:42:54.447016 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.252:46795 (local address 127.0.0.1:47898)
0808 04:42:54.447126 (+ 110us) negotiation.cc:107] Waiting for socket to connect
0808 04:42:54.447177 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.240.252:46795: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
W20260808 04:42:54.447366 3376 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.240.252:46795: Network error: Client connection negotiation failed: client connection to 127.20.240.252:46795: connect: Connection refused (error 111)
W20260808 04:42:54.449916 3384 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:42:54.450215 3384 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:42:54.450317 3384 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:42:54.454622 3384 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 04:42:54.454723 3384 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:42:54.454761 3384 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:42:54.454818 3384 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 04:42:54.454873 3384 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 04:42:54.460700 3384 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.240.212:44079
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786164000593138-21443-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786164000593138-21443-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.20.240.254:38093,127.20.240.253:41897,127.20.240.252:46795
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.252.keytab
--principal=kudu/127.20.240.252
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.240.252:46795
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786164000593138-21443-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.20.240.252
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3384
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786164000593138-21443-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 04:05:18 UTC on ccycloud.quasar-drfdgt.root.comops.site
build id 4574101
I20260808 04:42:54.462014 3384 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:42:54.463086 3384 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:42:54.472081 3391 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:42:54.472127 3384 server_base.cc:1034] running on GCE node
W20260808 04:42:54.472127 3390 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:42:54.472329 3393 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:42:54.472918 3384 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:42:54.474123 3384 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:42:54.475337 3384 hybrid_clock.cc:648] HybridClock initialized: now 1786164174475297 us; error 50 us; skew 500 ppm
Aug 08 04:42:54 dist-test-slave-vxj2 krb5kdc[3202](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164174, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.240.252@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:42:54.478447 3384 init.cc:377] Logged in from keytab as kudu/127.20.240.252@KRBTEST.COM (short username kudu)
I20260808 04:42:54.479480 3384 webserver.cc:460] Webserver started at http://127.20.240.252:42951/ using document root <none> and password file <none>
I20260808 04:42:54.480106 3384 fs_manager.cc:359] Metadata directory not provided
I20260808 04:42:54.480173 3384 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:42:54.480420 3384 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 04:42:54.482723 3384 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786164000593138-21443-0/minicluster-data/master-2/data/instance:
uuid: "366dd9fe2a2746e590a235b915be43ec"
format_stamp: "Formatted at 2026-08-08 04:42:54 on dist-test-slave-vxj2"
server_key: "b0bd6e948539db3503d841586c9eff84"
server_key_iv: "ae3a0b8bb23b08f884f9bc5f8834625d"
server_key_version: "encryptionkey@0"
I20260808 04:42:54.483359 3384 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786164000593138-21443-0/minicluster-data/master-2/wal/instance:
uuid: "366dd9fe2a2746e590a235b915be43ec"
format_stamp: "Formatted at 2026-08-08 04:42:54 on dist-test-slave-vxj2"
server_key: "b0bd6e948539db3503d841586c9eff84"
server_key_iv: "ae3a0b8bb23b08f884f9bc5f8834625d"
server_key_version: "encryptionkey@0"
I20260808 04:42:54.487546 3384 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.003s
I20260808 04:42:54.490149 3400 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:42:54.491401 3384 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 04:42:54.491601 3384 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786164000593138-21443-0/minicluster-data/master-2/data,/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786164000593138-21443-0/minicluster-data/master-2/wal
uuid: "366dd9fe2a2746e590a235b915be43ec"
format_stamp: "Formatted at 2026-08-08 04:42:54 on dist-test-slave-vxj2"
server_key: "b0bd6e948539db3503d841586c9eff84"
server_key_iv: "ae3a0b8bb23b08f884f9bc5f8834625d"
server_key_version: "encryptionkey@0"
I20260808 04:42:54.491732 3384 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786164000593138-21443-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786164000593138-21443-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786164000593138-21443-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:42:54.505777 3384 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:42:54.509641 3384 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:42:54.509891 3384 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:42:54.517398 3384 rpc_server.cc:307] RPC server started. Bound to: 127.20.240.252:46795
I20260808 04:42:54.517691 3455 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.240.252:46795 every 8 connection(s)
I20260808 04:42:54.518569 3384 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786164000593138-21443-0/minicluster-data/master-2/data/info.pb
I20260808 04:42:54.521656 3456 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:42:54.523018 3291 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.240.252" port: 46795 } attempt: 3
I20260808 04:42:54.526152 3456 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.240.254" port: 38093 } has no permanent_uuid. Determining permanent_uuid...
I20260808 04:42:54.526687 21443 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu as pid 3384
I20260808 04:42:54.526811 21443 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786164000593138-21443-0/minicluster-data/master-2/wal/instance
I20260808 04:42:54.527113 21443 external_mini_cluster.cc:1428] Setting key 9a9744beaf13f11f29f26b7246b4d5ae
Aug 08 04:42:54 dist-test-slave-vxj2 krb5kdc[3202](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164173, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.240.254@KRBTEST.COM for kudu/127.20.240.252@KRBTEST.COM
Aug 08 04:42:54 dist-test-slave-vxj2 krb5kdc[3202](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164173, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.240.252@KRBTEST.COM
Aug 08 04:42:54 dist-test-slave-vxj2 krb5kdc[3202](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164174, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.240.252@KRBTEST.COM for kudu/127.20.240.254@KRBTEST.COM
I20260808 04:42:54.537451 3295 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:42:54.523579 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.252:46795 (local address 127.0.0.1:47908)
0808 04:42:54.523722 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0808 04:42:54.523739 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 04:42:54.523843 (+ 104us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:42:54.526407 (+ 2564us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:42:54.526410 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:42:54.526670 (+ 260us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:42:54.526795 (+ 125us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:42:54.526803 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:42:54.528608 (+ 1805us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:42:54.528615 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:42:54.529520 (+ 905us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:42:54.529535 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:42:54.530512 (+ 977us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:42:54.530516 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:42:54.530601 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:42:54.531177 (+ 576us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:42:54.531193 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:42:54.532861 (+ 1668us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:42:54.535085 (+ 2224us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:42:54.535090 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:42:54.535096 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:42:54.535366 (+ 270us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:42:54.535826 (+ 460us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:42:54.535829 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:42:54.535831 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:42:54.535943 (+ 112us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:42:54.536774 (+ 831us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:42:54.536778 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:42:54.536890 (+ 112us) client_negotiation.cc:769] Sending connection context
0808 04:42:54.537012 (+ 122us) client_negotiation.cc:240] Negotiation successful
0808 04:42:54.537222 (+ 210us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":54}
I20260808 04:42:54.538549 3376 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.240.252" port: 46795 } attempt: 3
I20260808 04:42:54.539259 3460 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:42:54.524394 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47908 (local address 127.20.240.252:46795)
0808 04:42:54.524884 (+ 490us) server_negotiation.cc:206] Beginning negotiation
0808 04:42:54.524899 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0808 04:42:54.524938 (+ 39us) server_negotiation.cc:407] Connection header received
0808 04:42:54.525712 (+ 774us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:42:54.525732 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:42:54.526096 (+ 364us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:42:54.526461 (+ 365us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:42:54.526968 (+ 507us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:42:54.528448 (+ 1480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:42:54.529658 (+ 1210us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:42:54.530373 (+ 715us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:42:54.530545 (+ 172us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:42:54.532992 (+ 2447us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:42:54.533002 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:42:54.533020 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:42:54.533058 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:42:54.534954 (+ 1896us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:42:54.535519 (+ 565us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:42:54.535527 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:42:54.535538 (+ 11us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:42:54.535702 (+ 164us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:42:54.536059 (+ 357us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:42:54.536064 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:42:54.536066 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:42:54.536656 (+ 590us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:42:54.536812 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0808 04:42:54.537644 (+ 832us) server_negotiation.cc:299] Negotiation successful
0808 04:42:54.538062 (+ 418us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":335,"thread_start_us":162,"threads_started":1}
I20260808 04:42:54.540511 3461 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:42:54.527827 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47918 (local address 127.20.240.252:46795)
0808 04:42:54.528151 (+ 324us) server_negotiation.cc:206] Beginning negotiation
0808 04:42:54.528162 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 04:42:54.528432 (+ 270us) server_negotiation.cc:407] Connection header received
0808 04:42:54.528487 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:42:54.528493 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:42:54.528550 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:42:54.528630 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:42:54.529736 (+ 1106us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:42:54.530427 (+ 691us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:42:54.531653 (+ 1226us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:42:54.531978 (+ 325us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:42:54.532092 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:42:54.535554 (+ 3462us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:42:54.535558 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:42:54.535561 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:42:54.535589 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:42:54.538134 (+ 2545us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:42:54.539037 (+ 903us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:42:54.539041 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:42:54.539042 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:42:54.539135 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:42:54.539460 (+ 325us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:42:54.539463 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:42:54.539465 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:42:54.539677 (+ 212us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:42:54.539831 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0808 04:42:54.540178 (+ 347us) server_negotiation.cc:299] Negotiation successful
0808 04:42:54.540312 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":245,"thread_start_us":130,"threads_started":1}
I20260808 04:42:54.541582 3296 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:42:54.528455 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57952 (local address 127.20.240.254:38093)
0808 04:42:54.528574 (+ 119us) server_negotiation.cc:206] Beginning negotiation
0808 04:42:54.528578 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:42:54.528931 (+ 353us) server_negotiation.cc:407] Connection header received
0808 04:42:54.529185 (+ 254us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:42:54.529191 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:42:54.529246 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:42:54.529346 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:42:54.530152 (+ 806us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:42:54.530832 (+ 680us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:42:54.531844 (+ 1012us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:42:54.532217 (+ 373us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:42:54.532328 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:42:54.536015 (+ 3687us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:42:54.536019 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:42:54.536028 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:42:54.536053 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:42:54.538137 (+ 2084us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:42:54.538662 (+ 525us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:42:54.538666 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:42:54.538710 (+ 44us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:42:54.538818 (+ 108us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:42:54.539152 (+ 334us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:42:54.539156 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:42:54.539157 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:42:54.539861 (+ 704us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:42:54.539929 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0808 04:42:54.541299 (+ 1370us) server_negotiation.cc:299] Negotiation successful
0808 04:42:54.541432 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260808 04:42:54.542385 3465 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:42:54.528394 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:38093 (local address 127.0.0.1:57952)
0808 04:42:54.528806 (+ 412us) negotiation.cc:107] Waiting for socket to connect
0808 04:42:54.528855 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0808 04:42:54.529015 (+ 160us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:42:54.529406 (+ 391us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:42:54.529413 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:42:54.529861 (+ 448us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:42:54.530007 (+ 146us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:42:54.530015 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:42:54.530933 (+ 918us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:42:54.530937 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:42:54.531698 (+ 761us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:42:54.531706 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:42:54.532399 (+ 693us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:42:54.532405 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:42:54.532546 (+ 141us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:42:54.533451 (+ 905us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:42:54.533473 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:42:54.535854 (+ 2381us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:42:54.538250 (+ 2396us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:42:54.538260 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:42:54.538266 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:42:54.538576 (+ 310us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:42:54.538946 (+ 370us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:42:54.538950 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:42:54.538952 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:42:54.539044 (+ 92us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:42:54.539998 (+ 954us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:42:54.540003 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:42:54.540124 (+ 121us) client_negotiation.cc:769] Sending connection context
0808 04:42:54.542010 (+ 1886us) client_negotiation.cc:240] Negotiation successful
0808 04:42:54.542207 (+ 197us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":257,"thread_start_us":89,"threads_started":1}
I20260808 04:42:54.543365 3456 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.240.253" port: 41897 } has no permanent_uuid. Determining permanent_uuid...
I20260808 04:42:54.544166 3291 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 33cbd6d790e8405ba6a46f516ee92c25: Bootstrap starting.
Aug 08 04:42:54 dist-test-slave-vxj2 krb5kdc[3202](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164174, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.240.253@KRBTEST.COM for kudu/127.20.240.252@KRBTEST.COM
I20260808 04:42:54.547160 3291 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 33cbd6d790e8405ba6a46f516ee92c25: Neither blocks nor log segments found. Creating new log.
I20260808 04:42:54.548053 3291 log.cc:824] T 00000000000000000000000000000000 P 33cbd6d790e8405ba6a46f516ee92c25: Log is configured to *not* fsync() on all Append() calls
I20260808 04:42:54.549253 3460 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:42:54.539320 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47928 (local address 127.20.240.252:46795)
0808 04:42:54.540808 (+ 1488us) server_negotiation.cc:206] Beginning negotiation
0808 04:42:54.540811 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 04:42:54.540825 (+ 14us) server_negotiation.cc:407] Connection header received
0808 04:42:54.540859 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:42:54.540861 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:42:54.540893 (+ 32us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:42:54.540955 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:42:54.541554 (+ 599us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:42:54.542258 (+ 704us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:42:54.543395 (+ 1137us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:42:54.543732 (+ 337us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:42:54.544202 (+ 470us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:42:54.545998 (+ 1796us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:42:54.546001 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:42:54.546003 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:42:54.546022 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:42:54.547352 (+ 1330us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:42:54.547925 (+ 573us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:42:54.547928 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:42:54.547930 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:42:54.548009 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:42:54.548336 (+ 327us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:42:54.548338 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:42:54.548339 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:42:54.548541 (+ 202us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:42:54.548673 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0808 04:42:54.548954 (+ 281us) server_negotiation.cc:299] Negotiation successful
0808 04:42:54.549068 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1222,"thread_start_us":182,"threads_started":1}
I20260808 04:42:54.549256 3379 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:42:54.539051 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.252:46795 (local address 127.0.0.1:47928)
0808 04:42:54.539352 (+ 301us) negotiation.cc:107] Waiting for socket to connect
0808 04:42:54.539370 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0808 04:42:54.539474 (+ 104us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:42:54.541012 (+ 1538us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:42:54.541016 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:42:54.541231 (+ 215us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:42:54.541350 (+ 119us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:42:54.541358 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:42:54.542401 (+ 1043us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:42:54.542404 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:42:54.543236 (+ 832us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:42:54.543249 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:42:54.543877 (+ 628us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:42:54.543880 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:42:54.543964 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:42:54.544397 (+ 433us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:42:54.544412 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:42:54.545852 (+ 1440us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:42:54.547481 (+ 1629us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:42:54.547485 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:42:54.547487 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:42:54.547740 (+ 253us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:42:54.548123 (+ 383us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:42:54.548127 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:42:54.548129 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:42:54.548229 (+ 100us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:42:54.548664 (+ 435us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:42:54.548668 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:42:54.548778 (+ 110us) client_negotiation.cc:769] Sending connection context
0808 04:42:54.548901 (+ 123us) client_negotiation.cc:240] Negotiation successful
0808 04:42:54.549062 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":212}
I20260808 04:42:54.550482 3291 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 33cbd6d790e8405ba6a46f516ee92c25: No bootstrap required, opened a new log
I20260808 04:42:54.552448 3376 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 02655f2b250f4317a9055da1bc08085d: Bootstrap starting.
Aug 08 04:42:54 dist-test-slave-vxj2 krb5kdc[3202](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164174, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.240.252@KRBTEST.COM for kudu/127.20.240.253@KRBTEST.COM
I20260808 04:42:54.555444 3376 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 02655f2b250f4317a9055da1bc08085d: Neither blocks nor log segments found. Creating new log.
I20260808 04:42:54.555444 3291 raft_consensus.cc:348] T 00000000000000000000000000000000 P 33cbd6d790e8405ba6a46f516ee92c25 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33cbd6d790e8405ba6a46f516ee92c25" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 38093 } } peers { permanent_uuid: "02655f2b250f4317a9055da1bc08085d" member_type: VOTER last_known_addr { host: "127.20.240.253" port: 41897 } } peers { permanent_uuid: "366dd9fe2a2746e590a235b915be43ec" member_type: VOTER last_known_addr { host: "127.20.240.252" port: 46795 } }
I20260808 04:42:54.555972 3291 raft_consensus.cc:374] T 00000000000000000000000000000000 P 33cbd6d790e8405ba6a46f516ee92c25 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
Aug 08 04:42:54 dist-test-slave-vxj2 krb5kdc[3202](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164173, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.240.254@KRBTEST.COM
I20260808 04:42:54.556028 3291 raft_consensus.cc:729] T 00000000000000000000000000000000 P 33cbd6d790e8405ba6a46f516ee92c25 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33cbd6d790e8405ba6a46f516ee92c25, State: Initialized, Role: FOLLOWER
I20260808 04:42:54.556394 3376 log.cc:824] T 00000000000000000000000000000000 P 02655f2b250f4317a9055da1bc08085d: Log is configured to *not* fsync() on all Append() calls
I20260808 04:42:54.556849 3291 consensus_queue.cc:260] T 00000000000000000000000000000000 P 33cbd6d790e8405ba6a46f516ee92c25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33cbd6d790e8405ba6a46f516ee92c25" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 38093 } } peers { permanent_uuid: "02655f2b250f4317a9055da1bc08085d" member_type: VOTER last_known_addr { host: "127.20.240.253" port: 41897 } } peers { permanent_uuid: "366dd9fe2a2746e590a235b915be43ec" member_type: VOTER last_known_addr { host: "127.20.240.252" port: 46795 } }
I20260808 04:42:54.558852 3291 sys_catalog.cc:564] T 00000000000000000000000000000000 P 33cbd6d790e8405ba6a46f516ee92c25 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 04:42:54.559202 3376 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 02655f2b250f4317a9055da1bc08085d: No bootstrap required, opened a new log
I20260808 04:42:54.559734 3378 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:42:54.548620 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55756 (local address 127.20.240.253:41897)
0808 04:42:54.548760 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0808 04:42:54.548766 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 04:42:54.548780 (+ 14us) server_negotiation.cc:407] Connection header received
0808 04:42:54.548821 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:42:54.548827 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:42:54.548878 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:42:54.548973 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:42:54.550359 (+ 1386us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:42:54.551122 (+ 763us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:42:54.552273 (+ 1151us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:42:54.552590 (+ 317us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:42:54.552666 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:42:54.555252 (+ 2586us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:42:54.555256 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:42:54.555259 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:42:54.555287 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:42:54.556982 (+ 1695us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:42:54.557580 (+ 598us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:42:54.557583 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:42:54.557585 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:42:54.557669 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:42:54.558653 (+ 984us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:42:54.558657 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:42:54.558659 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:42:54.558949 (+ 290us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:42:54.559036 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0808 04:42:54.559423 (+ 387us) server_negotiation.cc:299] Negotiation successful
0808 04:42:54.559560 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260808 04:42:54.560210 3465 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:42:54.543830 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.253:41897 (local address 127.0.0.1:55756)
0808 04:42:54.543929 (+ 99us) negotiation.cc:107] Waiting for socket to connect
0808 04:42:54.543943 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 04:42:54.544017 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:42:54.549548 (+ 5531us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:42:54.549551 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:42:54.549724 (+ 173us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:42:54.549880 (+ 156us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:42:54.549888 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:42:54.551261 (+ 1373us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:42:54.551265 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:42:54.552143 (+ 878us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:42:54.552156 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:42:54.552872 (+ 716us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:42:54.552875 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:42:54.552969 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:42:54.553470 (+ 501us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:42:54.553485 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:42:54.555079 (+ 1594us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:42:54.557111 (+ 2032us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:42:54.557115 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:42:54.557117 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:42:54.557449 (+ 332us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:42:54.558424 (+ 975us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:42:54.558429 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:42:54.558434 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:42:54.558528 (+ 94us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:42:54.559098 (+ 570us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:42:54.559101 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:42:54.559217 (+ 116us) client_negotiation.cc:769] Sending connection context
0808 04:42:54.559884 (+ 667us) client_negotiation.cc:240] Negotiation successful
0808 04:42:54.560049 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":26}
I20260808 04:42:54.560232 3296 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:42:54.542410 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57966 (local address 127.20.240.254:38093)
0808 04:42:54.542511 (+ 101us) server_negotiation.cc:206] Beginning negotiation
0808 04:42:54.542514 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 04:42:54.550186 (+ 7672us) server_negotiation.cc:407] Connection header received
0808 04:42:54.550320 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:42:54.550326 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:42:54.550373 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:42:54.550444 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:42:54.551262 (+ 818us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:42:54.552052 (+ 790us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:42:54.553244 (+ 1192us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:42:54.553594 (+ 350us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:42:54.553679 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:42:54.556685 (+ 3006us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:42:54.556689 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:42:54.556694 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:42:54.556728 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:42:54.558271 (+ 1543us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:42:54.558767 (+ 496us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:42:54.558770 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:42:54.558772 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:42:54.558862 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:42:54.559197 (+ 335us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:42:54.559200 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:42:54.559202 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:42:54.559424 (+ 222us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:42:54.559600 (+ 176us) server_negotiation.cc:1035] Waiting for connection context
0808 04:42:54.559994 (+ 394us) server_negotiation.cc:299] Negotiation successful
0808 04:42:54.560102 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260808 04:42:54.561137 3456 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.240.252" port: 46795 } has no permanent_uuid. Determining permanent_uuid...
I20260808 04:42:54.564688 3376 raft_consensus.cc:348] T 00000000000000000000000000000000 P 02655f2b250f4317a9055da1bc08085d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33cbd6d790e8405ba6a46f516ee92c25" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 38093 } } peers { permanent_uuid: "02655f2b250f4317a9055da1bc08085d" member_type: VOTER last_known_addr { host: "127.20.240.253" port: 41897 } } peers { permanent_uuid: "366dd9fe2a2746e590a235b915be43ec" member_type: VOTER last_known_addr { host: "127.20.240.252" port: 46795 } }
I20260808 04:42:54.565012 3376 raft_consensus.cc:374] T 00000000000000000000000000000000 P 02655f2b250f4317a9055da1bc08085d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:42:54.565110 3376 raft_consensus.cc:729] T 00000000000000000000000000000000 P 02655f2b250f4317a9055da1bc08085d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 02655f2b250f4317a9055da1bc08085d, State: Initialized, Role: FOLLOWER
I20260808 04:42:54.565712 3376 consensus_queue.cc:260] T 00000000000000000000000000000000 P 02655f2b250f4317a9055da1bc08085d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33cbd6d790e8405ba6a46f516ee92c25" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 38093 } } peers { permanent_uuid: "02655f2b250f4317a9055da1bc08085d" member_type: VOTER last_known_addr { host: "127.20.240.253" port: 41897 } } peers { permanent_uuid: "366dd9fe2a2746e590a235b915be43ec" member_type: VOTER last_known_addr { host: "127.20.240.252" port: 46795 } }
Aug 08 04:42:54 dist-test-slave-vxj2 krb5kdc[3202](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164174, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.240.252@KRBTEST.COM for kudu/127.20.240.252@KRBTEST.COM
I20260808 04:42:54.567420 3376 sys_catalog.cc:564] T 00000000000000000000000000000000 P 02655f2b250f4317a9055da1bc08085d [sys.catalog]: configured and running, proceeding with master startup.
Aug 08 04:42:54 dist-test-slave-vxj2 krb5kdc[3202](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164173, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.240.253@KRBTEST.COM
I20260808 04:42:54.570196 3485 sys_catalog.cc:455] T 00000000000000000000000000000000 P 02655f2b250f4317a9055da1bc08085d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33cbd6d790e8405ba6a46f516ee92c25" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 38093 } } peers { permanent_uuid: "02655f2b250f4317a9055da1bc08085d" member_type: VOTER last_known_addr { host: "127.20.240.253" port: 41897 } } peers { permanent_uuid: "366dd9fe2a2746e590a235b915be43ec" member_type: VOTER last_known_addr { host: "127.20.240.252" port: 46795 } } }
I20260808 04:42:54.570448 3485 sys_catalog.cc:458] T 00000000000000000000000000000000 P 02655f2b250f4317a9055da1bc08085d [sys.catalog]: This master's current role is: FOLLOWER
I20260808 04:42:54.564195 3216 master_runner.cc:186] Error getting master registration for 127.20.240.253:41897: OK, instance_id { permanent_uuid: "02655f2b250f4317a9055da1bc08085d" instance_seqno: 1786164174279639 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260808 04:42:54.570837 3216 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260808 04:42:54.571009 3465 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:42:54.561681 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.252:46795 (local address 127.0.0.1:47936)
0808 04:42:54.561893 (+ 212us) negotiation.cc:107] Waiting for socket to connect
0808 04:42:54.561907 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 04:42:54.561977 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:42:54.562491 (+ 514us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:42:54.562494 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:42:54.562676 (+ 182us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:42:54.562772 (+ 96us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:42:54.562781 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:42:54.563770 (+ 989us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:42:54.563773 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:42:54.564531 (+ 758us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:42:54.564540 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:42:54.565126 (+ 586us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:42:54.565129 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:42:54.565223 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:42:54.565712 (+ 489us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:42:54.565731 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:42:54.567351 (+ 1620us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:42:54.569403 (+ 2052us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:42:54.569406 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:42:54.569408 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:42:54.569656 (+ 248us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:42:54.569976 (+ 320us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:42:54.569978 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:42:54.569980 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:42:54.570058 (+ 78us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:42:54.570495 (+ 437us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:42:54.570500 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:42:54.570586 (+ 86us) client_negotiation.cc:769] Sending connection context
0808 04:42:54.570687 (+ 101us) client_negotiation.cc:240] Negotiation successful
0808 04:42:54.570845 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":144}
I20260808 04:42:54.571492 3460 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:42:54.562103 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47936 (local address 127.20.240.252:46795)
0808 04:42:54.562203 (+ 100us) server_negotiation.cc:206] Beginning negotiation
0808 04:42:54.562207 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:42:54.562219 (+ 12us) server_negotiation.cc:407] Connection header received
0808 04:42:54.562253 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:42:54.562256 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:42:54.562295 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:42:54.562381 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:42:54.562885 (+ 504us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:42:54.563667 (+ 782us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:42:54.564639 (+ 972us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:42:54.564952 (+ 313us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:42:54.565033 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:42:54.567490 (+ 2457us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:42:54.567495 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:42:54.567500 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:42:54.567530 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:42:54.569294 (+ 1764us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:42:54.569760 (+ 466us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:42:54.569763 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:42:54.569764 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:42:54.569878 (+ 114us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:42:54.570152 (+ 274us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:42:54.570157 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:42:54.570161 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:42:54.570370 (+ 209us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:42:54.570461 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0808 04:42:54.571227 (+ 766us) server_negotiation.cc:299] Negotiation successful
0808 04:42:54.571348 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
W20260808 04:42:54.574311 3499 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 02655f2b250f4317a9055da1bc08085d: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 04:42:54.574395 3499 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 04:42:54.574638 3486 sys_catalog.cc:455] T 00000000000000000000000000000000 P 33cbd6d790e8405ba6a46f516ee92c25 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33cbd6d790e8405ba6a46f516ee92c25" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 38093 } } peers { permanent_uuid: "02655f2b250f4317a9055da1bc08085d" member_type: VOTER last_known_addr { host: "127.20.240.253" port: 41897 } } peers { permanent_uuid: "366dd9fe2a2746e590a235b915be43ec" member_type: VOTER last_known_addr { host: "127.20.240.252" port: 46795 } } }
I20260808 04:42:54.574796 3486 sys_catalog.cc:458] T 00000000000000000000000000000000 P 33cbd6d790e8405ba6a46f516ee92c25 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 04:42:54.574896 3486 raft_consensus.cc:482] T 00000000000000000000000000000000 P 33cbd6d790e8405ba6a46f516ee92c25 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 04:42:54.575023 3486 raft_consensus.cc:504] T 00000000000000000000000000000000 P 33cbd6d790e8405ba6a46f516ee92c25 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33cbd6d790e8405ba6a46f516ee92c25" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 38093 } } peers { permanent_uuid: "02655f2b250f4317a9055da1bc08085d" member_type: VOTER last_known_addr { host: "127.20.240.253" port: 41897 } } peers { permanent_uuid: "366dd9fe2a2746e590a235b915be43ec" member_type: VOTER last_known_addr { host: "127.20.240.252" port: 46795 } }
I20260808 04:42:54.575137 3378 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:42:54.562126 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55760 (local address 127.20.240.253:41897)
0808 04:42:54.562222 (+ 96us) server_negotiation.cc:206] Beginning negotiation
0808 04:42:54.562226 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:42:54.562424 (+ 198us) server_negotiation.cc:407] Connection header received
0808 04:42:54.562598 (+ 174us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:42:54.562601 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:42:54.562650 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:42:54.562702 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:42:54.563534 (+ 832us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:42:54.564265 (+ 731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:42:54.565346 (+ 1081us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:42:54.565696 (+ 350us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:42:54.565785 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:42:54.568829 (+ 3044us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:42:54.568833 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:42:54.568837 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:42:54.568867 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:42:54.573011 (+ 4144us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:42:54.573607 (+ 596us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:42:54.573611 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:42:54.573613 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:42:54.573719 (+ 106us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:42:54.574070 (+ 351us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:42:54.574077 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:42:54.574080 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:42:54.574304 (+ 224us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:42:54.574470 (+ 166us) server_negotiation.cc:1035] Waiting for connection context
0808 04:42:54.574862 (+ 392us) server_negotiation.cc:299] Negotiation successful
0808 04:42:54.574992 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260808 04:42:54.575151 3456 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 366dd9fe2a2746e590a235b915be43ec: Bootstrap starting.
I20260808 04:42:54.576448 3345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "33cbd6d790e8405ba6a46f516ee92c25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02655f2b250f4317a9055da1bc08085d" is_pre_election: true
I20260808 04:42:54.576650 3486 leader_election.cc:288] T 00000000000000000000000000000000 P 33cbd6d790e8405ba6a46f516ee92c25 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 02655f2b250f4317a9055da1bc08085d (127.20.240.253:41897), 366dd9fe2a2746e590a235b915be43ec (127.20.240.252:46795)
I20260808 04:42:54.576785 3345 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 02655f2b250f4317a9055da1bc08085d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33cbd6d790e8405ba6a46f516ee92c25 in term 0.
I20260808 04:42:54.577265 3238 leader_election.cc:302] T 00000000000000000000000000000000 P 33cbd6d790e8405ba6a46f516ee92c25 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02655f2b250f4317a9055da1bc08085d, 33cbd6d790e8405ba6a46f516ee92c25; no voters:
I20260808 04:42:54.578243 3470 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 33cbd6d790e8405ba6a46f516ee92c25 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 04:42:54.578338 3456 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 366dd9fe2a2746e590a235b915be43ec: Neither blocks nor log segments found. Creating new log.
I20260808 04:42:54.578367 3470 raft_consensus.cc:482] T 00000000000000000000000000000000 P 33cbd6d790e8405ba6a46f516ee92c25 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 04:42:54.578418 3470 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 33cbd6d790e8405ba6a46f516ee92c25 [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:42:54.579315 3456 log.cc:824] T 00000000000000000000000000000000 P 366dd9fe2a2746e590a235b915be43ec: Log is configured to *not* fsync() on all Append() calls
I20260808 04:42:54.579879 3470 raft_consensus.cc:504] T 00000000000000000000000000000000 P 33cbd6d790e8405ba6a46f516ee92c25 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33cbd6d790e8405ba6a46f516ee92c25" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 38093 } } peers { permanent_uuid: "02655f2b250f4317a9055da1bc08085d" member_type: VOTER last_known_addr { host: "127.20.240.253" port: 41897 } } peers { permanent_uuid: "366dd9fe2a2746e590a235b915be43ec" member_type: VOTER last_known_addr { host: "127.20.240.252" port: 46795 } }
I20260808 04:42:54.580644 3345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "33cbd6d790e8405ba6a46f516ee92c25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02655f2b250f4317a9055da1bc08085d"
I20260808 04:42:54.580778 3345 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 02655f2b250f4317a9055da1bc08085d [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:42:54.577081 3299 master_runner.cc:186] Error getting master registration for 127.20.240.252:46795: OK, instance_id { permanent_uuid: "366dd9fe2a2746e590a235b915be43ec" instance_seqno: 1786164174515277 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260808 04:42:54.582026 3299 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260808 04:42:54.582094 3484 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 33cbd6d790e8405ba6a46f516ee92c25: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 04:42:54.582170 3484 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 04:42:54.582238 3345 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 02655f2b250f4317a9055da1bc08085d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33cbd6d790e8405ba6a46f516ee92c25 in term 1.
I20260808 04:42:54.583719 3238 leader_election.cc:302] T 00000000000000000000000000000000 P 33cbd6d790e8405ba6a46f516ee92c25 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02655f2b250f4317a9055da1bc08085d, 33cbd6d790e8405ba6a46f516ee92c25; no voters:
I20260808 04:42:54.583921 3486 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 33cbd6d790e8405ba6a46f516ee92c25 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 04:42:54.584161 3486 raft_consensus.cc:686] T 00000000000000000000000000000000 P 33cbd6d790e8405ba6a46f516ee92c25 [term 1 LEADER]: Becoming Leader. State: Replica: 33cbd6d790e8405ba6a46f516ee92c25, State: Running, Role: LEADER
I20260808 04:42:54.584265 3456 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 366dd9fe2a2746e590a235b915be43ec: No bootstrap required, opened a new log
I20260808 04:42:54.584554 3486 consensus_queue.cc:237] T 00000000000000000000000000000000 P 33cbd6d790e8405ba6a46f516ee92c25 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33cbd6d790e8405ba6a46f516ee92c25" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 38093 } } peers { permanent_uuid: "02655f2b250f4317a9055da1bc08085d" member_type: VOTER last_known_addr { host: "127.20.240.253" port: 41897 } } peers { permanent_uuid: "366dd9fe2a2746e590a235b915be43ec" member_type: VOTER last_known_addr { host: "127.20.240.252" port: 46795 } }
I20260808 04:42:54.586402 3486 sys_catalog.cc:455] T 00000000000000000000000000000000 P 33cbd6d790e8405ba6a46f516ee92c25 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 33cbd6d790e8405ba6a46f516ee92c25. Latest consensus state: current_term: 1 leader_uuid: "33cbd6d790e8405ba6a46f516ee92c25" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33cbd6d790e8405ba6a46f516ee92c25" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 38093 } } peers { permanent_uuid: "02655f2b250f4317a9055da1bc08085d" member_type: VOTER last_known_addr { host: "127.20.240.253" port: 41897 } } peers { permanent_uuid: "366dd9fe2a2746e590a235b915be43ec" member_type: VOTER last_known_addr { host: "127.20.240.252" port: 46795 } } }
I20260808 04:42:54.586550 3486 sys_catalog.cc:458] T 00000000000000000000000000000000 P 33cbd6d790e8405ba6a46f516ee92c25 [sys.catalog]: This master's current role is: LEADER
I20260808 04:42:54.587930 3470 leader_election.cc:288] T 00000000000000000000000000000000 P 33cbd6d790e8405ba6a46f516ee92c25 [CANDIDATE]: Term 1 election: Requested vote from peers 02655f2b250f4317a9055da1bc08085d (127.20.240.253:41897), 366dd9fe2a2746e590a235b915be43ec (127.20.240.252:46795)
I20260808 04:42:54.588117 21443 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 04:42:54.588263 3506 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 04:42:54.588646 3456 raft_consensus.cc:348] T 00000000000000000000000000000000 P 366dd9fe2a2746e590a235b915be43ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33cbd6d790e8405ba6a46f516ee92c25" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 38093 } } peers { permanent_uuid: "02655f2b250f4317a9055da1bc08085d" member_type: VOTER last_known_addr { host: "127.20.240.253" port: 41897 } } peers { permanent_uuid: "366dd9fe2a2746e590a235b915be43ec" member_type: VOTER last_known_addr { host: "127.20.240.252" port: 46795 } }
I20260808 04:42:54.588922 3456 raft_consensus.cc:374] T 00000000000000000000000000000000 P 366dd9fe2a2746e590a235b915be43ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:42:54.588995 3456 raft_consensus.cc:729] T 00000000000000000000000000000000 P 366dd9fe2a2746e590a235b915be43ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 366dd9fe2a2746e590a235b915be43ec, State: Initialized, Role: FOLLOWER
I20260808 04:42:54.589399 3506 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 04:42:54.589555 3456 consensus_queue.cc:260] T 00000000000000000000000000000000 P 366dd9fe2a2746e590a235b915be43ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33cbd6d790e8405ba6a46f516ee92c25" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 38093 } } peers { permanent_uuid: "02655f2b250f4317a9055da1bc08085d" member_type: VOTER last_known_addr { host: "127.20.240.253" port: 41897 } } peers { permanent_uuid: "366dd9fe2a2746e590a235b915be43ec" member_type: VOTER last_known_addr { host: "127.20.240.252" port: 46795 } }
I20260808 04:42:54.591241 3456 sys_catalog.cc:564] T 00000000000000000000000000000000 P 366dd9fe2a2746e590a235b915be43ec [sys.catalog]: configured and running, proceeding with master startup.
I20260808 04:42:54.591315 3426 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "33cbd6d790e8405ba6a46f516ee92c25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "366dd9fe2a2746e590a235b915be43ec"
I20260808 04:42:54.591575 3426 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 366dd9fe2a2746e590a235b915be43ec [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:42:54.593645 3426 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 366dd9fe2a2746e590a235b915be43ec [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33cbd6d790e8405ba6a46f516ee92c25 in term 1.
I20260808 04:42:54.593930 3428 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "33cbd6d790e8405ba6a46f516ee92c25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "366dd9fe2a2746e590a235b915be43ec" is_pre_election: true
I20260808 04:42:54.594072 3428 raft_consensus.cc:2362] T 00000000000000000000000000000000 P 366dd9fe2a2746e590a235b915be43ec [term 1 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 33cbd6d790e8405ba6a46f516ee92c25 in term 1. Re-sending same reply.
I20260808 04:42:54.594208 3510 sys_catalog.cc:455] T 00000000000000000000000000000000 P 366dd9fe2a2746e590a235b915be43ec [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33cbd6d790e8405ba6a46f516ee92c25" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 38093 } } peers { permanent_uuid: "02655f2b250f4317a9055da1bc08085d" member_type: VOTER last_known_addr { host: "127.20.240.253" port: 41897 } } peers { permanent_uuid: "366dd9fe2a2746e590a235b915be43ec" member_type: VOTER last_known_addr { host: "127.20.240.252" port: 46795 } } }
I20260808 04:42:54.594376 3510 sys_catalog.cc:458] T 00000000000000000000000000000000 P 366dd9fe2a2746e590a235b915be43ec [sys.catalog]: This master's current role is: FOLLOWER
W20260808 04:42:54.598702 3525 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 366dd9fe2a2746e590a235b915be43ec: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 04:42:54.598815 3525 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 04:42:54.603264 3428 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 366dd9fe2a2746e590a235b915be43ec [term 1 FOLLOWER]: Refusing update from remote peer 33cbd6d790e8405ba6a46f516ee92c25: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 04:42:54.603621 3345 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 02655f2b250f4317a9055da1bc08085d [term 1 FOLLOWER]: Refusing update from remote peer 33cbd6d790e8405ba6a46f516ee92c25: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 04:42:54.603953 3470 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 33cbd6d790e8405ba6a46f516ee92c25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "366dd9fe2a2746e590a235b915be43ec" member_type: VOTER last_known_addr { host: "127.20.240.252" port: 46795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 04:42:54.604691 3470 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 33cbd6d790e8405ba6a46f516ee92c25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "02655f2b250f4317a9055da1bc08085d" member_type: VOTER last_known_addr { host: "127.20.240.253" port: 41897 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 04:42:54.608331 3485 sys_catalog.cc:455] T 00000000000000000000000000000000 P 02655f2b250f4317a9055da1bc08085d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 33cbd6d790e8405ba6a46f516ee92c25. Latest consensus state: current_term: 1 leader_uuid: "33cbd6d790e8405ba6a46f516ee92c25" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33cbd6d790e8405ba6a46f516ee92c25" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 38093 } } peers { permanent_uuid: "02655f2b250f4317a9055da1bc08085d" member_type: VOTER last_known_addr { host: "127.20.240.253" port: 41897 } } peers { permanent_uuid: "366dd9fe2a2746e590a235b915be43ec" member_type: VOTER last_known_addr { host: "127.20.240.252" port: 46795 } } }
I20260808 04:42:54.608346 3510 sys_catalog.cc:455] T 00000000000000000000000000000000 P 366dd9fe2a2746e590a235b915be43ec [sys.catalog]: SysCatalogTable state changed. Reason: New leader 33cbd6d790e8405ba6a46f516ee92c25. Latest consensus state: current_term: 1 leader_uuid: "33cbd6d790e8405ba6a46f516ee92c25" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33cbd6d790e8405ba6a46f516ee92c25" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 38093 } } peers { permanent_uuid: "02655f2b250f4317a9055da1bc08085d" member_type: VOTER last_known_addr { host: "127.20.240.253" port: 41897 } } peers { permanent_uuid: "366dd9fe2a2746e590a235b915be43ec" member_type: VOTER last_known_addr { host: "127.20.240.252" port: 46795 } } }
I20260808 04:42:54.608480 3510 sys_catalog.cc:458] T 00000000000000000000000000000000 P 366dd9fe2a2746e590a235b915be43ec [sys.catalog]: This master's current role is: FOLLOWER
I20260808 04:42:54.608480 3485 sys_catalog.cc:458] T 00000000000000000000000000000000 P 02655f2b250f4317a9055da1bc08085d [sys.catalog]: This master's current role is: FOLLOWER
I20260808 04:42:54.614670 3470 sys_catalog.cc:455] T 00000000000000000000000000000000 P 33cbd6d790e8405ba6a46f516ee92c25 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "33cbd6d790e8405ba6a46f516ee92c25" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33cbd6d790e8405ba6a46f516ee92c25" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 38093 } } peers { permanent_uuid: "02655f2b250f4317a9055da1bc08085d" member_type: VOTER last_known_addr { host: "127.20.240.253" port: 41897 } } peers { permanent_uuid: "366dd9fe2a2746e590a235b915be43ec" member_type: VOTER last_known_addr { host: "127.20.240.252" port: 46795 } } }
I20260808 04:42:54.614840 3470 sys_catalog.cc:458] T 00000000000000000000000000000000 P 33cbd6d790e8405ba6a46f516ee92c25 [sys.catalog]: This master's current role is: LEADER
I20260808 04:42:54.615458 3296 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:42:54.594346 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57970 (local address 127.20.240.254:38093)
0808 04:42:54.594490 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0808 04:42:54.594497 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 04:42:54.599155 (+ 4658us) server_negotiation.cc:407] Connection header received
0808 04:42:54.599361 (+ 206us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:42:54.599364 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:42:54.599417 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:42:54.599475 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:42:54.600649 (+ 1174us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:42:54.601500 (+ 851us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:42:54.602763 (+ 1263us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:42:54.603114 (+ 351us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:42:54.603196 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:42:54.607737 (+ 4541us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:42:54.607742 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:42:54.607745 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:42:54.607779 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:42:54.611204 (+ 3425us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:42:54.611750 (+ 546us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:42:54.611754 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:42:54.611756 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:42:54.611850 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:42:54.613301 (+ 1451us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:42:54.613305 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:42:54.613307 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:42:54.613567 (+ 260us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:42:54.613689 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0808 04:42:54.615140 (+ 1451us) server_negotiation.cc:299] Negotiation successful
0808 04:42:54.615294 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260808 04:42:54.615931 3486 sys_catalog.cc:455] T 00000000000000000000000000000000 P 33cbd6d790e8405ba6a46f516ee92c25 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "33cbd6d790e8405ba6a46f516ee92c25" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33cbd6d790e8405ba6a46f516ee92c25" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 38093 } } peers { permanent_uuid: "02655f2b250f4317a9055da1bc08085d" member_type: VOTER last_known_addr { host: "127.20.240.253" port: 41897 } } peers { permanent_uuid: "366dd9fe2a2746e590a235b915be43ec" member_type: VOTER last_known_addr { host: "127.20.240.252" port: 46795 } } }
I20260808 04:42:54.616057 3486 sys_catalog.cc:458] T 00000000000000000000000000000000 P 33cbd6d790e8405ba6a46f516ee92c25 [sys.catalog]: This master's current role is: LEADER
I20260808 04:42:54.616262 3510 sys_catalog.cc:455] T 00000000000000000000000000000000 P 366dd9fe2a2746e590a235b915be43ec [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "33cbd6d790e8405ba6a46f516ee92c25" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33cbd6d790e8405ba6a46f516ee92c25" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 38093 } } peers { permanent_uuid: "02655f2b250f4317a9055da1bc08085d" member_type: VOTER last_known_addr { host: "127.20.240.253" port: 41897 } } peers { permanent_uuid: "366dd9fe2a2746e590a235b915be43ec" member_type: VOTER last_known_addr { host: "127.20.240.252" port: 46795 } } }
I20260808 04:42:54.616410 3510 sys_catalog.cc:458] T 00000000000000000000000000000000 P 366dd9fe2a2746e590a235b915be43ec [sys.catalog]: This master's current role is: FOLLOWER
I20260808 04:42:54.616498 3513 mvcc.cc:205] Tried to move back new op lower bound from 7316128459149664256 to 7316128459101736960. Current Snapshot: MvccSnapshot[applied={T|T < 7316128459149664256}]
I20260808 04:42:54.618271 3485 sys_catalog.cc:455] T 00000000000000000000000000000000 P 02655f2b250f4317a9055da1bc08085d [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "33cbd6d790e8405ba6a46f516ee92c25" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33cbd6d790e8405ba6a46f516ee92c25" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 38093 } } peers { permanent_uuid: "02655f2b250f4317a9055da1bc08085d" member_type: VOTER last_known_addr { host: "127.20.240.253" port: 41897 } } peers { permanent_uuid: "366dd9fe2a2746e590a235b915be43ec" member_type: VOTER last_known_addr { host: "127.20.240.252" port: 46795 } } }
I20260808 04:42:54.618425 3485 sys_catalog.cc:458] T 00000000000000000000000000000000 P 02655f2b250f4317a9055da1bc08085d [sys.catalog]: This master's current role is: FOLLOWER
I20260808 04:42:54.619335 3531 mvcc.cc:205] Tried to move back new op lower bound from 7316128459149664256 to 7316128459101736960. Current Snapshot: MvccSnapshot[applied={T|T < 7316128459149664256}]
I20260808 04:42:54.619793 3530 mvcc.cc:205] Tried to move back new op lower bound from 7316128459149664256 to 7316128459101736960. Current Snapshot: MvccSnapshot[applied={T|T < 7316128459149664256}]
I20260808 04:42:54.623598 3506 catalog_manager.cc:1347] Generated new cluster ID: 6ba3adc987f843ab90d09418ea1bab94
I20260808 04:42:54.623675 3506 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 04:42:54.626845 3460 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:42:54.598883 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47952 (local address 127.20.240.252:46795)
0808 04:42:54.599002 (+ 119us) server_negotiation.cc:206] Beginning negotiation
0808 04:42:54.599007 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 04:42:54.605405 (+ 6398us) server_negotiation.cc:407] Connection header received
0808 04:42:54.606729 (+ 1324us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:42:54.606734 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:42:54.606788 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:42:54.606844 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:42:54.608192 (+ 1348us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:42:54.608995 (+ 803us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:42:54.617076 (+ 8081us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:42:54.617449 (+ 373us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:42:54.617532 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:42:54.620506 (+ 2974us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:42:54.620511 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:42:54.620514 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:42:54.620543 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:42:54.622655 (+ 2112us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:42:54.624310 (+ 1655us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:42:54.624314 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:42:54.624316 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:42:54.624406 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:42:54.625108 (+ 702us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:42:54.625112 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:42:54.625114 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:42:54.625366 (+ 252us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:42:54.625488 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0808 04:42:54.626534 (+ 1046us) server_negotiation.cc:299] Negotiation successful
0808 04:42:54.626673 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260808 04:42:54.627767 3378 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:42:54.595418 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55762 (local address 127.20.240.253:41897)
0808 04:42:54.595561 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0808 04:42:54.595568 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 04:42:54.603999 (+ 8431us) server_negotiation.cc:407] Connection header received
0808 04:42:54.605692 (+ 1693us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:42:54.605696 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:42:54.605749 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:42:54.605802 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:42:54.609567 (+ 3765us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:42:54.610367 (+ 800us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:42:54.616466 (+ 6099us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:42:54.616813 (+ 347us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:42:54.616899 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:42:54.620918 (+ 4019us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:42:54.620922 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:42:54.620925 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:42:54.620967 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:42:54.623455 (+ 2488us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:42:54.624723 (+ 1268us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:42:54.624727 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:42:54.624730 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:42:54.624813 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:42:54.625826 (+ 1013us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:42:54.625829 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:42:54.625831 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:42:54.626063 (+ 232us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:42:54.626162 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0808 04:42:54.627481 (+ 1319us) server_negotiation.cc:299] Negotiation successful
0808 04:42:54.627612 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260808 04:42:54.657078 3506 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 04:42:54.658509 3506 catalog_manager.cc:1504] Loading token signing keys...
I20260808 04:42:54.674799 3506 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 33cbd6d790e8405ba6a46f516ee92c25: Generated new TSK 0
I20260808 04:42:54.675848 3506 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 04:42:55.575721 3499 catalog_manager.cc:1259] Loaded cluster ID: 6ba3adc987f843ab90d09418ea1bab94
I20260808 04:42:55.575834 3499 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 02655f2b250f4317a9055da1bc08085d: loading cluster ID for follower catalog manager: success
I20260808 04:42:55.577906 3499 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 02655f2b250f4317a9055da1bc08085d: acquiring CA information for follower catalog manager: success
I20260808 04:42:55.579120 3499 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 02655f2b250f4317a9055da1bc08085d: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260808 04:42:55.600147 3525 catalog_manager.cc:1259] Loaded cluster ID: 6ba3adc987f843ab90d09418ea1bab94
I20260808 04:42:55.600278 3525 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 366dd9fe2a2746e590a235b915be43ec: loading cluster ID for follower catalog manager: success
I20260808 04:42:55.602097 3525 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 366dd9fe2a2746e590a235b915be43ec: acquiring CA information for follower catalog manager: success
I20260808 04:42:55.603299 3525 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 366dd9fe2a2746e590a235b915be43ec: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260808 04:42:55.749483 21443 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu with pid 3216
I20260808 04:42:55.757251 21443 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu with pid 3299
I20260808 04:42:55.764799 21443 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu with pid 3384
2026-08-08T04:42:55Z chronyd exiting
[ OK ] SecurityITest.IPKICACert (3172 ms)
[ RUN ] SecurityITest.IPKICACertWebServerEndPoints
Loading random data
Initializing database '/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786164000593138-21443-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 04:42:55 dist-test-slave-vxj2 krb5kdc[3545](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 04:42:55 dist-test-slave-vxj2 krb5kdc[3545](info): set up 2 sockets
Aug 08 04:42:55 dist-test-slave-vxj2 krb5kdc[3545](info): commencing operation
krb5kdc: starting...
W20260808 04:42:56.864169 21443 mini_kdc.cc:121] Time spent starting KDC: real 1.076s user 0.004s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786164000593138-21443-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786164000593138-21443-0/krb5kdc/test-user.keytab.
Aug 08 04:42:56 dist-test-slave-vxj2 krb5kdc[3545](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164176, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T04:42:56Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T04:42:56Z Disabled control of system clock
WARNING: no policy specified for kudu/127.20.240.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.240.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.240.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.254.keytab.
Entry for principal kudu/127.20.240.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.254.keytab.
I20260808 04:42:56.997658 21443 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
/tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786164000593138-21443-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786164000593138-21443-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786164000593138-21443-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786164000593138-21443-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.240.254:45155
--webserver_interface=127.20.240.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.254.keytab
--principal=kudu/127.20.240.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.240.212:36871
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.240.254:45155
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786164000593138-21443-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786164000593138-21443-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786164000593138-21443-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 04:42:57.111523 3560 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:42:57.111836 3560 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:42:57.111887 3560 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:42:57.116449 3560 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 04:42:57.116528 3560 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:42:57.116549 3560 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:42:57.116565 3560 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 04:42:57.116581 3560 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 04:42:57.122221 3560 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.240.212:36871
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786164000593138-21443-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786164000593138-21443-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.240.254:45155
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.254.keytab
--principal=kudu/127.20.240.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.240.254:45155
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786164000593138-21443-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.240.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3560
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786164000593138-21443-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 04:05:18 UTC on ccycloud.quasar-drfdgt.root.comops.site
build id 4574101
I20260808 04:42:57.123471 3560 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:42:57.124553 3560 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:42:57.133634 3565 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:42:57.133638 3566 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:42:57.133692 3560 server_base.cc:1034] running on GCE node
W20260808 04:42:57.133638 3568 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:42:57.134578 3560 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:42:57.135784 3560 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:42:57.136955 3560 hybrid_clock.cc:648] HybridClock initialized: now 1786164177136938 us; error 34 us; skew 500 ppm
Aug 08 04:42:57 dist-test-slave-vxj2 krb5kdc[3545](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164177, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.240.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:42:57.139845 3560 init.cc:377] Logged in from keytab as kudu/127.20.240.254@KRBTEST.COM (short username kudu)
I20260808 04:42:57.140816 3560 webserver.cc:460] Webserver started at http://127.20.240.254:36431/ using document root <none> and password file <none>
I20260808 04:42:57.141528 3560 fs_manager.cc:359] Metadata directory not provided
I20260808 04:42:57.141626 3560 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:42:57.141871 3560 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 04:42:57.144070 3560 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786164000593138-21443-0/minicluster-data/master-0/data/instance:
uuid: "6e141f2bddb6465cb0ab9fc75690ed98"
format_stamp: "Formatted at 2026-08-08 04:42:57 on dist-test-slave-vxj2"
server_key: "3d90aedffaafca1bf28b155c24b0df9e"
server_key_iv: "f631c4bc49caa7d4d37273992b1675f3"
server_key_version: "encryptionkey@0"
I20260808 04:42:57.144652 3560 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786164000593138-21443-0/minicluster-data/master-0/wal/instance:
uuid: "6e141f2bddb6465cb0ab9fc75690ed98"
format_stamp: "Formatted at 2026-08-08 04:42:57 on dist-test-slave-vxj2"
server_key: "3d90aedffaafca1bf28b155c24b0df9e"
server_key_iv: "f631c4bc49caa7d4d37273992b1675f3"
server_key_version: "encryptionkey@0"
I20260808 04:42:57.148474 3560 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260808 04:42:57.150986 3575 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:42:57.152169 3560 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20260808 04:42:57.152325 3560 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786164000593138-21443-0/minicluster-data/master-0/data,/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786164000593138-21443-0/minicluster-data/master-0/wal
uuid: "6e141f2bddb6465cb0ab9fc75690ed98"
format_stamp: "Formatted at 2026-08-08 04:42:57 on dist-test-slave-vxj2"
server_key: "3d90aedffaafca1bf28b155c24b0df9e"
server_key_iv: "f631c4bc49caa7d4d37273992b1675f3"
server_key_version: "encryptionkey@0"
I20260808 04:42:57.152441 3560 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786164000593138-21443-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786164000593138-21443-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786164000593138-21443-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:42:57.161883 3560 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:42:57.165071 3560 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:42:57.165351 3560 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:42:57.172670 3560 rpc_server.cc:307] RPC server started. Bound to: 127.20.240.254:45155
I20260808 04:42:57.172726 3635 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.240.254:45155 every 8 connection(s)
I20260808 04:42:57.173749 3560 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786164000593138-21443-0/minicluster-data/master-0/data/info.pb
I20260808 04:42:57.174966 21443 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu as pid 3560
I20260808 04:42:57.175094 21443 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786164000593138-21443-0/minicluster-data/master-0/wal/instance
I20260808 04:42:57.175410 21443 external_mini_cluster.cc:1428] Setting key 17ba84f5d085e031d8a13f760e9af5b4
I20260808 04:42:57.177304 3636 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:42:57.184316 3636 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6e141f2bddb6465cb0ab9fc75690ed98: Bootstrap starting.
Aug 08 04:42:57 dist-test-slave-vxj2 krb5kdc[3545](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164176, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.240.254@KRBTEST.COM
I20260808 04:42:57.187413 3636 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6e141f2bddb6465cb0ab9fc75690ed98: Neither blocks nor log segments found. Creating new log.
I20260808 04:42:57.188345 3636 log.cc:824] T 00000000000000000000000000000000 P 6e141f2bddb6465cb0ab9fc75690ed98: Log is configured to *not* fsync() on all Append() calls
I20260808 04:42:57.190979 3636 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6e141f2bddb6465cb0ab9fc75690ed98: No bootstrap required, opened a new log
I20260808 04:42:57.191386 3639 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:42:57.176791 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37866 (local address 127.20.240.254:45155)
0808 04:42:57.177254 (+ 463us) server_negotiation.cc:206] Beginning negotiation
0808 04:42:57.177273 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0808 04:42:57.177320 (+ 47us) server_negotiation.cc:407] Connection header received
0808 04:42:57.178182 (+ 862us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:42:57.178210 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:42:57.178629 (+ 419us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:42:57.179005 (+ 376us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:42:57.179733 (+ 728us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:42:57.181274 (+ 1541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:42:57.182196 (+ 922us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:42:57.182909 (+ 713us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:42:57.183080 (+ 171us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:42:57.185909 (+ 2829us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:42:57.185918 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:42:57.185934 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:42:57.185970 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:42:57.188024 (+ 2054us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:42:57.188499 (+ 475us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:42:57.188506 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:42:57.188512 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:42:57.188657 (+ 145us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:42:57.189027 (+ 370us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:42:57.189029 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:42:57.189031 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:42:57.189618 (+ 587us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:42:57.189805 (+ 187us) server_negotiation.cc:1035] Waiting for connection context
0808 04:42:57.190107 (+ 302us) server_negotiation.cc:299] Negotiation successful
0808 04:42:57.190427 (+ 320us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":291,"thread_start_us":118,"threads_started":1}
I20260808 04:42:57.194315 21443 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 04:42:57.195232 3636 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6e141f2bddb6465cb0ab9fc75690ed98 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6e141f2bddb6465cb0ab9fc75690ed98" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 45155 } }
I20260808 04:42:57.195528 3636 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6e141f2bddb6465cb0ab9fc75690ed98 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:42:57.195606 3636 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6e141f2bddb6465cb0ab9fc75690ed98 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e141f2bddb6465cb0ab9fc75690ed98, State: Initialized, Role: FOLLOWER
I20260808 04:42:57.196079 3636 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6e141f2bddb6465cb0ab9fc75690ed98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6e141f2bddb6465cb0ab9fc75690ed98" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 45155 } }
I20260808 04:42:57.196206 3636 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6e141f2bddb6465cb0ab9fc75690ed98 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 04:42:57.196290 3636 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6e141f2bddb6465cb0ab9fc75690ed98 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 04:42:57.196388 3636 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6e141f2bddb6465cb0ab9fc75690ed98 [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:42:57.197451 3636 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6e141f2bddb6465cb0ab9fc75690ed98 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6e141f2bddb6465cb0ab9fc75690ed98" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 45155 } }
I20260808 04:42:57.197788 3636 leader_election.cc:302] T 00000000000000000000000000000000 P 6e141f2bddb6465cb0ab9fc75690ed98 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6e141f2bddb6465cb0ab9fc75690ed98; no voters:
I20260808 04:42:57.198112 3636 leader_election.cc:288] T 00000000000000000000000000000000 P 6e141f2bddb6465cb0ab9fc75690ed98 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 04:42:57.198289 3642 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6e141f2bddb6465cb0ab9fc75690ed98 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 04:42:57.198560 3642 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6e141f2bddb6465cb0ab9fc75690ed98 [term 1 LEADER]: Becoming Leader. State: Replica: 6e141f2bddb6465cb0ab9fc75690ed98, State: Running, Role: LEADER
I20260808 04:42:57.198868 3642 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6e141f2bddb6465cb0ab9fc75690ed98 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6e141f2bddb6465cb0ab9fc75690ed98" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 45155 } }
I20260808 04:42:57.199456 3636 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6e141f2bddb6465cb0ab9fc75690ed98 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 04:42:57.200577 3643 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6e141f2bddb6465cb0ab9fc75690ed98 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6e141f2bddb6465cb0ab9fc75690ed98" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6e141f2bddb6465cb0ab9fc75690ed98" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 45155 } } }
I20260808 04:42:57.200723 3643 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6e141f2bddb6465cb0ab9fc75690ed98 [sys.catalog]: This master's current role is: LEADER
I20260808 04:42:57.200886 3645 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6e141f2bddb6465cb0ab9fc75690ed98 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6e141f2bddb6465cb0ab9fc75690ed98. Latest consensus state: current_term: 1 leader_uuid: "6e141f2bddb6465cb0ab9fc75690ed98" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6e141f2bddb6465cb0ab9fc75690ed98" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 45155 } } }
I20260808 04:42:57.201048 3645 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6e141f2bddb6465cb0ab9fc75690ed98 [sys.catalog]: This master's current role is: LEADER
I20260808 04:42:57.201393 3653 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 04:42:57.204176 3653 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 04:42:57.209846 3653 catalog_manager.cc:1347] Generated new cluster ID: de322c34062e4c548fa301eb9ec1b74c
I20260808 04:42:57.209951 3653 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 04:42:57.222493 3653 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 04:42:57.223892 3653 catalog_manager.cc:1504] Loading token signing keys...
I20260808 04:42:57.240283 3653 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6e141f2bddb6465cb0ab9fc75690ed98: Generated new TSK 0
I20260808 04:42:57.241285 3653 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 04:42:57.250414 21443 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu with pid 3560
2026-08-08T04:42:57Z chronyd exiting
[ OK ] SecurityITest.IPKICACertWebServerEndPoints (1482 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedIPKICert
Loading random data
Initializing database '/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164000593138-21443-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 04:42:57 dist-test-slave-vxj2 krb5kdc[3665](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 04:42:57 dist-test-slave-vxj2 krb5kdc[3665](info): set up 2 sockets
Aug 08 04:42:57 dist-test-slave-vxj2 krb5kdc[3665](info): commencing operation
krb5kdc: starting...
W20260808 04:42:58.344265 21443 mini_kdc.cc:121] Time spent starting KDC: real 1.073s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164000593138-21443-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164000593138-21443-0/krb5kdc/test-user.keytab.
Aug 08 04:42:58 dist-test-slave-vxj2 krb5kdc[3665](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164178, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T04:42:58Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T04:42:58Z Disabled control of system clock
WARNING: no policy specified for kudu/127.20.240.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.240.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.240.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.254.keytab.
Entry for principal kudu/127.20.240.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.254.keytab.
I20260808 04:42:58.480881 21443 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
/tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164000593138-21443-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164000593138-21443-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164000593138-21443-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164000593138-21443-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.240.254:46087
--webserver_interface=127.20.240.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.254.keytab
--principal=kudu/127.20.240.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.240.212:33995
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.240.254:46087
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164000593138-21443-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164000593138-21443-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164000593138-21443-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 04:42:58.595989 3681 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:42:58.596356 3681 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:42:58.596437 3681 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:42:58.600770 3681 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 04:42:58.600912 3681 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:42:58.600956 3681 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:42:58.600996 3681 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 04:42:58.601051 3681 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 04:42:58.607074 3681 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.240.212:33995
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164000593138-21443-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164000593138-21443-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.240.254:46087
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.254.keytab
--principal=kudu/127.20.240.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.240.254:46087
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164000593138-21443-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.240.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3681
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164000593138-21443-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 04:05:18 UTC on ccycloud.quasar-drfdgt.root.comops.site
build id 4574101
I20260808 04:42:58.608376 3681 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:42:58.609566 3681 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:42:58.619426 3686 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:42:58.619468 3687 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:42:58.619465 3689 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:42:58.619526 3681 server_base.cc:1034] running on GCE node
I20260808 04:42:58.620396 3681 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:42:58.621706 3681 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:42:58.622875 3681 hybrid_clock.cc:648] HybridClock initialized: now 1786164178622858 us; error 35 us; skew 500 ppm
Aug 08 04:42:58 dist-test-slave-vxj2 krb5kdc[3665](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164178, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.240.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:42:58.630360 3681 init.cc:377] Logged in from keytab as kudu/127.20.240.254@KRBTEST.COM (short username kudu)
I20260808 04:42:58.631500 3681 webserver.cc:460] Webserver started at http://127.20.240.254:44713/ using document root <none> and password file <none>
I20260808 04:42:58.632138 3681 fs_manager.cc:359] Metadata directory not provided
I20260808 04:42:58.632239 3681 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:42:58.632490 3681 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 04:42:58.634801 3681 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164000593138-21443-0/minicluster-data/master-0/data/instance:
uuid: "107010403a3944a09c963231a87a6b5e"
format_stamp: "Formatted at 2026-08-08 04:42:58 on dist-test-slave-vxj2"
server_key: "beb698de7980809b1080ce76fc69508b"
server_key_iv: "9fc98e5bf9bd0575b57f71b4511c5982"
server_key_version: "encryptionkey@0"
I20260808 04:42:58.635459 3681 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164000593138-21443-0/minicluster-data/master-0/wal/instance:
uuid: "107010403a3944a09c963231a87a6b5e"
format_stamp: "Formatted at 2026-08-08 04:42:58 on dist-test-slave-vxj2"
server_key: "beb698de7980809b1080ce76fc69508b"
server_key_iv: "9fc98e5bf9bd0575b57f71b4511c5982"
server_key_version: "encryptionkey@0"
I20260808 04:42:58.639591 3681 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260808 04:42:58.642302 3697 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:42:58.643564 3681 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 04:42:58.643723 3681 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164000593138-21443-0/minicluster-data/master-0/data,/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164000593138-21443-0/minicluster-data/master-0/wal
uuid: "107010403a3944a09c963231a87a6b5e"
format_stamp: "Formatted at 2026-08-08 04:42:58 on dist-test-slave-vxj2"
server_key: "beb698de7980809b1080ce76fc69508b"
server_key_iv: "9fc98e5bf9bd0575b57f71b4511c5982"
server_key_version: "encryptionkey@0"
I20260808 04:42:58.643888 3681 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164000593138-21443-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164000593138-21443-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164000593138-21443-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:42:58.669016 3681 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:42:58.672564 3681 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:42:58.672853 3681 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:42:58.680968 3681 rpc_server.cc:307] RPC server started. Bound to: 127.20.240.254:46087
I20260808 04:42:58.681412 3754 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.240.254:46087 every 8 connection(s)
I20260808 04:42:58.682132 3681 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164000593138-21443-0/minicluster-data/master-0/data/info.pb
I20260808 04:42:58.686216 3755 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:42:58.688627 21443 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu as pid 3681
I20260808 04:42:58.688787 21443 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164000593138-21443-0/minicluster-data/master-0/wal/instance
I20260808 04:42:58.689085 21443 external_mini_cluster.cc:1428] Setting key 949cb2f453aaaab13aaae45cd6437aa1
I20260808 04:42:58.695938 3755 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 107010403a3944a09c963231a87a6b5e: Bootstrap starting.
Aug 08 04:42:58 dist-test-slave-vxj2 krb5kdc[3665](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164178, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.240.254@KRBTEST.COM
I20260808 04:42:58.699801 3755 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 107010403a3944a09c963231a87a6b5e: Neither blocks nor log segments found. Creating new log.
I20260808 04:42:58.700914 3755 log.cc:824] T 00000000000000000000000000000000 P 107010403a3944a09c963231a87a6b5e: Log is configured to *not* fsync() on all Append() calls
I20260808 04:42:58.703670 3755 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 107010403a3944a09c963231a87a6b5e: No bootstrap required, opened a new log
I20260808 04:42:58.704569 3759 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:42:58.690704 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58936 (local address 127.20.240.254:46087)
0808 04:42:58.691157 (+ 453us) server_negotiation.cc:206] Beginning negotiation
0808 04:42:58.691182 (+ 25us) server_negotiation.cc:399] Waiting for connection header
0808 04:42:58.691220 (+ 38us) server_negotiation.cc:407] Connection header received
0808 04:42:58.691877 (+ 657us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:42:58.691894 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:42:58.692239 (+ 345us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:42:58.692590 (+ 351us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:42:58.693578 (+ 988us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:42:58.694619 (+ 1041us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:42:58.695528 (+ 909us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:42:58.696068 (+ 540us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:42:58.696287 (+ 219us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:42:58.699059 (+ 2772us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:42:58.699064 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:42:58.699079 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:42:58.699112 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:42:58.700948 (+ 1836us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:42:58.701529 (+ 581us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:42:58.701538 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:42:58.701545 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:42:58.701704 (+ 159us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:42:58.702122 (+ 418us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:42:58.702128 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:42:58.702133 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:42:58.702651 (+ 518us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:42:58.702866 (+ 215us) server_negotiation.cc:1035] Waiting for connection context
0808 04:42:58.703275 (+ 409us) server_negotiation.cc:299] Negotiation successful
0808 04:42:58.703591 (+ 316us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":298,"thread_start_us":155,"threads_started":1}
I20260808 04:42:58.708046 3755 raft_consensus.cc:348] T 00000000000000000000000000000000 P 107010403a3944a09c963231a87a6b5e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "107010403a3944a09c963231a87a6b5e" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 46087 } }
I20260808 04:42:58.708297 3755 raft_consensus.cc:374] T 00000000000000000000000000000000 P 107010403a3944a09c963231a87a6b5e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:42:58.708333 3755 raft_consensus.cc:729] T 00000000000000000000000000000000 P 107010403a3944a09c963231a87a6b5e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 107010403a3944a09c963231a87a6b5e, State: Initialized, Role: FOLLOWER
I20260808 04:42:58.708833 3755 consensus_queue.cc:260] T 00000000000000000000000000000000 P 107010403a3944a09c963231a87a6b5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "107010403a3944a09c963231a87a6b5e" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 46087 } }
I20260808 04:42:58.708966 3755 raft_consensus.cc:388] T 00000000000000000000000000000000 P 107010403a3944a09c963231a87a6b5e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 04:42:58.709081 3755 raft_consensus.cc:482] T 00000000000000000000000000000000 P 107010403a3944a09c963231a87a6b5e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 04:42:58.709225 3755 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 107010403a3944a09c963231a87a6b5e [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:42:58.710275 3755 raft_consensus.cc:504] T 00000000000000000000000000000000 P 107010403a3944a09c963231a87a6b5e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "107010403a3944a09c963231a87a6b5e" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 46087 } }
I20260808 04:42:58.710666 3755 leader_election.cc:302] T 00000000000000000000000000000000 P 107010403a3944a09c963231a87a6b5e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 107010403a3944a09c963231a87a6b5e; no voters:
I20260808 04:42:58.711057 3755 leader_election.cc:288] T 00000000000000000000000000000000 P 107010403a3944a09c963231a87a6b5e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 04:42:58.711191 3761 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 107010403a3944a09c963231a87a6b5e [term 1 FOLLOWER]: Leader election won for term 1
I20260808 04:42:58.711526 3761 raft_consensus.cc:686] T 00000000000000000000000000000000 P 107010403a3944a09c963231a87a6b5e [term 1 LEADER]: Becoming Leader. State: Replica: 107010403a3944a09c963231a87a6b5e, State: Running, Role: LEADER
I20260808 04:42:58.711933 3761 consensus_queue.cc:237] T 00000000000000000000000000000000 P 107010403a3944a09c963231a87a6b5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "107010403a3944a09c963231a87a6b5e" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 46087 } }
I20260808 04:42:58.712536 3755 sys_catalog.cc:564] T 00000000000000000000000000000000 P 107010403a3944a09c963231a87a6b5e [sys.catalog]: configured and running, proceeding with master startup.
I20260808 04:42:58.713989 3763 sys_catalog.cc:455] T 00000000000000000000000000000000 P 107010403a3944a09c963231a87a6b5e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 107010403a3944a09c963231a87a6b5e. Latest consensus state: current_term: 1 leader_uuid: "107010403a3944a09c963231a87a6b5e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "107010403a3944a09c963231a87a6b5e" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 46087 } } }
I20260808 04:42:58.713989 3762 sys_catalog.cc:455] T 00000000000000000000000000000000 P 107010403a3944a09c963231a87a6b5e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "107010403a3944a09c963231a87a6b5e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "107010403a3944a09c963231a87a6b5e" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 46087 } } }
I20260808 04:42:58.714164 3762 sys_catalog.cc:458] T 00000000000000000000000000000000 P 107010403a3944a09c963231a87a6b5e [sys.catalog]: This master's current role is: LEADER
I20260808 04:42:58.714164 3763 sys_catalog.cc:458] T 00000000000000000000000000000000 P 107010403a3944a09c963231a87a6b5e [sys.catalog]: This master's current role is: LEADER
W20260808 04:42:58.717983 3777 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 107010403a3944a09c963231a87a6b5e: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 04:42:58.718142 3777 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 04:42:58.718255 3773 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 04:42:58.719260 3773 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 04:42:58.726483 3773 catalog_manager.cc:1347] Generated new cluster ID: 011e5d9609d5482ab7bc89a7c86def27
I20260808 04:42:58.726568 3773 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 04:42:58.738906 3773 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 04:42:58.740247 3773 catalog_manager.cc:1504] Loading token signing keys...
I20260808 04:42:58.747686 3773 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 107010403a3944a09c963231a87a6b5e: Generated new TSK 0
I20260808 04:42:58.748726 3773 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.20.240.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.240.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.240.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.193.keytab.
Entry for principal kudu/127.20.240.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.193.keytab.
I20260808 04:42:58.790326 21443 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
/tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164000593138-21443-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164000593138-21443-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164000593138-21443-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164000593138-21443-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.240.193:0
--local_ip_for_outbound_sockets=127.20.240.193
--webserver_interface=127.20.240.193
--webserver_port=0
--tserver_master_addrs=127.20.240.254:46087
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.193.keytab
--principal=kudu/127.20.240.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.240.212:33995
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164000593138-21443-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164000593138-21443-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164000593138-21443-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 04:42:58.908031 3785 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:42:58.908345 3785 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:42:58.908392 3785 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:42:58.912793 3785 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:42:58.912873 3785 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:42:58.912976 3785 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.240.193
I20260808 04:42:58.918968 3785 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.240.212:33995
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164000593138-21443-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164000593138-21443-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.193.keytab
--principal=kudu/127.20.240.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.240.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164000593138-21443-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.240.193
--webserver_port=0
--tserver_master_addrs=127.20.240.254:46087
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3785
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.240.193
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164000593138-21443-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 04:05:18 UTC on ccycloud.quasar-drfdgt.root.comops.site
build id 4574101
I20260808 04:42:58.920154 3785 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:42:58.921263 3785 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:42:58.931648 3793 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:42:58.931686 3790 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:42:58.931703 3791 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:42:58.931957 3785 server_base.cc:1034] running on GCE node
I20260808 04:42:58.932403 3785 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:42:58.933091 3785 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:42:58.934331 3785 hybrid_clock.cc:648] HybridClock initialized: now 1786164178934312 us; error 30 us; skew 500 ppm
Aug 08 04:42:58 dist-test-slave-vxj2 krb5kdc[3665](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164178, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.240.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:42:58.937461 3785 init.cc:377] Logged in from keytab as kudu/127.20.240.193@KRBTEST.COM (short username kudu)
I20260808 04:42:58.938406 3785 webserver.cc:460] Webserver started at http://127.20.240.193:44435/ using document root <none> and password file <none>
I20260808 04:42:58.939013 3785 fs_manager.cc:359] Metadata directory not provided
I20260808 04:42:58.939080 3785 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:42:58.939307 3785 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 04:42:58.941515 3785 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164000593138-21443-0/minicluster-data/ts-0/data/instance:
uuid: "64fe25f92a054bcc9b2ff7cbf43af06d"
format_stamp: "Formatted at 2026-08-08 04:42:58 on dist-test-slave-vxj2"
server_key: "617e2dd309f1e1a1643be80f47ea13fe"
server_key_iv: "9e362114cf5b7100bae2cc4c3a257fe3"
server_key_version: "encryptionkey@0"
I20260808 04:42:58.942095 3785 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164000593138-21443-0/minicluster-data/ts-0/wal/instance:
uuid: "64fe25f92a054bcc9b2ff7cbf43af06d"
format_stamp: "Formatted at 2026-08-08 04:42:58 on dist-test-slave-vxj2"
server_key: "617e2dd309f1e1a1643be80f47ea13fe"
server_key_iv: "9e362114cf5b7100bae2cc4c3a257fe3"
server_key_version: "encryptionkey@0"
I20260808 04:42:58.945961 3785 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260808 04:42:58.948800 3800 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:42:58.950192 3785 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 04:42:58.950325 3785 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164000593138-21443-0/minicluster-data/ts-0/data,/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164000593138-21443-0/minicluster-data/ts-0/wal
uuid: "64fe25f92a054bcc9b2ff7cbf43af06d"
format_stamp: "Formatted at 2026-08-08 04:42:58 on dist-test-slave-vxj2"
server_key: "617e2dd309f1e1a1643be80f47ea13fe"
server_key_iv: "9e362114cf5b7100bae2cc4c3a257fe3"
server_key_version: "encryptionkey@0"
I20260808 04:42:58.950444 3785 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164000593138-21443-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164000593138-21443-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164000593138-21443-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:42:58.975600 3785 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:42:58.979313 3785 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:42:58.979501 3785 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:42:58.980089 3785 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 04:42:58.981019 3785 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 04:42:58.981098 3785 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 04:42:58.981200 3785 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 04:42:58.981253 3785 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 04:42:58.990617 3785 rpc_server.cc:307] RPC server started. Bound to: 127.20.240.193:42575
I20260808 04:42:58.990636 3926 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.240.193:42575 every 8 connection(s)
I20260808 04:42:58.991568 3785 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164000593138-21443-0/minicluster-data/ts-0/data/info.pb
I20260808 04:42:58.998281 21443 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu as pid 3785
I20260808 04:42:58.998402 21443 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164000593138-21443-0/minicluster-data/ts-0/wal/instance
I20260808 04:42:58.998710 21443 external_mini_cluster.cc:1428] Setting key 4b5407f923dbcb8b4e11c2256dc039d4
Aug 08 04:42:58 dist-test-slave-vxj2 krb5kdc[3665](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164178, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.240.193@KRBTEST.COM for kudu/127.20.240.254@KRBTEST.COM
I20260808 04:42:59.006306 3759 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:42:58.993488 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.240.193:54297 (local address 127.20.240.254:46087)
0808 04:42:58.993672 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0808 04:42:58.993676 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:42:58.994533 (+ 857us) server_negotiation.cc:407] Connection header received
0808 04:42:58.995878 (+ 1345us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:42:58.995881 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:42:58.995930 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:42:58.996009 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:42:58.997138 (+ 1129us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:42:58.997810 (+ 672us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:42:58.999154 (+ 1344us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:42:58.999395 (+ 241us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:42:58.999517 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:42:59.002514 (+ 2997us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:42:59.002518 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:42:59.002520 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:42:59.002545 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:42:59.004018 (+ 1473us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:42:59.004573 (+ 555us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:42:59.004577 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:42:59.004579 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:42:59.004668 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:42:59.005042 (+ 374us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:42:59.005047 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:42:59.005049 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:42:59.005312 (+ 263us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:42:59.005441 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0808 04:42:59.005981 (+ 540us) server_negotiation.cc:299] Negotiation successful
0808 04:42:59.006121 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260808 04:42:59.007191 3929 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:42:58.993884 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:46087 (local address 127.20.240.193:54297)
0808 04:42:58.994362 (+ 478us) negotiation.cc:107] Waiting for socket to connect
0808 04:42:58.994407 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0808 04:42:58.995671 (+ 1264us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:42:58.996139 (+ 468us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:42:58.996145 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:42:58.996504 (+ 359us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:42:58.996976 (+ 472us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:42:58.996989 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:42:58.997947 (+ 958us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:42:58.997951 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:42:58.999011 (+ 1060us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:42:58.999021 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:42:58.999575 (+ 554us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:42:58.999579 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:42:58.999754 (+ 175us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:42:59.000353 (+ 599us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:42:59.000371 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:42:59.002330 (+ 1959us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:42:59.004152 (+ 1822us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:42:59.004158 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:42:59.004174 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:42:59.004458 (+ 284us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:42:59.004766 (+ 308us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:42:59.004778 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:42:59.004781 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:42:59.004941 (+ 160us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:42:59.005428 (+ 487us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:42:59.005435 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:42:59.005728 (+ 293us) client_negotiation.cc:769] Sending connection context
0808 04:42:59.005939 (+ 211us) client_negotiation.cc:240] Negotiation successful
0808 04:42:59.006288 (+ 349us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":289,"thread_start_us":127,"threads_started":1}
WARNING: no policy specified for kudu/127.20.240.194@KRBTEST.COM; defaulting to no policy
I20260808 04:42:59.008571 3927 heartbeater.cc:347] Connected to a master server at 127.20.240.254:46087
I20260808 04:42:59.008862 3927 heartbeater.cc:464] Registering TS with master...
I20260808 04:42:59.009495 3927 heartbeater.cc:511] Master 127.20.240.254:46087 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.240.194@KRBTEST.COM" created.
I20260808 04:42:59.011240 3716 ts_manager.cc:194] Registered new tserver with Master: 64fe25f92a054bcc9b2ff7cbf43af06d (127.20.240.193:42575)
I20260808 04:42:59.012878 3716 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.240.193@KRBTEST.COM'} at 127.20.240.193:54297
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.240.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.194.keytab.
Entry for principal kudu/127.20.240.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.194.keytab.
I20260808 04:42:59.028904 21443 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
/tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164000593138-21443-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164000593138-21443-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164000593138-21443-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164000593138-21443-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.240.194:0
--local_ip_for_outbound_sockets=127.20.240.194
--webserver_interface=127.20.240.194
--webserver_port=0
--tserver_master_addrs=127.20.240.254:46087
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.194.keytab
--principal=kudu/127.20.240.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.240.212:33995
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164000593138-21443-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164000593138-21443-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164000593138-21443-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 04:42:59.144224 3932 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:42:59.144518 3932 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:42:59.144567 3932 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:42:59.149065 3932 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:42:59.149164 3932 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:42:59.149309 3932 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.240.194
I20260808 04:42:59.155169 3932 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.240.212:33995
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164000593138-21443-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164000593138-21443-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.194.keytab
--principal=kudu/127.20.240.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.240.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164000593138-21443-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.240.194
--webserver_port=0
--tserver_master_addrs=127.20.240.254:46087
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3932
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.240.194
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164000593138-21443-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 04:05:18 UTC on ccycloud.quasar-drfdgt.root.comops.site
build id 4574101
I20260808 04:42:59.156438 3932 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:42:59.157639 3932 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:42:59.168099 3938 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:42:59.168272 3932 server_base.cc:1034] running on GCE node
W20260808 04:42:59.168159 3940 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:42:59.168166 3937 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:42:59.168820 3932 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:42:59.169577 3932 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:42:59.170764 3932 hybrid_clock.cc:648] HybridClock initialized: now 1786164179170740 us; error 33 us; skew 500 ppm
Aug 08 04:42:59 dist-test-slave-vxj2 krb5kdc[3665](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164179, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.240.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:42:59.173974 3932 init.cc:377] Logged in from keytab as kudu/127.20.240.194@KRBTEST.COM (short username kudu)
I20260808 04:42:59.175052 3932 webserver.cc:460] Webserver started at http://127.20.240.194:38461/ using document root <none> and password file <none>
I20260808 04:42:59.175717 3932 fs_manager.cc:359] Metadata directory not provided
I20260808 04:42:59.175812 3932 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:42:59.176065 3932 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 04:42:59.178375 3932 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164000593138-21443-0/minicluster-data/ts-1/data/instance:
uuid: "3859384e3bed4d3c88c284d01ecf71be"
format_stamp: "Formatted at 2026-08-08 04:42:59 on dist-test-slave-vxj2"
server_key: "18344e6552b0a41168d36d0de9cedceb"
server_key_iv: "abfe9930238821ce0e5e1b2719c68012"
server_key_version: "encryptionkey@0"
I20260808 04:42:59.179006 3932 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164000593138-21443-0/minicluster-data/ts-1/wal/instance:
uuid: "3859384e3bed4d3c88c284d01ecf71be"
format_stamp: "Formatted at 2026-08-08 04:42:59 on dist-test-slave-vxj2"
server_key: "18344e6552b0a41168d36d0de9cedceb"
server_key_iv: "abfe9930238821ce0e5e1b2719c68012"
server_key_version: "encryptionkey@0"
I20260808 04:42:59.183074 3932 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260808 04:42:59.185678 3948 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:42:59.186995 3932 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 04:42:59.187140 3932 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164000593138-21443-0/minicluster-data/ts-1/data,/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164000593138-21443-0/minicluster-data/ts-1/wal
uuid: "3859384e3bed4d3c88c284d01ecf71be"
format_stamp: "Formatted at 2026-08-08 04:42:59 on dist-test-slave-vxj2"
server_key: "18344e6552b0a41168d36d0de9cedceb"
server_key_iv: "abfe9930238821ce0e5e1b2719c68012"
server_key_version: "encryptionkey@0"
I20260808 04:42:59.187263 3932 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164000593138-21443-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164000593138-21443-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164000593138-21443-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:42:59.208223 3932 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:42:59.211619 3932 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:42:59.211851 3932 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:42:59.212602 3932 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 04:42:59.213719 3932 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 04:42:59.213804 3932 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 04:42:59.213876 3932 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 04:42:59.213904 3932 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 04:42:59.223824 3932 rpc_server.cc:307] RPC server started. Bound to: 127.20.240.194:34749
I20260808 04:42:59.223851 4069 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.240.194:34749 every 8 connection(s)
I20260808 04:42:59.224809 3932 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164000593138-21443-0/minicluster-data/ts-1/data/info.pb
I20260808 04:42:59.226655 21443 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu as pid 3932
I20260808 04:42:59.226815 21443 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164000593138-21443-0/minicluster-data/ts-1/wal/instance
I20260808 04:42:59.227162 21443 external_mini_cluster.cc:1428] Setting key 321e644f789a8e3b42f94727c3e4f6c1
Aug 08 04:42:59 dist-test-slave-vxj2 krb5kdc[3665](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164179, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.240.194@KRBTEST.COM for kudu/127.20.240.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.20.240.195@KRBTEST.COM; defaulting to no policy
I20260808 04:42:59.241670 3759 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:42:59.226968 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.240.194:49275 (local address 127.20.240.254:46087)
0808 04:42:59.227146 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0808 04:42:59.227151 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 04:42:59.228536 (+ 1385us) server_negotiation.cc:407] Connection header received
0808 04:42:59.230587 (+ 2051us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:42:59.230590 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:42:59.230638 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:42:59.230728 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:42:59.232178 (+ 1450us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:42:59.232723 (+ 545us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:42:59.234068 (+ 1345us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:42:59.234312 (+ 244us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:42:59.234437 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:42:59.237484 (+ 3047us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:42:59.237488 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:42:59.237491 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:42:59.237527 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:42:59.239278 (+ 1751us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:42:59.239920 (+ 642us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:42:59.239924 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:42:59.239925 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:42:59.240016 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:42:59.240414 (+ 398us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:42:59.240417 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:42:59.240418 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:42:59.240625 (+ 207us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:42:59.240728 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0808 04:42:59.241353 (+ 625us) server_negotiation.cc:299] Negotiation successful
0808 04:42:59.241509 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.240.195@KRBTEST.COM" created.
I20260808 04:42:59.242666 4072 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:42:59.227455 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:46087 (local address 127.20.240.194:49275)
0808 04:42:59.228346 (+ 891us) negotiation.cc:107] Waiting for socket to connect
0808 04:42:59.228409 (+ 63us) client_negotiation.cc:174] Beginning negotiation
0808 04:42:59.230322 (+ 1913us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:42:59.230958 (+ 636us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:42:59.230972 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:42:59.231485 (+ 513us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:42:59.232004 (+ 519us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:42:59.232018 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:42:59.232871 (+ 853us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:42:59.232874 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:42:59.233856 (+ 982us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:42:59.233866 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:42:59.234484 (+ 618us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:42:59.234489 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:42:59.234669 (+ 180us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:42:59.235330 (+ 661us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:42:59.235359 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:42:59.237260 (+ 1901us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:42:59.239436 (+ 2176us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:42:59.239442 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:42:59.239469 (+ 27us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:42:59.239771 (+ 302us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:42:59.240116 (+ 345us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:42:59.240118 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:42:59.240120 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:42:59.240268 (+ 148us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:42:59.240730 (+ 462us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:42:59.240735 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:42:59.241024 (+ 289us) client_negotiation.cc:769] Sending connection context
0808 04:42:59.241248 (+ 224us) client_negotiation.cc:240] Negotiation successful
0808 04:42:59.241610 (+ 362us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":646,"thread_start_us":159,"threads_started":1}
I20260808 04:42:59.244057 4070 heartbeater.cc:347] Connected to a master server at 127.20.240.254:46087
I20260808 04:42:59.244375 4070 heartbeater.cc:464] Registering TS with master...
I20260808 04:42:59.244971 4070 heartbeater.cc:511] Master 127.20.240.254:46087 requested a full tablet report, sending...
I20260808 04:42:59.246258 3716 ts_manager.cc:194] Registered new tserver with Master: 3859384e3bed4d3c88c284d01ecf71be (127.20.240.194:34749)
I20260808 04:42:59.247169 3716 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.240.194@KRBTEST.COM'} at 127.20.240.194:49275
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.240.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.195.keytab.
Entry for principal kudu/127.20.240.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.195.keytab.
I20260808 04:42:59.261858 21443 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
/tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164000593138-21443-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164000593138-21443-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164000593138-21443-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164000593138-21443-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.240.195:0
--local_ip_for_outbound_sockets=127.20.240.195
--webserver_interface=127.20.240.195
--webserver_port=0
--tserver_master_addrs=127.20.240.254:46087
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.195.keytab
--principal=kudu/127.20.240.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.240.212:33995
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164000593138-21443-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164000593138-21443-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164000593138-21443-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 04:42:59.379521 4075 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:42:59.379837 4075 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:42:59.379884 4075 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:42:59.387058 4075 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:42:59.387140 4075 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:42:59.387238 4075 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.240.195
I20260808 04:42:59.393128 4075 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.240.212:33995
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164000593138-21443-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164000593138-21443-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.195.keytab
--principal=kudu/127.20.240.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.240.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164000593138-21443-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.240.195
--webserver_port=0
--tserver_master_addrs=127.20.240.254:46087
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4075
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.240.195
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164000593138-21443-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 04:05:18 UTC on ccycloud.quasar-drfdgt.root.comops.site
build id 4574101
I20260808 04:42:59.394414 4075 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:42:59.395488 4075 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:42:59.405499 4083 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:42:59.405489 4081 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:42:59.405779 4075 server_base.cc:1034] running on GCE node
W20260808 04:42:59.405503 4085 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:42:59.406316 4075 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:42:59.407058 4075 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:42:59.408236 4075 hybrid_clock.cc:648] HybridClock initialized: now 1786164179408216 us; error 34 us; skew 500 ppm
Aug 08 04:42:59 dist-test-slave-vxj2 krb5kdc[3665](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164179, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.240.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:42:59.415709 4075 init.cc:377] Logged in from keytab as kudu/127.20.240.195@KRBTEST.COM (short username kudu)
I20260808 04:42:59.416791 4075 webserver.cc:460] Webserver started at http://127.20.240.195:43451/ using document root <none> and password file <none>
I20260808 04:42:59.417480 4075 fs_manager.cc:359] Metadata directory not provided
I20260808 04:42:59.417557 4075 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:42:59.417826 4075 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 04:42:59.420033 4075 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164000593138-21443-0/minicluster-data/ts-2/data/instance:
uuid: "0217252a13be4e29a06a3278372656a5"
format_stamp: "Formatted at 2026-08-08 04:42:59 on dist-test-slave-vxj2"
server_key: "dbb37e4962e56d7a3085312d70520474"
server_key_iv: "a8c14e10faac394df636ac2af53cca90"
server_key_version: "encryptionkey@0"
I20260808 04:42:59.420629 4075 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164000593138-21443-0/minicluster-data/ts-2/wal/instance:
uuid: "0217252a13be4e29a06a3278372656a5"
format_stamp: "Formatted at 2026-08-08 04:42:59 on dist-test-slave-vxj2"
server_key: "dbb37e4962e56d7a3085312d70520474"
server_key_iv: "a8c14e10faac394df636ac2af53cca90"
server_key_version: "encryptionkey@0"
I20260808 04:42:59.424585 4075 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260808 04:42:59.427284 4092 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:42:59.428715 4075 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260808 04:42:59.428884 4075 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164000593138-21443-0/minicluster-data/ts-2/data,/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164000593138-21443-0/minicluster-data/ts-2/wal
uuid: "0217252a13be4e29a06a3278372656a5"
format_stamp: "Formatted at 2026-08-08 04:42:59 on dist-test-slave-vxj2"
server_key: "dbb37e4962e56d7a3085312d70520474"
server_key_iv: "a8c14e10faac394df636ac2af53cca90"
server_key_version: "encryptionkey@0"
I20260808 04:42:59.429010 4075 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164000593138-21443-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164000593138-21443-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164000593138-21443-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:42:59.439567 4075 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:42:59.442863 4075 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:42:59.443079 4075 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:42:59.443715 4075 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 04:42:59.444593 4075 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 04:42:59.444667 4075 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 04:42:59.444736 4075 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 04:42:59.444785 4075 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 04:42:59.454682 4075 rpc_server.cc:307] RPC server started. Bound to: 127.20.240.195:45275
I20260808 04:42:59.454727 4218 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.240.195:45275 every 8 connection(s)
I20260808 04:42:59.455713 4075 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164000593138-21443-0/minicluster-data/ts-2/data/info.pb
I20260808 04:42:59.459268 21443 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu as pid 4075
I20260808 04:42:59.459389 21443 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164000593138-21443-0/minicluster-data/ts-2/wal/instance
I20260808 04:42:59.459681 21443 external_mini_cluster.cc:1428] Setting key f199546348cf47501aaf1b075a782e5e
Aug 08 04:42:59 dist-test-slave-vxj2 krb5kdc[3665](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164179, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.240.195@KRBTEST.COM for kudu/127.20.240.254@KRBTEST.COM
I20260808 04:42:59.470752 3759 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:42:59.457731 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.240.195:58863 (local address 127.20.240.254:46087)
0808 04:42:59.457886 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0808 04:42:59.457890 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:42:59.458760 (+ 870us) server_negotiation.cc:407] Connection header received
0808 04:42:59.460338 (+ 1578us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:42:59.460343 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:42:59.460400 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:42:59.460507 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:42:59.462190 (+ 1683us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:42:59.462749 (+ 559us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:42:59.463928 (+ 1179us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:42:59.464142 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:42:59.464228 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:42:59.466968 (+ 2740us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:42:59.466972 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:42:59.466974 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:42:59.467003 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:42:59.468568 (+ 1565us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:42:59.469106 (+ 538us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:42:59.469108 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:42:59.469109 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:42:59.469204 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:42:59.469651 (+ 447us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:42:59.469654 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:42:59.469656 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:42:59.469856 (+ 200us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:42:59.469939 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0808 04:42:59.470506 (+ 567us) server_negotiation.cc:299] Negotiation successful
0808 04:42:59.470616 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260808 04:42:59.471758 4221 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:42:59.458126 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:46087 (local address 127.20.240.195:58863)
0808 04:42:59.458583 (+ 457us) negotiation.cc:107] Waiting for socket to connect
0808 04:42:59.458629 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0808 04:42:59.460084 (+ 1455us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:42:59.460728 (+ 644us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:42:59.460739 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:42:59.461280 (+ 541us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:42:59.462014 (+ 734us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:42:59.462039 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:42:59.462913 (+ 874us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:42:59.462915 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:42:59.463812 (+ 897us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:42:59.463822 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:42:59.464278 (+ 456us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:42:59.464281 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:42:59.464448 (+ 167us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:42:59.465043 (+ 595us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:42:59.465070 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:42:59.466767 (+ 1697us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:42:59.468693 (+ 1926us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:42:59.468699 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:42:59.468713 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:42:59.468994 (+ 281us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:42:59.469305 (+ 311us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:42:59.469308 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:42:59.469310 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:42:59.469544 (+ 234us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:42:59.469955 (+ 411us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:42:59.469962 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:42:59.470251 (+ 289us) client_negotiation.cc:769] Sending connection context
0808 04:42:59.470462 (+ 211us) client_negotiation.cc:240] Negotiation successful
0808 04:42:59.470771 (+ 309us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":271,"thread_start_us":112,"threads_started":1}
I20260808 04:42:59.473165 4219 heartbeater.cc:347] Connected to a master server at 127.20.240.254:46087
I20260808 04:42:59.473429 4219 heartbeater.cc:464] Registering TS with master...
I20260808 04:42:59.474092 4219 heartbeater.cc:511] Master 127.20.240.254:46087 requested a full tablet report, sending...
I20260808 04:42:59.475136 3716 ts_manager.cc:194] Registered new tserver with Master: 0217252a13be4e29a06a3278372656a5 (127.20.240.195:45275)
I20260808 04:42:59.475734 3716 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.240.195@KRBTEST.COM'} at 127.20.240.195:58863
I20260808 04:42:59.486313 21443 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 04:42:59.496680 3759 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:42:59.488674 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58948 (local address 127.20.240.254:46087)
0808 04:42:59.488815 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0808 04:42:59.488819 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:42:59.489009 (+ 190us) server_negotiation.cc:407] Connection header received
0808 04:42:59.489123 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:42:59.489125 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:42:59.489234 (+ 109us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:42:59.489315 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:42:59.490092 (+ 777us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:42:59.490719 (+ 627us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:42:59.491612 (+ 893us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:42:59.491831 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:42:59.491910 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:42:59.493660 (+ 1750us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:42:59.493663 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:42:59.493665 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:42:59.493690 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:42:59.495155 (+ 1465us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:42:59.495536 (+ 381us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:42:59.495538 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:42:59.495540 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:42:59.495612 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:42:59.495832 (+ 220us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:42:59.495834 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:42:59.495835 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:42:59.496057 (+ 222us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:42:59.496162 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0808 04:42:59.496358 (+ 196us) server_negotiation.cc:299] Negotiation successful
0808 04:42:59.496464 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260808 04:42:59.499806 3716 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58948:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 04:42:59.502997 3716 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 04:42:59.518352 4234 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:42:59.512031 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.194:34749 (local address 127.0.0.1:40706)
0808 04:42:59.512719 (+ 688us) negotiation.cc:107] Waiting for socket to connect
0808 04:42:59.512773 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0808 04:42:59.512903 (+ 130us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:42:59.514082 (+ 1179us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:42:59.514091 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:42:59.514120 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 04:42:59.514266 (+ 146us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:42:59.514273 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:42:59.515478 (+ 1205us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:42:59.515482 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:42:59.516654 (+ 1172us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:42:59.516665 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:42:59.517734 (+ 1069us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:42:59.517738 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:42:59.517848 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:42:59.517886 (+ 38us) client_negotiation.cc:769] Sending connection context
0808 04:42:59.518042 (+ 156us) client_negotiation.cc:240] Negotiation successful
0808 04:42:59.518179 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":503,"thread_start_us":69,"threads_started":1}
I20260808 04:42:59.518358 4233 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:42:59.512253 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40706 (local address 127.20.240.194:34749)
0808 04:42:59.513246 (+ 993us) server_negotiation.cc:206] Beginning negotiation
0808 04:42:59.513258 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 04:42:59.513285 (+ 27us) server_negotiation.cc:407] Connection header received
0808 04:42:59.513369 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:42:59.513374 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:42:59.513662 (+ 288us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:42:59.513877 (+ 215us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 04:42:59.514403 (+ 526us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:42:59.515342 (+ 939us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:42:59.516796 (+ 1454us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:42:59.517605 (+ 809us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:42:59.517748 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:42:59.517894 (+ 146us) server_negotiation.cc:1035] Waiting for connection context
0808 04:42:59.518075 (+ 181us) server_negotiation.cc:299] Negotiation successful
0808 04:42:59.518179 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":865,"thread_start_us":169,"threads_started":1}
I20260808 04:42:59.519057 4231 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:42:59.512298 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.195:45275 (local address 127.0.0.1:35984)
0808 04:42:59.512862 (+ 564us) negotiation.cc:107] Waiting for socket to connect
0808 04:42:59.512879 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 04:42:59.512981 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:42:59.514377 (+ 1396us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:42:59.514382 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:42:59.514423 (+ 41us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 04:42:59.514519 (+ 96us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:42:59.514525 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:42:59.516082 (+ 1557us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:42:59.516086 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:42:59.517218 (+ 1132us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:42:59.517228 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:42:59.518626 (+ 1398us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:42:59.518630 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:42:59.518723 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:42:59.518748 (+ 25us) client_negotiation.cc:769] Sending connection context
0808 04:42:59.518831 (+ 83us) client_negotiation.cc:240] Negotiation successful
0808 04:42:59.518921 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":483,"thread_start_us":142,"threads_started":1}
I20260808 04:42:59.519207 4236 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:42:59.512950 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35984 (local address 127.20.240.195:45275)
0808 04:42:59.513728 (+ 778us) server_negotiation.cc:206] Beginning negotiation
0808 04:42:59.513749 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0808 04:42:59.513821 (+ 72us) server_negotiation.cc:407] Connection header received
0808 04:42:59.513963 (+ 142us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:42:59.513968 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:42:59.514200 (+ 232us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:42:59.514366 (+ 166us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 04:42:59.514645 (+ 279us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:42:59.515933 (+ 1288us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:42:59.517358 (+ 1425us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:42:59.518162 (+ 804us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:42:59.518291 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:42:59.518408 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0808 04:42:59.518897 (+ 489us) server_negotiation.cc:299] Negotiation successful
0808 04:42:59.519034 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":664,"thread_start_us":228,"threads_started":1}
I20260808 04:42:59.520071 4235 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:42:59.512734 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.193:42575 (local address 127.0.0.1:44916)
0808 04:42:59.513556 (+ 822us) negotiation.cc:107] Waiting for socket to connect
0808 04:42:59.513570 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 04:42:59.513660 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:42:59.514198 (+ 538us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:42:59.514202 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:42:59.514231 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 04:42:59.514401 (+ 170us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:42:59.514411 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:42:59.516264 (+ 1853us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:42:59.516268 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:42:59.517611 (+ 1343us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:42:59.517622 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:42:59.519120 (+ 1498us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:42:59.519124 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:42:59.519519 (+ 395us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:42:59.519544 (+ 25us) client_negotiation.cc:769] Sending connection context
0808 04:42:59.519618 (+ 74us) client_negotiation.cc:240] Negotiation successful
0808 04:42:59.519689 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":764,"thread_start_us":91,"threads_started":1}
I20260808 04:42:59.521715 4238 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:42:59.513195 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44916 (local address 127.20.240.193:42575)
0808 04:42:59.513504 (+ 309us) server_negotiation.cc:206] Beginning negotiation
0808 04:42:59.513511 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 04:42:59.513768 (+ 257us) server_negotiation.cc:407] Connection header received
0808 04:42:59.513852 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:42:59.513857 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:42:59.514048 (+ 191us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:42:59.514197 (+ 149us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 04:42:59.514560 (+ 363us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:42:59.515933 (+ 1373us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:42:59.517763 (+ 1830us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:42:59.518829 (+ 1066us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:42:59.518937 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:42:59.519054 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0808 04:42:59.521463 (+ 2409us) server_negotiation.cc:299] Negotiation successful
0808 04:42:59.521573 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":199,"thread_start_us":98,"threads_started":1}
I20260808 04:42:59.522250 4001 tablet_service.cc:1467] Processing CreateTablet for tablet fcdbba7e6a5e45208b62716926755eac (DEFAULT_TABLE table=test-table [id=7592a7816d6d4798a5b62a8df7d577a0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 04:42:59.522257 4147 tablet_service.cc:1467] Processing CreateTablet for tablet fcdbba7e6a5e45208b62716926755eac (DEFAULT_TABLE table=test-table [id=7592a7816d6d4798a5b62a8df7d577a0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 04:42:59.523243 4001 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fcdbba7e6a5e45208b62716926755eac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:42:59.523252 4147 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fcdbba7e6a5e45208b62716926755eac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:42:59.530102 4240 tablet_bootstrap.cc:492] T fcdbba7e6a5e45208b62716926755eac P 0217252a13be4e29a06a3278372656a5: Bootstrap starting.
I20260808 04:42:59.531529 3852 tablet_service.cc:1467] Processing CreateTablet for tablet fcdbba7e6a5e45208b62716926755eac (DEFAULT_TABLE table=test-table [id=7592a7816d6d4798a5b62a8df7d577a0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 04:42:59.532454 4240 tablet_bootstrap.cc:654] T fcdbba7e6a5e45208b62716926755eac P 0217252a13be4e29a06a3278372656a5: Neither blocks nor log segments found. Creating new log.
I20260808 04:42:59.532529 3852 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fcdbba7e6a5e45208b62716926755eac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:42:59.533602 4239 tablet_bootstrap.cc:492] T fcdbba7e6a5e45208b62716926755eac P 3859384e3bed4d3c88c284d01ecf71be: Bootstrap starting.
I20260808 04:42:59.533766 4240 log.cc:824] T fcdbba7e6a5e45208b62716926755eac P 0217252a13be4e29a06a3278372656a5: Log is configured to *not* fsync() on all Append() calls
I20260808 04:42:59.536113 4240 tablet_bootstrap.cc:492] T fcdbba7e6a5e45208b62716926755eac P 0217252a13be4e29a06a3278372656a5: No bootstrap required, opened a new log
I20260808 04:42:59.536330 4240 ts_tablet_manager.cc:1397] T fcdbba7e6a5e45208b62716926755eac P 0217252a13be4e29a06a3278372656a5: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260808 04:42:59.536846 4239 tablet_bootstrap.cc:654] T fcdbba7e6a5e45208b62716926755eac P 3859384e3bed4d3c88c284d01ecf71be: Neither blocks nor log segments found. Creating new log.
I20260808 04:42:59.537740 4239 log.cc:824] T fcdbba7e6a5e45208b62716926755eac P 3859384e3bed4d3c88c284d01ecf71be: Log is configured to *not* fsync() on all Append() calls
I20260808 04:42:59.539458 4245 tablet_bootstrap.cc:492] T fcdbba7e6a5e45208b62716926755eac P 64fe25f92a054bcc9b2ff7cbf43af06d: Bootstrap starting.
I20260808 04:42:59.539975 4239 tablet_bootstrap.cc:492] T fcdbba7e6a5e45208b62716926755eac P 3859384e3bed4d3c88c284d01ecf71be: No bootstrap required, opened a new log
I20260808 04:42:59.540184 4239 ts_tablet_manager.cc:1397] T fcdbba7e6a5e45208b62716926755eac P 3859384e3bed4d3c88c284d01ecf71be: Time spent bootstrapping tablet: real 0.007s user 0.005s sys 0.000s
I20260808 04:42:59.540397 4240 raft_consensus.cc:348] T fcdbba7e6a5e45208b62716926755eac P 0217252a13be4e29a06a3278372656a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3859384e3bed4d3c88c284d01ecf71be" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 34749 } } peers { permanent_uuid: "0217252a13be4e29a06a3278372656a5" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 45275 } } peers { permanent_uuid: "64fe25f92a054bcc9b2ff7cbf43af06d" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 42575 } }
I20260808 04:42:59.540686 4240 raft_consensus.cc:374] T fcdbba7e6a5e45208b62716926755eac P 0217252a13be4e29a06a3278372656a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:42:59.540745 4240 raft_consensus.cc:729] T fcdbba7e6a5e45208b62716926755eac P 0217252a13be4e29a06a3278372656a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0217252a13be4e29a06a3278372656a5, State: Initialized, Role: FOLLOWER
I20260808 04:42:59.541242 4240 consensus_queue.cc:260] T fcdbba7e6a5e45208b62716926755eac P 0217252a13be4e29a06a3278372656a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3859384e3bed4d3c88c284d01ecf71be" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 34749 } } peers { permanent_uuid: "0217252a13be4e29a06a3278372656a5" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 45275 } } peers { permanent_uuid: "64fe25f92a054bcc9b2ff7cbf43af06d" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 42575 } }
I20260808 04:42:59.542300 4240 ts_tablet_manager.cc:1428] T fcdbba7e6a5e45208b62716926755eac P 0217252a13be4e29a06a3278372656a5: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20260808 04:42:59.542466 4219 heartbeater.cc:503] Master 127.20.240.254:46087 was elected leader, sending a full tablet report...
I20260808 04:42:59.542591 4245 tablet_bootstrap.cc:654] T fcdbba7e6a5e45208b62716926755eac P 64fe25f92a054bcc9b2ff7cbf43af06d: Neither blocks nor log segments found. Creating new log.
I20260808 04:42:59.543460 4245 log.cc:824] T fcdbba7e6a5e45208b62716926755eac P 64fe25f92a054bcc9b2ff7cbf43af06d: Log is configured to *not* fsync() on all Append() calls
I20260808 04:42:59.543920 4239 raft_consensus.cc:348] T fcdbba7e6a5e45208b62716926755eac P 3859384e3bed4d3c88c284d01ecf71be [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3859384e3bed4d3c88c284d01ecf71be" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 34749 } } peers { permanent_uuid: "0217252a13be4e29a06a3278372656a5" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 45275 } } peers { permanent_uuid: "64fe25f92a054bcc9b2ff7cbf43af06d" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 42575 } }
I20260808 04:42:59.544220 4239 raft_consensus.cc:374] T fcdbba7e6a5e45208b62716926755eac P 3859384e3bed4d3c88c284d01ecf71be [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:42:59.544286 4239 raft_consensus.cc:729] T fcdbba7e6a5e45208b62716926755eac P 3859384e3bed4d3c88c284d01ecf71be [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3859384e3bed4d3c88c284d01ecf71be, State: Initialized, Role: FOLLOWER
I20260808 04:42:59.544736 4239 consensus_queue.cc:260] T fcdbba7e6a5e45208b62716926755eac P 3859384e3bed4d3c88c284d01ecf71be [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3859384e3bed4d3c88c284d01ecf71be" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 34749 } } peers { permanent_uuid: "0217252a13be4e29a06a3278372656a5" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 45275 } } peers { permanent_uuid: "64fe25f92a054bcc9b2ff7cbf43af06d" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 42575 } }
I20260808 04:42:59.545502 4070 heartbeater.cc:503] Master 127.20.240.254:46087 was elected leader, sending a full tablet report...
I20260808 04:42:59.545637 4245 tablet_bootstrap.cc:492] T fcdbba7e6a5e45208b62716926755eac P 64fe25f92a054bcc9b2ff7cbf43af06d: No bootstrap required, opened a new log
I20260808 04:42:59.545830 4245 ts_tablet_manager.cc:1397] T fcdbba7e6a5e45208b62716926755eac P 64fe25f92a054bcc9b2ff7cbf43af06d: Time spent bootstrapping tablet: real 0.007s user 0.005s sys 0.000s
I20260808 04:42:59.545876 4239 ts_tablet_manager.cc:1428] T fcdbba7e6a5e45208b62716926755eac P 3859384e3bed4d3c88c284d01ecf71be: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20260808 04:42:59.550288 4245 raft_consensus.cc:348] T fcdbba7e6a5e45208b62716926755eac P 64fe25f92a054bcc9b2ff7cbf43af06d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3859384e3bed4d3c88c284d01ecf71be" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 34749 } } peers { permanent_uuid: "0217252a13be4e29a06a3278372656a5" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 45275 } } peers { permanent_uuid: "64fe25f92a054bcc9b2ff7cbf43af06d" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 42575 } }
I20260808 04:42:59.550562 4245 raft_consensus.cc:374] T fcdbba7e6a5e45208b62716926755eac P 64fe25f92a054bcc9b2ff7cbf43af06d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:42:59.550638 4245 raft_consensus.cc:729] T fcdbba7e6a5e45208b62716926755eac P 64fe25f92a054bcc9b2ff7cbf43af06d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 64fe25f92a054bcc9b2ff7cbf43af06d, State: Initialized, Role: FOLLOWER
I20260808 04:42:59.551100 4245 consensus_queue.cc:260] T fcdbba7e6a5e45208b62716926755eac P 64fe25f92a054bcc9b2ff7cbf43af06d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3859384e3bed4d3c88c284d01ecf71be" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 34749 } } peers { permanent_uuid: "0217252a13be4e29a06a3278372656a5" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 45275 } } peers { permanent_uuid: "64fe25f92a054bcc9b2ff7cbf43af06d" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 42575 } }
I20260808 04:42:59.551784 3927 heartbeater.cc:503] Master 127.20.240.254:46087 was elected leader, sending a full tablet report...
I20260808 04:42:59.552078 4245 ts_tablet_manager.cc:1428] T fcdbba7e6a5e45208b62716926755eac P 64fe25f92a054bcc9b2ff7cbf43af06d: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260808 04:42:59.595813 4248 raft_consensus.cc:482] T fcdbba7e6a5e45208b62716926755eac P 3859384e3bed4d3c88c284d01ecf71be [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 04:42:59.596027 4248 raft_consensus.cc:504] T fcdbba7e6a5e45208b62716926755eac P 3859384e3bed4d3c88c284d01ecf71be [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3859384e3bed4d3c88c284d01ecf71be" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 34749 } } peers { permanent_uuid: "0217252a13be4e29a06a3278372656a5" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 45275 } } peers { permanent_uuid: "64fe25f92a054bcc9b2ff7cbf43af06d" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 42575 } }
I20260808 04:42:59.597262 4248 leader_election.cc:288] T fcdbba7e6a5e45208b62716926755eac P 3859384e3bed4d3c88c284d01ecf71be [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0217252a13be4e29a06a3278372656a5 (127.20.240.195:45275), 64fe25f92a054bcc9b2ff7cbf43af06d (127.20.240.193:42575)
I20260808 04:42:59.601922 4252 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:42:59.597479 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.195:45275 (local address 127.20.240.194:50653)
0808 04:42:59.597934 (+ 455us) negotiation.cc:107] Waiting for socket to connect
0808 04:42:59.597945 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 04:42:59.598054 (+ 109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:42:59.598337 (+ 283us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:42:59.598340 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:42:59.598357 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 04:42:59.598454 (+ 97us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:42:59.598458 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:42:59.599360 (+ 902us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:42:59.599363 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:42:59.600523 (+ 1160us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:42:59.600529 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:42:59.601469 (+ 940us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:42:59.601473 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:42:59.601582 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:42:59.601609 (+ 27us) client_negotiation.cc:769] Sending connection context
0808 04:42:59.601691 (+ 82us) client_negotiation.cc:240] Negotiation successful
0808 04:42:59.601762 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":383,"mutex_wait_us":18,"thread_start_us":139,"threads_started":1}
I20260808 04:42:59.601992 4236 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:42:59.597674 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.240.194:50653 (local address 127.20.240.195:45275)
0808 04:42:59.597814 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0808 04:42:59.597818 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:42:59.598031 (+ 213us) server_negotiation.cc:407] Connection header received
0808 04:42:59.598166 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:42:59.598169 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:42:59.598217 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:42:59.598307 (+ 90us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 04:42:59.598559 (+ 252us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:42:59.599266 (+ 707us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:42:59.600656 (+ 1390us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:42:59.601315 (+ 659us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:42:59.601450 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:42:59.601506 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0808 04:42:59.601727 (+ 221us) server_negotiation.cc:299] Negotiation successful
0808 04:42:59.601855 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260808 04:42:59.602070 4072 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:42:59.597451 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.193:42575 (local address 127.20.240.194:40845)
0808 04:42:59.597663 (+ 212us) negotiation.cc:107] Waiting for socket to connect
0808 04:42:59.597679 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 04:42:59.597779 (+ 100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:42:59.598055 (+ 276us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:42:59.598058 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:42:59.598073 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 04:42:59.598208 (+ 135us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:42:59.598213 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:42:59.599194 (+ 981us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:42:59.599197 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:42:59.600501 (+ 1304us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:42:59.600514 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:42:59.601574 (+ 1060us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:42:59.601580 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:42:59.601713 (+ 133us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:42:59.601738 (+ 25us) client_negotiation.cc:769] Sending connection context
0808 04:42:59.601811 (+ 73us) client_negotiation.cc:240] Negotiation successful
0808 04:42:59.601880 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":110,"mutex_wait_us":27}
I20260808 04:42:59.602186 4238 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:42:59.597622 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.240.194:40845 (local address 127.20.240.193:42575)
0808 04:42:59.597752 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0808 04:42:59.597758 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 04:42:59.597776 (+ 18us) server_negotiation.cc:407] Connection header received
0808 04:42:59.597903 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:42:59.597905 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:42:59.597947 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:42:59.598043 (+ 96us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 04:42:59.598316 (+ 273us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:42:59.599084 (+ 768us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:42:59.600656 (+ 1572us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:42:59.601343 (+ 687us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:42:59.601449 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:42:59.601511 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0808 04:42:59.601975 (+ 464us) server_negotiation.cc:299] Negotiation successful
0808 04:42:59.602064 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260808 04:42:59.602612 4169 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fcdbba7e6a5e45208b62716926755eac" candidate_uuid: "3859384e3bed4d3c88c284d01ecf71be" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0217252a13be4e29a06a3278372656a5" is_pre_election: true
I20260808 04:42:59.602774 3877 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fcdbba7e6a5e45208b62716926755eac" candidate_uuid: "3859384e3bed4d3c88c284d01ecf71be" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "64fe25f92a054bcc9b2ff7cbf43af06d" is_pre_election: true
I20260808 04:42:59.602954 4169 raft_consensus.cc:2454] T fcdbba7e6a5e45208b62716926755eac P 0217252a13be4e29a06a3278372656a5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3859384e3bed4d3c88c284d01ecf71be in term 0.
I20260808 04:42:59.603092 3877 raft_consensus.cc:2454] T fcdbba7e6a5e45208b62716926755eac P 64fe25f92a054bcc9b2ff7cbf43af06d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3859384e3bed4d3c88c284d01ecf71be in term 0.
I20260808 04:42:59.603456 3949 leader_election.cc:302] T fcdbba7e6a5e45208b62716926755eac P 3859384e3bed4d3c88c284d01ecf71be [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0217252a13be4e29a06a3278372656a5, 3859384e3bed4d3c88c284d01ecf71be; no voters:
I20260808 04:42:59.603758 4248 raft_consensus.cc:2781] T fcdbba7e6a5e45208b62716926755eac P 3859384e3bed4d3c88c284d01ecf71be [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 04:42:59.603847 4248 raft_consensus.cc:482] T fcdbba7e6a5e45208b62716926755eac P 3859384e3bed4d3c88c284d01ecf71be [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 04:42:59.603893 4248 raft_consensus.cc:3037] T fcdbba7e6a5e45208b62716926755eac P 3859384e3bed4d3c88c284d01ecf71be [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:42:59.604961 4248 raft_consensus.cc:504] T fcdbba7e6a5e45208b62716926755eac P 3859384e3bed4d3c88c284d01ecf71be [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3859384e3bed4d3c88c284d01ecf71be" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 34749 } } peers { permanent_uuid: "0217252a13be4e29a06a3278372656a5" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 45275 } } peers { permanent_uuid: "64fe25f92a054bcc9b2ff7cbf43af06d" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 42575 } }
I20260808 04:42:59.605360 4248 leader_election.cc:288] T fcdbba7e6a5e45208b62716926755eac P 3859384e3bed4d3c88c284d01ecf71be [CANDIDATE]: Term 1 election: Requested vote from peers 0217252a13be4e29a06a3278372656a5 (127.20.240.195:45275), 64fe25f92a054bcc9b2ff7cbf43af06d (127.20.240.193:42575)
I20260808 04:42:59.605711 4169 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fcdbba7e6a5e45208b62716926755eac" candidate_uuid: "3859384e3bed4d3c88c284d01ecf71be" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0217252a13be4e29a06a3278372656a5"
I20260808 04:42:59.605800 3877 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fcdbba7e6a5e45208b62716926755eac" candidate_uuid: "3859384e3bed4d3c88c284d01ecf71be" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "64fe25f92a054bcc9b2ff7cbf43af06d"
I20260808 04:42:59.605842 4169 raft_consensus.cc:3037] T fcdbba7e6a5e45208b62716926755eac P 0217252a13be4e29a06a3278372656a5 [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:42:59.605957 3877 raft_consensus.cc:3037] T fcdbba7e6a5e45208b62716926755eac P 64fe25f92a054bcc9b2ff7cbf43af06d [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:42:59.606989 4169 raft_consensus.cc:2454] T fcdbba7e6a5e45208b62716926755eac P 0217252a13be4e29a06a3278372656a5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3859384e3bed4d3c88c284d01ecf71be in term 1.
I20260808 04:42:59.607120 3877 raft_consensus.cc:2454] T fcdbba7e6a5e45208b62716926755eac P 64fe25f92a054bcc9b2ff7cbf43af06d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3859384e3bed4d3c88c284d01ecf71be in term 1.
I20260808 04:42:59.607298 3949 leader_election.cc:302] T fcdbba7e6a5e45208b62716926755eac P 3859384e3bed4d3c88c284d01ecf71be [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0217252a13be4e29a06a3278372656a5, 3859384e3bed4d3c88c284d01ecf71be; no voters:
I20260808 04:42:59.607558 4248 raft_consensus.cc:2781] T fcdbba7e6a5e45208b62716926755eac P 3859384e3bed4d3c88c284d01ecf71be [term 1 FOLLOWER]: Leader election won for term 1
I20260808 04:42:59.607836 4248 raft_consensus.cc:686] T fcdbba7e6a5e45208b62716926755eac P 3859384e3bed4d3c88c284d01ecf71be [term 1 LEADER]: Becoming Leader. State: Replica: 3859384e3bed4d3c88c284d01ecf71be, State: Running, Role: LEADER
I20260808 04:42:59.608207 4248 consensus_queue.cc:237] T fcdbba7e6a5e45208b62716926755eac P 3859384e3bed4d3c88c284d01ecf71be [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3859384e3bed4d3c88c284d01ecf71be" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 34749 } } peers { permanent_uuid: "0217252a13be4e29a06a3278372656a5" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 45275 } } peers { permanent_uuid: "64fe25f92a054bcc9b2ff7cbf43af06d" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 42575 } }
I20260808 04:42:59.614521 3716 catalog_manager.cc:5495] T fcdbba7e6a5e45208b62716926755eac P 3859384e3bed4d3c88c284d01ecf71be reported cstate change: term changed from 0 to 1, leader changed from <none> to 3859384e3bed4d3c88c284d01ecf71be (127.20.240.194). New cstate: current_term: 1 leader_uuid: "3859384e3bed4d3c88c284d01ecf71be" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3859384e3bed4d3c88c284d01ecf71be" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 34749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0217252a13be4e29a06a3278372656a5" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 45275 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "64fe25f92a054bcc9b2ff7cbf43af06d" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 42575 } health_report { overall_health: UNKNOWN } } }
I20260808 04:42:59.645062 4233 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:42:59.639875 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40718 (local address 127.20.240.194:34749)
0808 04:42:59.640036 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0808 04:42:59.640044 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 04:42:59.640065 (+ 21us) server_negotiation.cc:407] Connection header received
0808 04:42:59.640164 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:42:59.640168 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:42:59.640272 (+ 104us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:42:59.640403 (+ 131us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 04:42:59.640715 (+ 312us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:42:59.641651 (+ 936us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:42:59.642925 (+ 1274us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:42:59.643351 (+ 426us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:42:59.643517 (+ 166us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:42:59.643899 (+ 382us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 04:42:59.644557 (+ 658us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 04:42:59.644697 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0808 04:42:59.644791 (+ 94us) server_negotiation.cc:299] Negotiation successful
0808 04:42:59.644869 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260808 04:42:59.652607 4169 raft_consensus.cc:1261] T fcdbba7e6a5e45208b62716926755eac P 0217252a13be4e29a06a3278372656a5 [term 1 FOLLOWER]: Refusing update from remote peer 3859384e3bed4d3c88c284d01ecf71be: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 04:42:59.652607 3877 raft_consensus.cc:1261] T fcdbba7e6a5e45208b62716926755eac P 64fe25f92a054bcc9b2ff7cbf43af06d [term 1 FOLLOWER]: Refusing update from remote peer 3859384e3bed4d3c88c284d01ecf71be: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 04:42:59.653554 4253 consensus_queue.cc:1035] T fcdbba7e6a5e45208b62716926755eac P 3859384e3bed4d3c88c284d01ecf71be [LEADER]: Connected to new peer: Peer: permanent_uuid: "64fe25f92a054bcc9b2ff7cbf43af06d" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 42575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 04:42:59.653797 4248 consensus_queue.cc:1035] T fcdbba7e6a5e45208b62716926755eac P 3859384e3bed4d3c88c284d01ecf71be [LEADER]: Connected to new peer: Peer: permanent_uuid: "0217252a13be4e29a06a3278372656a5" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 04:42:59.665328 4258 mvcc.cc:205] Tried to move back new op lower bound from 7316128479848685568 to 7316128479678701568. Current Snapshot: MvccSnapshot[applied={T|T < 7316128479848685568}]
I20260808 04:42:59.671314 3716 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58948:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 04:42:59.671522 3716 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58948:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 04:42:59.674400 3716 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 107010403a3944a09c963231a87a6b5e: Sending DeleteTablet for 3 replicas of tablet fcdbba7e6a5e45208b62716926755eac
I20260808 04:42:59.675283 4001 tablet_service.cc:1514] Processing DeleteTablet for tablet fcdbba7e6a5e45208b62716926755eac with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 04:42:59 UTC) from {username='kudu', principal='kudu/127.20.240.254@KRBTEST.COM'} at 127.0.0.1:40706
I20260808 04:42:59.675324 4147 tablet_service.cc:1514] Processing DeleteTablet for tablet fcdbba7e6a5e45208b62716926755eac with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 04:42:59 UTC) from {username='kudu', principal='kudu/127.20.240.254@KRBTEST.COM'} at 127.0.0.1:35984
I20260808 04:42:59.675427 3852 tablet_service.cc:1514] Processing DeleteTablet for tablet fcdbba7e6a5e45208b62716926755eac with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 04:42:59 UTC) from {username='kudu', principal='kudu/127.20.240.254@KRBTEST.COM'} at 127.0.0.1:44916
I20260808 04:42:59.676043 4270 tablet_replica.cc:330] T fcdbba7e6a5e45208b62716926755eac P 64fe25f92a054bcc9b2ff7cbf43af06d: stopping tablet replica
I20260808 04:42:59.676193 21443 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu with pid 3785
I20260808 04:42:59.676246 4268 tablet_replica.cc:330] T fcdbba7e6a5e45208b62716926755eac P 3859384e3bed4d3c88c284d01ecf71be: stopping tablet replica
I20260808 04:42:59.676419 4270 raft_consensus.cc:2229] T fcdbba7e6a5e45208b62716926755eac P 64fe25f92a054bcc9b2ff7cbf43af06d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 04:42:59.676544 4268 raft_consensus.cc:2229] T fcdbba7e6a5e45208b62716926755eac P 3859384e3bed4d3c88c284d01ecf71be [term 1 LEADER]: Raft consensus shutting down.
I20260808 04:42:59.676903 4268 raft_consensus.cc:2258] T fcdbba7e6a5e45208b62716926755eac P 3859384e3bed4d3c88c284d01ecf71be [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 04:42:59.678591 4268 ts_tablet_manager.cc:1905] T fcdbba7e6a5e45208b62716926755eac P 3859384e3bed4d3c88c284d01ecf71be: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 04:42:59.677470 4269 tablet_replica.cc:330] T fcdbba7e6a5e45208b62716926755eac P 0217252a13be4e29a06a3278372656a5: stopping tablet replica
I20260808 04:42:59.681519 4269 raft_consensus.cc:2229] T fcdbba7e6a5e45208b62716926755eac P 0217252a13be4e29a06a3278372656a5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 04:42:59.681847 4269 raft_consensus.cc:2258] T fcdbba7e6a5e45208b62716926755eac P 0217252a13be4e29a06a3278372656a5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 04:42:59.682405 4268 ts_tablet_manager.cc:1918] T fcdbba7e6a5e45208b62716926755eac P 3859384e3bed4d3c88c284d01ecf71be: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 04:42:59.682497 4268 log.cc:1196] T fcdbba7e6a5e45208b62716926755eac P 3859384e3bed4d3c88c284d01ecf71be: Deleting WAL directory at /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164000593138-21443-0/minicluster-data/ts-1/wal/wals/fcdbba7e6a5e45208b62716926755eac
I20260808 04:42:59.682832 4268 ts_tablet_manager.cc:1939] T fcdbba7e6a5e45208b62716926755eac P 3859384e3bed4d3c88c284d01ecf71be: Deleting consensus metadata
I20260808 04:42:59.685963 4269 ts_tablet_manager.cc:1905] T fcdbba7e6a5e45208b62716926755eac P 0217252a13be4e29a06a3278372656a5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 04:42:59.687409 3701 catalog_manager.cc:4841] TS 3859384e3bed4d3c88c284d01ecf71be (127.20.240.194:34749): tablet fcdbba7e6a5e45208b62716926755eac (table test-table [id=7592a7816d6d4798a5b62a8df7d577a0]) successfully deleted
I20260808 04:42:59.688918 4269 ts_tablet_manager.cc:1918] T fcdbba7e6a5e45208b62716926755eac P 0217252a13be4e29a06a3278372656a5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 04:42:59.689031 4269 log.cc:1196] T fcdbba7e6a5e45208b62716926755eac P 0217252a13be4e29a06a3278372656a5: Deleting WAL directory at /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164000593138-21443-0/minicluster-data/ts-2/wal/wals/fcdbba7e6a5e45208b62716926755eac
I20260808 04:42:59.689720 4269 ts_tablet_manager.cc:1939] T fcdbba7e6a5e45208b62716926755eac P 0217252a13be4e29a06a3278372656a5: Deleting consensus metadata
I20260808 04:42:59.691202 3698 catalog_manager.cc:4841] TS 0217252a13be4e29a06a3278372656a5 (127.20.240.195:45275): tablet fcdbba7e6a5e45208b62716926755eac (table test-table [id=7592a7816d6d4798a5b62a8df7d577a0]) successfully deleted
W20260808 04:42:59.694278 3700 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.20.240.193:42575 (error 108)
I20260808 04:42:59.694541 21443 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu with pid 3932
I20260808 04:42:59.696431 4235 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:42:59.695947 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.193:42575 (local address 127.0.0.1:44926)
0808 04:42:59.696256 (+ 309us) negotiation.cc:107] Waiting for socket to connect
0808 04:42:59.696332 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.240.193:42575: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":211}
W20260808 04:42:59.697412 3700 catalog_manager.cc:4584] TS 64fe25f92a054bcc9b2ff7cbf43af06d (127.20.240.193:42575): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet fcdbba7e6a5e45208b62716926755eac: Network error: Client connection negotiation failed: client connection to 127.20.240.193:42575: connect: Connection refused (error 111)
I20260808 04:42:59.701416 21443 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu with pid 4075
I20260808 04:42:59.711961 21443 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu with pid 3681
I20260808 04:42:59.719471 21443 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
/tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164000593138-21443-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164000593138-21443-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164000593138-21443-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164000593138-21443-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.240.254:46087
--webserver_interface=127.20.240.254
--webserver_port=44713
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.254.keytab
--principal=kudu/127.20.240.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.240.212:33995
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.240.254:46087
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--ipki_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164000593138-21443-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164000593138-21443-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164000593138-21443-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 04:42:59.832772 4272 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:42:59.833101 4272 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:42:59.833214 4272 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:42:59.837276 4272 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 04:42:59.837357 4272 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:42:59.837394 4272 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:42:59.837432 4272 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 04:42:59.837467 4272 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 04:42:59.842962 4272 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.240.212:33995
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164000593138-21443-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164000593138-21443-0/minicluster-data/master-0/wal
--ipki_private_key_password_cmd=echo foo
--ipki_ca_key_size=768
--master_addresses=127.20.240.254:46087
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.254.keytab
--principal=kudu/127.20.240.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.240.254:46087
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164000593138-21443-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.240.254
--webserver_port=44713
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4272
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164000593138-21443-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 04:05:18 UTC on ccycloud.quasar-drfdgt.root.comops.site
build id 4574101
I20260808 04:42:59.844110 4272 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:42:59.845223 4272 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:42:59.858590 4278 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:42:59.858614 4281 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:42:59.858582 4279 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:42:59.859042 4272 server_base.cc:1034] running on GCE node
I20260808 04:42:59.859686 4272 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:42:59.860869 4272 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:42:59.862094 4272 hybrid_clock.cc:648] HybridClock initialized: now 1786164179862059 us; error 42 us; skew 500 ppm
Aug 08 04:42:59 dist-test-slave-vxj2 krb5kdc[3665](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164179, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.240.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:42:59.865398 4272 init.cc:377] Logged in from keytab as kudu/127.20.240.254@KRBTEST.COM (short username kudu)
I20260808 04:42:59.866532 4272 webserver.cc:460] Webserver started at http://127.20.240.254:44713/ using document root <none> and password file <none>
I20260808 04:42:59.867200 4272 fs_manager.cc:359] Metadata directory not provided
I20260808 04:42:59.867339 4272 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:42:59.871946 4272 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260808 04:42:59.874543 4288 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:42:59.875891 4272 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260808 04:42:59.876063 4272 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164000593138-21443-0/minicluster-data/master-0/data,/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164000593138-21443-0/minicluster-data/master-0/wal
uuid: "107010403a3944a09c963231a87a6b5e"
format_stamp: "Formatted at 2026-08-08 04:42:58 on dist-test-slave-vxj2"
server_key: "beb698de7980809b1080ce76fc69508b"
server_key_iv: "9fc98e5bf9bd0575b57f71b4511c5982"
server_key_version: "encryptionkey@0"
I20260808 04:42:59.876724 4272 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164000593138-21443-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164000593138-21443-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164000593138-21443-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:42:59.896337 4272 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:42:59.899696 4272 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:42:59.899952 4272 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:42:59.908030 4272 rpc_server.cc:307] RPC server started. Bound to: 127.20.240.254:46087
I20260808 04:42:59.908320 4350 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.240.254:46087 every 8 connection(s)
I20260808 04:42:59.909343 4272 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164000593138-21443-0/minicluster-data/master-0/data/info.pb
I20260808 04:42:59.913990 4351 sys_catalog.cc:263] Verifying existing consensus state
I20260808 04:42:59.915736 4351 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 107010403a3944a09c963231a87a6b5e: Bootstrap starting.
I20260808 04:42:59.916579 21443 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu as pid 4272
I20260808 04:42:59.917080 21443 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
/tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164000593138-21443-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164000593138-21443-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164000593138-21443-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164000593138-21443-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.240.193:42575
--local_ip_for_outbound_sockets=127.20.240.193
--tserver_master_addrs=127.20.240.254:46087
--webserver_port=44435
--webserver_interface=127.20.240.193
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.193.keytab
--principal=kudu/127.20.240.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.240.212:33995
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164000593138-21443-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164000593138-21443-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164000593138-21443-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 04:42:59.934530 4351 log.cc:824] T 00000000000000000000000000000000 P 107010403a3944a09c963231a87a6b5e: Log is configured to *not* fsync() on all Append() calls
I20260808 04:42:59.944208 4351 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 107010403a3944a09c963231a87a6b5e: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 04:42:59.944638 4351 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 107010403a3944a09c963231a87a6b5e: Bootstrap complete.
I20260808 04:42:59.948958 4351 raft_consensus.cc:348] T 00000000000000000000000000000000 P 107010403a3944a09c963231a87a6b5e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "107010403a3944a09c963231a87a6b5e" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 46087 } }
I20260808 04:42:59.949455 4351 raft_consensus.cc:729] T 00000000000000000000000000000000 P 107010403a3944a09c963231a87a6b5e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 107010403a3944a09c963231a87a6b5e, State: Initialized, Role: FOLLOWER
I20260808 04:42:59.950009 4351 consensus_queue.cc:260] T 00000000000000000000000000000000 P 107010403a3944a09c963231a87a6b5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "107010403a3944a09c963231a87a6b5e" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 46087 } }
I20260808 04:42:59.950166 4351 raft_consensus.cc:388] T 00000000000000000000000000000000 P 107010403a3944a09c963231a87a6b5e [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 04:42:59.950266 4351 raft_consensus.cc:482] T 00000000000000000000000000000000 P 107010403a3944a09c963231a87a6b5e [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 04:42:59.950389 4351 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 107010403a3944a09c963231a87a6b5e [term 1 FOLLOWER]: Advancing to term 2
I20260808 04:42:59.952491 4351 raft_consensus.cc:504] T 00000000000000000000000000000000 P 107010403a3944a09c963231a87a6b5e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "107010403a3944a09c963231a87a6b5e" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 46087 } }
I20260808 04:42:59.952841 4351 leader_election.cc:302] T 00000000000000000000000000000000 P 107010403a3944a09c963231a87a6b5e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 107010403a3944a09c963231a87a6b5e; no voters:
I20260808 04:42:59.953255 4351 leader_election.cc:288] T 00000000000000000000000000000000 P 107010403a3944a09c963231a87a6b5e [CANDIDATE]: Term 2 election: Requested vote from peers
I20260808 04:42:59.953344 4355 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 107010403a3944a09c963231a87a6b5e [term 2 FOLLOWER]: Leader election won for term 2
I20260808 04:42:59.953547 4355 raft_consensus.cc:686] T 00000000000000000000000000000000 P 107010403a3944a09c963231a87a6b5e [term 2 LEADER]: Becoming Leader. State: Replica: 107010403a3944a09c963231a87a6b5e, State: Running, Role: LEADER
I20260808 04:42:59.953852 4355 consensus_queue.cc:237] T 00000000000000000000000000000000 P 107010403a3944a09c963231a87a6b5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "107010403a3944a09c963231a87a6b5e" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 46087 } }
I20260808 04:42:59.954582 4351 sys_catalog.cc:564] T 00000000000000000000000000000000 P 107010403a3944a09c963231a87a6b5e [sys.catalog]: configured and running, proceeding with master startup.
I20260808 04:42:59.955447 4357 sys_catalog.cc:455] T 00000000000000000000000000000000 P 107010403a3944a09c963231a87a6b5e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 107010403a3944a09c963231a87a6b5e. Latest consensus state: current_term: 2 leader_uuid: "107010403a3944a09c963231a87a6b5e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "107010403a3944a09c963231a87a6b5e" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 46087 } } }
I20260808 04:42:59.955467 4356 sys_catalog.cc:455] T 00000000000000000000000000000000 P 107010403a3944a09c963231a87a6b5e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "107010403a3944a09c963231a87a6b5e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "107010403a3944a09c963231a87a6b5e" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 46087 } } }
I20260808 04:42:59.955597 4357 sys_catalog.cc:458] T 00000000000000000000000000000000 P 107010403a3944a09c963231a87a6b5e [sys.catalog]: This master's current role is: LEADER
I20260808 04:42:59.955621 4356 sys_catalog.cc:458] T 00000000000000000000000000000000 P 107010403a3944a09c963231a87a6b5e [sys.catalog]: This master's current role is: LEADER
I20260808 04:42:59.960120 4372 catalog_manager.cc:1259] Loaded cluster ID: 011e5d9609d5482ab7bc89a7c86def27
I20260808 04:42:59.960196 4372 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 107010403a3944a09c963231a87a6b5e: loading cluster ID for follower catalog manager: success
W20260808 04:42:59.961190 4372 catalog_manager.cc:1576] T 00000000000000000000000000000000 P 107010403a3944a09c963231a87a6b5e: acquiring CA information for follower catalog manager: Runtime error: could not decrypt private key with the password returned by the configured command: unable to load data from memory: error reading private key: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D07803A:asn1 encoding routines:ASN1_ITEM_EX_D2I:nested asn1 error:tasn_dec.c:386:Type=X509_ALGOR error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=algor, Type=X509_SIG
W20260808 04:42:59.961263 4372 catalog_manager.cc:873] Runtime error: could not decrypt private key with the password returned by the configured command: unable to load data from memory: error reading private key: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D07803A:asn1 encoding routines:ASN1_ITEM_EX_D2I:nested asn1 error:tasn_dec.c:386:Type=X509_ALGOR error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=algor, Type=X509_SIG: failed to prepare follower catalog manager, will retry
I20260808 04:42:59.961340 4360 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 04:42:59.963824 4360 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 04:42:59.964313 4360 catalog_manager.cc:1259] Loaded cluster ID: 011e5d9609d5482ab7bc89a7c86def27
I20260808 04:42:59.964373 4360 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 04:42:59.965477 4360 catalog_manager.cc:1314] IPKI private key was stored in cleartext, attempting to encrypt it.
I20260808 04:42:59.970407 4360 catalog_manager.cc:1324] IPKI private key successfully encrypted.
I20260808 04:42:59.976198 4360 catalog_manager.cc:1504] Loading token signing keys...
I20260808 04:42:59.977020 4360 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 107010403a3944a09c963231a87a6b5e: Loaded TSK: 0
I20260808 04:42:59.978233 4360 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260808 04:43:00.045173 4353 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:43:00.045517 4353 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:43:00.045605 4353 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:43:00.049846 4353 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:43:00.049955 4353 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:43:00.050060 4353 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.240.193
I20260808 04:43:00.056007 4353 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.240.212:33995
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164000593138-21443-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164000593138-21443-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.193.keytab
--principal=kudu/127.20.240.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.240.193:42575
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164000593138-21443-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.240.193
--webserver_port=44435
--tserver_master_addrs=127.20.240.254:46087
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4353
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.240.193
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164000593138-21443-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 04:05:18 UTC on ccycloud.quasar-drfdgt.root.comops.site
build id 4574101
I20260808 04:43:00.057304 4353 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:43:00.058434 4353 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:43:00.070020 4380 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:43:00.070020 4379 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:43:00.070580 4353 server_base.cc:1034] running on GCE node
W20260808 04:43:00.070022 4382 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:43:00.071084 4353 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:43:00.071872 4353 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:43:00.073117 4353 hybrid_clock.cc:648] HybridClock initialized: now 1786164180073088 us; error 56 us; skew 500 ppm
Aug 08 04:43:00 dist-test-slave-vxj2 krb5kdc[3665](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164180, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.240.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:43:00.076345 4353 init.cc:377] Logged in from keytab as kudu/127.20.240.193@KRBTEST.COM (short username kudu)
I20260808 04:43:00.077512 4353 webserver.cc:460] Webserver started at http://127.20.240.193:44435/ using document root <none> and password file <none>
I20260808 04:43:00.078105 4353 fs_manager.cc:359] Metadata directory not provided
I20260808 04:43:00.078184 4353 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:43:00.082376 4353 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260808 04:43:00.084656 4390 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:43:00.086021 4353 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260808 04:43:00.086148 4353 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164000593138-21443-0/minicluster-data/ts-0/data,/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164000593138-21443-0/minicluster-data/ts-0/wal
uuid: "64fe25f92a054bcc9b2ff7cbf43af06d"
format_stamp: "Formatted at 2026-08-08 04:42:58 on dist-test-slave-vxj2"
server_key: "617e2dd309f1e1a1643be80f47ea13fe"
server_key_iv: "9e362114cf5b7100bae2cc4c3a257fe3"
server_key_version: "encryptionkey@0"
I20260808 04:43:00.086735 4353 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164000593138-21443-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164000593138-21443-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164000593138-21443-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:43:00.109315 4353 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:43:00.112651 4353 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:43:00.112892 4353 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:43:00.113631 4353 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 04:43:00.114852 4401 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260808 04:43:00.119525 4353 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260808 04:43:00.119596 4353 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.005s user 0.001s sys 0.000s
I20260808 04:43:00.119694 4353 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260808 04:43:00.121584 4353 ts_tablet_manager.cc:610] Registered 1 tablets
I20260808 04:43:00.121632 4353 ts_tablet_manager.cc:589] Time spent register tablets: real 0.002s user 0.002s sys 0.000s
I20260808 04:43:00.121991 4401 tablet_bootstrap.cc:492] T fcdbba7e6a5e45208b62716926755eac P 64fe25f92a054bcc9b2ff7cbf43af06d: Bootstrap starting.
I20260808 04:43:00.132823 4353 rpc_server.cc:307] RPC server started. Bound to: 127.20.240.193:42575
I20260808 04:43:00.132899 4522 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.240.193:42575 every 8 connection(s)
I20260808 04:43:00.133926 4353 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164000593138-21443-0/minicluster-data/ts-0/data/info.pb
I20260808 04:43:00.135298 21443 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu as pid 4353
I20260808 04:43:00.135811 21443 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
/tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164000593138-21443-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164000593138-21443-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164000593138-21443-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164000593138-21443-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.240.194:34749
--local_ip_for_outbound_sockets=127.20.240.194
--tserver_master_addrs=127.20.240.254:46087
--webserver_port=38461
--webserver_interface=127.20.240.194
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.194.keytab
--principal=kudu/127.20.240.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.240.212:33995
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164000593138-21443-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164000593138-21443-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164000593138-21443-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 04:43:00.141402 4401 log.cc:824] T fcdbba7e6a5e45208b62716926755eac P 64fe25f92a054bcc9b2ff7cbf43af06d: Log is configured to *not* fsync() on all Append() calls
Aug 08 04:43:00 dist-test-slave-vxj2 krb5kdc[3665](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164180, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.240.193@KRBTEST.COM for kudu/127.20.240.254@KRBTEST.COM
I20260808 04:43:00.150250 4401 tablet_bootstrap.cc:492] T fcdbba7e6a5e45208b62716926755eac P 64fe25f92a054bcc9b2ff7cbf43af06d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 04:43:00.150774 4401 tablet_bootstrap.cc:492] T fcdbba7e6a5e45208b62716926755eac P 64fe25f92a054bcc9b2ff7cbf43af06d: Bootstrap complete.
I20260808 04:43:00.152438 4401 ts_tablet_manager.cc:1397] T fcdbba7e6a5e45208b62716926755eac P 64fe25f92a054bcc9b2ff7cbf43af06d: Time spent bootstrapping tablet: real 0.031s user 0.015s sys 0.015s
I20260808 04:43:00.155506 4401 raft_consensus.cc:348] T fcdbba7e6a5e45208b62716926755eac P 64fe25f92a054bcc9b2ff7cbf43af06d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3859384e3bed4d3c88c284d01ecf71be" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 34749 } } peers { permanent_uuid: "0217252a13be4e29a06a3278372656a5" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 45275 } } peers { permanent_uuid: "64fe25f92a054bcc9b2ff7cbf43af06d" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 42575 } }
I20260808 04:43:00.156073 4401 raft_consensus.cc:729] T fcdbba7e6a5e45208b62716926755eac P 64fe25f92a054bcc9b2ff7cbf43af06d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 64fe25f92a054bcc9b2ff7cbf43af06d, State: Initialized, Role: FOLLOWER
I20260808 04:43:00.156513 4525 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:43:00.136134 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:46087 (local address 127.20.240.193:56903)
0808 04:43:00.137076 (+ 942us) negotiation.cc:107] Waiting for socket to connect
0808 04:43:00.137134 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0808 04:43:00.138455 (+ 1321us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:43:00.140101 (+ 1646us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:43:00.140114 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:43:00.140679 (+ 565us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:43:00.141492 (+ 813us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:43:00.141518 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:43:00.143268 (+ 1750us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:43:00.143275 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:43:00.144901 (+ 1626us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:43:00.144921 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:43:00.146033 (+ 1112us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:43:00.146040 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:43:00.146307 (+ 267us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:43:00.147126 (+ 819us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:43:00.147157 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:43:00.149437 (+ 2280us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:43:00.152470 (+ 3033us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:43:00.152477 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:43:00.152492 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:43:00.152902 (+ 410us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:43:00.153408 (+ 506us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:43:00.153412 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:43:00.153414 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:43:00.153608 (+ 194us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:43:00.154413 (+ 805us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:43:00.154420 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:43:00.154750 (+ 330us) client_negotiation.cc:769] Sending connection context
0808 04:43:00.154964 (+ 214us) client_negotiation.cc:240] Negotiation successful
0808 04:43:00.155398 (+ 434us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":732,"thread_start_us":172,"threads_started":1}
I20260808 04:43:00.156599 4401 consensus_queue.cc:260] T fcdbba7e6a5e45208b62716926755eac P 64fe25f92a054bcc9b2ff7cbf43af06d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3859384e3bed4d3c88c284d01ecf71be" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 34749 } } peers { permanent_uuid: "0217252a13be4e29a06a3278372656a5" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 45275 } } peers { permanent_uuid: "64fe25f92a054bcc9b2ff7cbf43af06d" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 42575 } }
I20260808 04:43:00.157521 4526 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:43:00.136297 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.240.193:56903 (local address 127.20.240.254:46087)
0808 04:43:00.136790 (+ 493us) server_negotiation.cc:206] Beginning negotiation
0808 04:43:00.136810 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0808 04:43:00.137330 (+ 520us) server_negotiation.cc:407] Connection header received
0808 04:43:00.139062 (+ 1732us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:43:00.139081 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:43:00.139547 (+ 466us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:43:00.139967 (+ 420us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:43:00.141714 (+ 1747us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:43:00.143068 (+ 1354us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:43:00.145087 (+ 2019us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:43:00.145851 (+ 764us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:43:00.146029 (+ 178us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:43:00.149724 (+ 3695us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:43:00.149731 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:43:00.149747 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:43:00.149784 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:43:00.152313 (+ 2529us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:43:00.153068 (+ 755us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:43:00.153075 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:43:00.153080 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:43:00.153294 (+ 214us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:43:00.153738 (+ 444us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:43:00.153742 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:43:00.153744 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:43:00.154285 (+ 541us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:43:00.154425 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0808 04:43:00.155138 (+ 713us) server_negotiation.cc:299] Negotiation successful
0808 04:43:00.155464 (+ 326us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":357,"thread_start_us":109,"threads_started":1}
I20260808 04:43:00.157727 4401 ts_tablet_manager.cc:1428] T fcdbba7e6a5e45208b62716926755eac P 64fe25f92a054bcc9b2ff7cbf43af06d: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20260808 04:43:00.159843 4523 heartbeater.cc:347] Connected to a master server at 127.20.240.254:46087
I20260808 04:43:00.160084 4523 heartbeater.cc:464] Registering TS with master...
I20260808 04:43:00.160583 4523 heartbeater.cc:511] Master 127.20.240.254:46087 requested a full tablet report, sending...
I20260808 04:43:00.163096 4311 ts_manager.cc:194] Registered new tserver with Master: 64fe25f92a054bcc9b2ff7cbf43af06d (127.20.240.193:42575)
I20260808 04:43:00.166798 4311 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.240.193@KRBTEST.COM'} at 127.20.240.193:56903
I20260808 04:43:00.169646 4523 heartbeater.cc:503] Master 127.20.240.254:46087 was elected leader, sending a full tablet report...
Aug 08 04:43:00 dist-test-slave-vxj2 krb5kdc[3665](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164179, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.240.254@KRBTEST.COM for kudu/127.20.240.193@KRBTEST.COM
I20260808 04:43:00.177031 4531 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:43:00.166255 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44934 (local address 127.20.240.193:42575)
0808 04:43:00.166758 (+ 503us) server_negotiation.cc:206] Beginning negotiation
0808 04:43:00.166771 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0808 04:43:00.167140 (+ 369us) server_negotiation.cc:407] Connection header received
0808 04:43:00.167342 (+ 202us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:43:00.167348 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:43:00.167575 (+ 227us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:43:00.167740 (+ 165us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:43:00.168408 (+ 668us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:43:00.169139 (+ 731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:43:00.170149 (+ 1010us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:43:00.170602 (+ 453us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:43:00.170728 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:43:00.173098 (+ 2370us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:43:00.173108 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:43:00.173122 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:43:00.173233 (+ 111us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:43:00.174983 (+ 1750us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:43:00.175517 (+ 534us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:43:00.175523 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:43:00.175524 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:43:00.175605 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:43:00.175900 (+ 295us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:43:00.175905 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:43:00.175906 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:43:00.176170 (+ 264us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:43:00.176318 (+ 148us) server_negotiation.cc:1035] Waiting for connection context
0808 04:43:00.176676 (+ 358us) server_negotiation.cc:299] Negotiation successful
0808 04:43:00.176852 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":2,"server-negotiator.queue_time_us":385,"thread_start_us":127,"threads_started":1}
I20260808 04:43:00.177031 4530 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:43:00.166109 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.193:42575 (local address 127.0.0.1:44934)
0808 04:43:00.166987 (+ 878us) negotiation.cc:107] Waiting for socket to connect
0808 04:43:00.167032 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0808 04:43:00.167178 (+ 146us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:43:00.167770 (+ 592us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:43:00.167776 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:43:00.168164 (+ 388us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:43:00.168273 (+ 109us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:43:00.168281 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:43:00.169318 (+ 1037us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:43:00.169322 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:43:00.170022 (+ 700us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:43:00.170034 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:43:00.170730 (+ 696us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:43:00.170734 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:43:00.170867 (+ 133us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:43:00.171516 (+ 649us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:43:00.171529 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:43:00.172949 (+ 1420us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:43:00.175107 (+ 2158us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:43:00.175119 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:43:00.175125 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:43:00.175381 (+ 256us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:43:00.175706 (+ 325us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:43:00.175709 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:43:00.175711 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:43:00.175804 (+ 93us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:43:00.176304 (+ 500us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:43:00.176310 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:43:00.176442 (+ 132us) client_negotiation.cc:769] Sending connection context
0808 04:43:00.176591 (+ 149us) client_negotiation.cc:240] Negotiation successful
0808 04:43:00.176816 (+ 225us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":701,"thread_start_us":114,"threads_started":1}
I20260808 04:43:00.178236 4450 tablet_service.cc:1514] Processing DeleteTablet for tablet fcdbba7e6a5e45208b62716926755eac with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 04:42:59 UTC) from {username='kudu', principal='kudu/127.20.240.254@KRBTEST.COM'} at 127.0.0.1:44934
I20260808 04:43:00.179363 4532 tablet_replica.cc:330] stopping tablet replica
I20260808 04:43:00.179699 4532 raft_consensus.cc:2229] T fcdbba7e6a5e45208b62716926755eac P 64fe25f92a054bcc9b2ff7cbf43af06d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 04:43:00.179992 4532 raft_consensus.cc:2258] T fcdbba7e6a5e45208b62716926755eac P 64fe25f92a054bcc9b2ff7cbf43af06d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 04:43:00.181111 4532 ts_tablet_manager.cc:1905] T fcdbba7e6a5e45208b62716926755eac P 64fe25f92a054bcc9b2ff7cbf43af06d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 04:43:00.184818 4532 ts_tablet_manager.cc:1918] T fcdbba7e6a5e45208b62716926755eac P 64fe25f92a054bcc9b2ff7cbf43af06d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 04:43:00.184906 4532 log.cc:1196] T fcdbba7e6a5e45208b62716926755eac P 64fe25f92a054bcc9b2ff7cbf43af06d: Deleting WAL directory at /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164000593138-21443-0/minicluster-data/ts-0/wal/wals/fcdbba7e6a5e45208b62716926755eac
I20260808 04:43:00.185245 4532 ts_tablet_manager.cc:1939] T fcdbba7e6a5e45208b62716926755eac P 64fe25f92a054bcc9b2ff7cbf43af06d: Deleting consensus metadata
I20260808 04:43:00.187021 4292 catalog_manager.cc:4841] TS 64fe25f92a054bcc9b2ff7cbf43af06d (127.20.240.193:42575): tablet fcdbba7e6a5e45208b62716926755eac (table test-table [id=7592a7816d6d4798a5b62a8df7d577a0]) successfully deleted
W20260808 04:43:00.266500 4527 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:43:00.266829 4527 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:43:00.266914 4527 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:43:00.271090 4527 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:43:00.271205 4527 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:43:00.271317 4527 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.240.194
I20260808 04:43:00.277051 4527 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.240.212:33995
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164000593138-21443-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164000593138-21443-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.194.keytab
--principal=kudu/127.20.240.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.240.194:34749
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164000593138-21443-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.240.194
--webserver_port=38461
--tserver_master_addrs=127.20.240.254:46087
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4527
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.240.194
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164000593138-21443-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 04:05:18 UTC on ccycloud.quasar-drfdgt.root.comops.site
build id 4574101
I20260808 04:43:00.278365 4527 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:43:00.279470 4527 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:43:00.289703 4540 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:43:00.289708 4542 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:43:00.289708 4539 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:43:00.290117 4527 server_base.cc:1034] running on GCE node
I20260808 04:43:00.290530 4527 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:43:00.291210 4527 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:43:00.292411 4527 hybrid_clock.cc:648] HybridClock initialized: now 1786164180292379 us; error 43 us; skew 500 ppm
Aug 08 04:43:00 dist-test-slave-vxj2 krb5kdc[3665](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164180, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.240.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:43:00.295413 4527 init.cc:377] Logged in from keytab as kudu/127.20.240.194@KRBTEST.COM (short username kudu)
I20260808 04:43:00.296294 4527 webserver.cc:460] Webserver started at http://127.20.240.194:38461/ using document root <none> and password file <none>
I20260808 04:43:00.296809 4527 fs_manager.cc:359] Metadata directory not provided
I20260808 04:43:00.296881 4527 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:43:00.300778 4527 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.003s sys 0.000s
I20260808 04:43:00.302942 4550 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:43:00.304327 4527 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 04:43:00.304437 4527 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164000593138-21443-0/minicluster-data/ts-1/data,/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164000593138-21443-0/minicluster-data/ts-1/wal
uuid: "3859384e3bed4d3c88c284d01ecf71be"
format_stamp: "Formatted at 2026-08-08 04:42:59 on dist-test-slave-vxj2"
server_key: "18344e6552b0a41168d36d0de9cedceb"
server_key_iv: "abfe9930238821ce0e5e1b2719c68012"
server_key_version: "encryptionkey@0"
I20260808 04:43:00.304996 4527 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164000593138-21443-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164000593138-21443-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164000593138-21443-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:43:00.342164 4527 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:43:00.345678 4527 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:43:00.345878 4527 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:43:00.346524 4527 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 04:43:00.347402 4527 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 04:43:00.347481 4527 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 04:43:00.347555 4527 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 04:43:00.347599 4527 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 04:43:00.357282 4527 rpc_server.cc:307] RPC server started. Bound to: 127.20.240.194:34749
I20260808 04:43:00.357329 4678 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.240.194:34749 every 8 connection(s)
I20260808 04:43:00.358402 4527 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164000593138-21443-0/minicluster-data/ts-1/data/info.pb
I20260808 04:43:00.366461 21443 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu as pid 4527
I20260808 04:43:00.366937 21443 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
/tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164000593138-21443-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164000593138-21443-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164000593138-21443-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164000593138-21443-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.240.195:45275
--local_ip_for_outbound_sockets=127.20.240.195
--tserver_master_addrs=127.20.240.254:46087
--webserver_port=43451
--webserver_interface=127.20.240.195
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.195.keytab
--principal=kudu/127.20.240.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.240.212:33995
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164000593138-21443-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164000593138-21443-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164000593138-21443-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 08 04:43:00 dist-test-slave-vxj2 krb5kdc[3665](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164180, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.240.194@KRBTEST.COM for kudu/127.20.240.254@KRBTEST.COM
I20260808 04:43:00.374639 4526 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:43:00.360805 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.240.194:37295 (local address 127.20.240.254:46087)
0808 04:43:00.361404 (+ 599us) server_negotiation.cc:206] Beginning negotiation
0808 04:43:00.361410 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 04:43:00.362370 (+ 960us) server_negotiation.cc:407] Connection header received
0808 04:43:00.363805 (+ 1435us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:43:00.363808 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:43:00.363862 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:43:00.363971 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:43:00.365394 (+ 1423us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:43:00.365945 (+ 551us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:43:00.367408 (+ 1463us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:43:00.367658 (+ 250us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:43:00.367786 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:43:00.370594 (+ 2808us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:43:00.370597 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:43:00.370599 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:43:00.370628 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:43:00.372177 (+ 1549us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:43:00.372801 (+ 624us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:43:00.372804 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:43:00.372806 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:43:00.372893 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:43:00.373335 (+ 442us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:43:00.373338 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:43:00.373340 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:43:00.373541 (+ 201us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:43:00.373653 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0808 04:43:00.374313 (+ 660us) server_negotiation.cc:299] Negotiation successful
0808 04:43:00.374461 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":454}
I20260808 04:43:00.375541 4681 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:43:00.361511 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:46087 (local address 127.20.240.194:37295)
0808 04:43:00.362174 (+ 663us) negotiation.cc:107] Waiting for socket to connect
0808 04:43:00.362219 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0808 04:43:00.363532 (+ 1313us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:43:00.364176 (+ 644us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:43:00.364184 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:43:00.364596 (+ 412us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:43:00.365147 (+ 551us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:43:00.365234 (+ 87us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:43:00.366085 (+ 851us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:43:00.366092 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:43:00.367254 (+ 1162us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:43:00.367266 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:43:00.367833 (+ 567us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:43:00.367838 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:43:00.368025 (+ 187us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:43:00.368688 (+ 663us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:43:00.368705 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:43:00.370384 (+ 1679us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:43:00.372355 (+ 1971us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:43:00.372362 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:43:00.372381 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:43:00.372676 (+ 295us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:43:00.372993 (+ 317us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:43:00.372997 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:43:00.372999 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:43:00.373215 (+ 216us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:43:00.373654 (+ 439us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:43:00.373664 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:43:00.374000 (+ 336us) client_negotiation.cc:769] Sending connection context
0808 04:43:00.374244 (+ 244us) client_negotiation.cc:240] Negotiation successful
0808 04:43:00.374632 (+ 388us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":423,"thread_start_us":166,"threads_started":1}
I20260808 04:43:00.376881 4679 heartbeater.cc:347] Connected to a master server at 127.20.240.254:46087
I20260808 04:43:00.377121 4679 heartbeater.cc:464] Registering TS with master...
I20260808 04:43:00.377663 4679 heartbeater.cc:511] Master 127.20.240.254:46087 requested a full tablet report, sending...
I20260808 04:43:00.378741 4311 ts_manager.cc:194] Registered new tserver with Master: 3859384e3bed4d3c88c284d01ecf71be (127.20.240.194:34749)
I20260808 04:43:00.379313 4311 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.240.194@KRBTEST.COM'} at 127.20.240.194:37295
W20260808 04:43:00.486045 4682 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:43:00.486346 4682 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:43:00.486429 4682 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:43:00.490798 4682 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:43:00.490897 4682 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:43:00.490991 4682 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.240.195
I20260808 04:43:00.496999 4682 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.240.212:33995
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164000593138-21443-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164000593138-21443-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.195.keytab
--principal=kudu/127.20.240.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.240.195:45275
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164000593138-21443-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.240.195
--webserver_port=43451
--tserver_master_addrs=127.20.240.254:46087
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4682
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.240.195
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164000593138-21443-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 04:05:18 UTC on ccycloud.quasar-drfdgt.root.comops.site
build id 4574101
I20260808 04:43:00.498212 4682 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:43:00.499284 4682 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:43:00.509723 4687 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:43:00.509756 4690 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:43:00.509723 4688 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:43:00.510116 4682 server_base.cc:1034] running on GCE node
I20260808 04:43:00.510591 4682 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:43:00.511399 4682 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:43:00.512609 4682 hybrid_clock.cc:648] HybridClock initialized: now 1786164180512588 us; error 37 us; skew 500 ppm
Aug 08 04:43:00 dist-test-slave-vxj2 krb5kdc[3665](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164180, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.240.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:43:00.516048 4682 init.cc:377] Logged in from keytab as kudu/127.20.240.195@KRBTEST.COM (short username kudu)
I20260808 04:43:00.517274 4682 webserver.cc:460] Webserver started at http://127.20.240.195:43451/ using document root <none> and password file <none>
I20260808 04:43:00.517928 4682 fs_manager.cc:359] Metadata directory not provided
I20260808 04:43:00.518052 4682 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:43:00.522385 4682 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260808 04:43:00.524704 4699 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:43:00.526109 4682 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 04:43:00.526274 4682 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164000593138-21443-0/minicluster-data/ts-2/data,/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164000593138-21443-0/minicluster-data/ts-2/wal
uuid: "0217252a13be4e29a06a3278372656a5"
format_stamp: "Formatted at 2026-08-08 04:42:59 on dist-test-slave-vxj2"
server_key: "dbb37e4962e56d7a3085312d70520474"
server_key_iv: "a8c14e10faac394df636ac2af53cca90"
server_key_version: "encryptionkey@0"
I20260808 04:43:00.526872 4682 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164000593138-21443-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164000593138-21443-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164000593138-21443-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:43:00.542999 4682 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:43:00.546816 4682 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:43:00.547091 4682 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:43:00.547814 4682 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 04:43:00.548834 4682 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 04:43:00.548936 4682 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 04:43:00.549049 4682 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 04:43:00.549108 4682 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 04:43:00.560371 4682 rpc_server.cc:307] RPC server started. Bound to: 127.20.240.195:45275
I20260808 04:43:00.560408 4823 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.240.195:45275 every 8 connection(s)
I20260808 04:43:00.561625 4682 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164000593138-21443-0/minicluster-data/ts-2/data/info.pb
I20260808 04:43:00.564611 21443 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu as pid 4682
Aug 08 04:43:00 dist-test-slave-vxj2 krb5kdc[3665](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164180, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.240.195@KRBTEST.COM for kudu/127.20.240.254@KRBTEST.COM
I20260808 04:43:00.574290 4828 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:43:00.565879 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58964 (local address 127.20.240.254:46087)
0808 04:43:00.566219 (+ 340us) server_negotiation.cc:206] Beginning negotiation
0808 04:43:00.566225 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 04:43:00.566244 (+ 19us) server_negotiation.cc:407] Connection header received
0808 04:43:00.566315 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:43:00.566321 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:43:00.566374 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:43:00.566498 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:43:00.567357 (+ 859us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:43:00.567942 (+ 585us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:43:00.568865 (+ 923us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:43:00.569103 (+ 238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:43:00.569295 (+ 192us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:43:00.570886 (+ 1591us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:43:00.570890 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:43:00.570892 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:43:00.570922 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:43:00.572444 (+ 1522us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:43:00.572916 (+ 472us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:43:00.572922 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:43:00.572924 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:43:00.573023 (+ 99us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:43:00.573354 (+ 331us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:43:00.573357 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:43:00.573359 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:43:00.573544 (+ 185us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:43:00.573780 (+ 236us) server_negotiation.cc:1035] Waiting for connection context
0808 04:43:00.573931 (+ 151us) server_negotiation.cc:299] Negotiation successful
0808 04:43:00.574095 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":242,"thread_start_us":122,"threads_started":1}
I20260808 04:43:00.577497 4526 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:43:00.563850 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.240.195:43329 (local address 127.20.240.254:46087)
0808 04:43:00.564057 (+ 207us) server_negotiation.cc:206] Beginning negotiation
0808 04:43:00.564062 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 04:43:00.565307 (+ 1245us) server_negotiation.cc:407] Connection header received
0808 04:43:00.567110 (+ 1803us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:43:00.567113 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:43:00.567163 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:43:00.567274 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:43:00.568533 (+ 1259us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:43:00.569035 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:43:00.570486 (+ 1451us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:43:00.570706 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:43:00.570832 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:43:00.573530 (+ 2698us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:43:00.573533 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:43:00.573535 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:43:00.573556 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:43:00.575245 (+ 1689us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:43:00.575859 (+ 614us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:43:00.575862 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:43:00.575864 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:43:00.575948 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:43:00.576312 (+ 364us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:43:00.576315 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:43:00.576317 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:43:00.576543 (+ 226us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:43:00.576641 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0808 04:43:00.577209 (+ 568us) server_negotiation.cc:299] Negotiation successful
0808 04:43:00.577335 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":88}
I20260808 04:43:00.578382 4826 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:43:00.564357 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:46087 (local address 127.20.240.195:43329)
0808 04:43:00.565094 (+ 737us) negotiation.cc:107] Waiting for socket to connect
0808 04:43:00.565158 (+ 64us) client_negotiation.cc:174] Beginning negotiation
0808 04:43:00.566875 (+ 1717us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:43:00.567488 (+ 613us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:43:00.567496 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:43:00.567864 (+ 368us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:43:00.568376 (+ 512us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:43:00.568390 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:43:00.569216 (+ 826us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:43:00.569223 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:43:00.570348 (+ 1125us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:43:00.570358 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:43:00.570892 (+ 534us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:43:00.570896 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:43:00.571067 (+ 171us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:43:00.571704 (+ 637us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:43:00.571730 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:43:00.573352 (+ 1622us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:43:00.575353 (+ 2001us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:43:00.575358 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:43:00.575372 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:43:00.575740 (+ 368us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:43:00.576055 (+ 315us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:43:00.576058 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:43:00.576060 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:43:00.576203 (+ 143us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:43:00.576641 (+ 438us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:43:00.576648 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:43:00.576919 (+ 271us) client_negotiation.cc:769] Sending connection context
0808 04:43:00.577109 (+ 190us) client_negotiation.cc:240] Negotiation successful
0808 04:43:00.577495 (+ 386us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":463,"thread_start_us":171,"threads_started":1}
I20260808 04:43:00.579567 4824 heartbeater.cc:347] Connected to a master server at 127.20.240.254:46087
I20260808 04:43:00.579838 4824 heartbeater.cc:464] Registering TS with master...
I20260808 04:43:00.580390 4824 heartbeater.cc:511] Master 127.20.240.254:46087 requested a full tablet report, sending...
I20260808 04:43:00.581785 4311 ts_manager.cc:194] Registered new tserver with Master: 0217252a13be4e29a06a3278372656a5 (127.20.240.195:45275)
I20260808 04:43:00.582392 4311 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.240.195@KRBTEST.COM'} at 127.20.240.195:43329
I20260808 04:43:00.588642 21443 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 04:43:00.593516 4526 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:43:00.589457 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58972 (local address 127.20.240.254:46087)
0808 04:43:00.589614 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0808 04:43:00.589618 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:43:00.589825 (+ 207us) server_negotiation.cc:407] Connection header received
0808 04:43:00.590099 (+ 274us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:43:00.590102 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:43:00.590205 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:43:00.590307 (+ 102us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 04:43:00.590568 (+ 261us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:43:00.591217 (+ 649us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:43:00.592144 (+ 927us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:43:00.592361 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:43:00.592439 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:43:00.592710 (+ 271us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 04:43:00.593112 (+ 402us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 04:43:00.593322 (+ 210us) server_negotiation.cc:1035] Waiting for connection context
0808 04:43:00.593353 (+ 31us) server_negotiation.cc:299] Negotiation successful
0808 04:43:00.593402 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260808 04:43:00.594213 4311 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin'} at 127.0.0.1:58972:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 04:43:00.597739 4311 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 04:43:00.606124 4450 tablet_service.cc:1467] Processing CreateTablet for tablet ab36c17f462b44609bb82ff5b3defb65 (DEFAULT_TABLE table=test-table [id=654a46482487492ba4caa9a38d1f2a45]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 04:43:00.606881 4450 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ab36c17f462b44609bb82ff5b3defb65. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:43:00.609921 4401 tablet_bootstrap.cc:492] T ab36c17f462b44609bb82ff5b3defb65 P 64fe25f92a054bcc9b2ff7cbf43af06d: Bootstrap starting.
I20260808 04:43:00.610921 4401 tablet_bootstrap.cc:654] T ab36c17f462b44609bb82ff5b3defb65 P 64fe25f92a054bcc9b2ff7cbf43af06d: Neither blocks nor log segments found. Creating new log.
I20260808 04:43:00.611228 4833 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:43:00.605215 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.195:45275 (local address 127.0.0.1:36000)
0808 04:43:00.605614 (+ 399us) negotiation.cc:107] Waiting for socket to connect
0808 04:43:00.605629 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 04:43:00.605722 (+ 93us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:43:00.606458 (+ 736us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:43:00.606461 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:43:00.606503 (+ 42us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 04:43:00.606625 (+ 122us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:43:00.606630 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:43:00.608108 (+ 1478us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:43:00.608114 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:43:00.609421 (+ 1307us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:43:00.609433 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:43:00.610696 (+ 1263us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:43:00.610700 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:43:00.610795 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:43:00.610849 (+ 54us) client_negotiation.cc:769] Sending connection context
0808 04:43:00.610949 (+ 100us) client_negotiation.cc:240] Negotiation successful
0808 04:43:00.611035 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":331,"thread_start_us":141,"threads_started":1}
I20260808 04:43:00.611610 4530 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:43:00.604927 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.194:34749 (local address 127.0.0.1:40730)
0808 04:43:00.605090 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0808 04:43:00.605108 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0808 04:43:00.605210 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:43:00.606495 (+ 1285us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:43:00.606498 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:43:00.606518 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 04:43:00.606641 (+ 123us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:43:00.606647 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:43:00.608454 (+ 1807us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:43:00.608458 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:43:00.609580 (+ 1122us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:43:00.609587 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:43:00.611193 (+ 1606us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:43:00.611197 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:43:00.611303 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:43:00.611329 (+ 26us) client_negotiation.cc:769] Sending connection context
0808 04:43:00.611383 (+ 54us) client_negotiation.cc:240] Negotiation successful
0808 04:43:00.611467 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":53,"mutex_wait_us":4}
I20260808 04:43:00.611876 4835 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:43:00.605581 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36000 (local address 127.20.240.195:45275)
0808 04:43:00.605956 (+ 375us) server_negotiation.cc:206] Beginning negotiation
0808 04:43:00.605969 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0808 04:43:00.606001 (+ 32us) server_negotiation.cc:407] Connection header received
0808 04:43:00.606069 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:43:00.606073 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:43:00.606271 (+ 198us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:43:00.606763 (+ 492us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 04:43:00.606887 (+ 124us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:43:00.607976 (+ 1089us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:43:00.609648 (+ 1672us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:43:00.610545 (+ 897us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:43:00.610706 (+ 161us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:43:00.610874 (+ 168us) server_negotiation.cc:1035] Waiting for connection context
0808 04:43:00.611578 (+ 704us) server_negotiation.cc:299] Negotiation successful
0808 04:43:00.611711 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":272,"thread_start_us":188,"threads_started":1}
I20260808 04:43:00.612449 4401 tablet_bootstrap.cc:492] T ab36c17f462b44609bb82ff5b3defb65 P 64fe25f92a054bcc9b2ff7cbf43af06d: No bootstrap required, opened a new log
I20260808 04:43:00.612556 4834 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:43:00.605419 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40730 (local address 127.20.240.194:34749)
0808 04:43:00.605990 (+ 571us) server_negotiation.cc:206] Beginning negotiation
0808 04:43:00.606002 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 04:43:00.606026 (+ 24us) server_negotiation.cc:407] Connection header received
0808 04:43:00.606101 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:43:00.606106 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:43:00.606314 (+ 208us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:43:00.606798 (+ 484us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 04:43:00.606971 (+ 173us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:43:00.608303 (+ 1332us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:43:00.609700 (+ 1397us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:43:00.611066 (+ 1366us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:43:00.612142 (+ 1076us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:43:00.612273 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0808 04:43:00.612324 (+ 51us) server_negotiation.cc:299] Negotiation successful
0808 04:43:00.612412 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":468,"thread_start_us":158,"threads_started":1}
I20260808 04:43:00.612565 4401 ts_tablet_manager.cc:1397] T ab36c17f462b44609bb82ff5b3defb65 P 64fe25f92a054bcc9b2ff7cbf43af06d: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260808 04:43:00.613010 4401 raft_consensus.cc:348] T ab36c17f462b44609bb82ff5b3defb65 P 64fe25f92a054bcc9b2ff7cbf43af06d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3859384e3bed4d3c88c284d01ecf71be" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 34749 } } peers { permanent_uuid: "0217252a13be4e29a06a3278372656a5" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 45275 } } peers { permanent_uuid: "64fe25f92a054bcc9b2ff7cbf43af06d" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 42575 } }
I20260808 04:43:00.613140 4401 raft_consensus.cc:374] T ab36c17f462b44609bb82ff5b3defb65 P 64fe25f92a054bcc9b2ff7cbf43af06d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:43:00.613214 4401 raft_consensus.cc:729] T ab36c17f462b44609bb82ff5b3defb65 P 64fe25f92a054bcc9b2ff7cbf43af06d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 64fe25f92a054bcc9b2ff7cbf43af06d, State: Initialized, Role: FOLLOWER
I20260808 04:43:00.613363 4401 consensus_queue.cc:260] T ab36c17f462b44609bb82ff5b3defb65 P 64fe25f92a054bcc9b2ff7cbf43af06d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3859384e3bed4d3c88c284d01ecf71be" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 34749 } } peers { permanent_uuid: "0217252a13be4e29a06a3278372656a5" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 45275 } } peers { permanent_uuid: "64fe25f92a054bcc9b2ff7cbf43af06d" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 42575 } }
I20260808 04:43:00.613649 4401 ts_tablet_manager.cc:1428] T ab36c17f462b44609bb82ff5b3defb65 P 64fe25f92a054bcc9b2ff7cbf43af06d: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260808 04:43:00.615199 4752 tablet_service.cc:1467] Processing CreateTablet for tablet ab36c17f462b44609bb82ff5b3defb65 (DEFAULT_TABLE table=test-table [id=654a46482487492ba4caa9a38d1f2a45]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 04:43:00.615199 4604 tablet_service.cc:1467] Processing CreateTablet for tablet ab36c17f462b44609bb82ff5b3defb65 (DEFAULT_TABLE table=test-table [id=654a46482487492ba4caa9a38d1f2a45]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 04:43:00.616398 4604 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ab36c17f462b44609bb82ff5b3defb65. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:43:00.616406 4752 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ab36c17f462b44609bb82ff5b3defb65. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:43:00.625479 4837 tablet_bootstrap.cc:492] T ab36c17f462b44609bb82ff5b3defb65 P 0217252a13be4e29a06a3278372656a5: Bootstrap starting.
I20260808 04:43:00.625479 4838 tablet_bootstrap.cc:492] T ab36c17f462b44609bb82ff5b3defb65 P 3859384e3bed4d3c88c284d01ecf71be: Bootstrap starting.
I20260808 04:43:00.628742 4838 tablet_bootstrap.cc:654] T ab36c17f462b44609bb82ff5b3defb65 P 3859384e3bed4d3c88c284d01ecf71be: Neither blocks nor log segments found. Creating new log.
I20260808 04:43:00.628742 4837 tablet_bootstrap.cc:654] T ab36c17f462b44609bb82ff5b3defb65 P 0217252a13be4e29a06a3278372656a5: Neither blocks nor log segments found. Creating new log.
I20260808 04:43:00.629846 4838 log.cc:824] T ab36c17f462b44609bb82ff5b3defb65 P 3859384e3bed4d3c88c284d01ecf71be: Log is configured to *not* fsync() on all Append() calls
I20260808 04:43:00.629845 4837 log.cc:824] T ab36c17f462b44609bb82ff5b3defb65 P 0217252a13be4e29a06a3278372656a5: Log is configured to *not* fsync() on all Append() calls
I20260808 04:43:00.632216 4838 tablet_bootstrap.cc:492] T ab36c17f462b44609bb82ff5b3defb65 P 3859384e3bed4d3c88c284d01ecf71be: No bootstrap required, opened a new log
I20260808 04:43:00.632228 4837 tablet_bootstrap.cc:492] T ab36c17f462b44609bb82ff5b3defb65 P 0217252a13be4e29a06a3278372656a5: No bootstrap required, opened a new log
I20260808 04:43:00.632455 4838 ts_tablet_manager.cc:1397] T ab36c17f462b44609bb82ff5b3defb65 P 3859384e3bed4d3c88c284d01ecf71be: Time spent bootstrapping tablet: real 0.007s user 0.005s sys 0.000s
I20260808 04:43:00.632472 4837 ts_tablet_manager.cc:1397] T ab36c17f462b44609bb82ff5b3defb65 P 0217252a13be4e29a06a3278372656a5: Time spent bootstrapping tablet: real 0.007s user 0.005s sys 0.000s
W20260808 04:43:00.635336 4524 tablet.cc:2369] T ab36c17f462b44609bb82ff5b3defb65 P 64fe25f92a054bcc9b2ff7cbf43af06d: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 04:43:00.635564 4837 raft_consensus.cc:348] T ab36c17f462b44609bb82ff5b3defb65 P 0217252a13be4e29a06a3278372656a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3859384e3bed4d3c88c284d01ecf71be" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 34749 } } peers { permanent_uuid: "0217252a13be4e29a06a3278372656a5" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 45275 } } peers { permanent_uuid: "64fe25f92a054bcc9b2ff7cbf43af06d" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 42575 } }
I20260808 04:43:00.635560 4838 raft_consensus.cc:348] T ab36c17f462b44609bb82ff5b3defb65 P 3859384e3bed4d3c88c284d01ecf71be [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3859384e3bed4d3c88c284d01ecf71be" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 34749 } } peers { permanent_uuid: "0217252a13be4e29a06a3278372656a5" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 45275 } } peers { permanent_uuid: "64fe25f92a054bcc9b2ff7cbf43af06d" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 42575 } }
I20260808 04:43:00.635835 4837 raft_consensus.cc:374] T ab36c17f462b44609bb82ff5b3defb65 P 0217252a13be4e29a06a3278372656a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:43:00.635865 4838 raft_consensus.cc:374] T ab36c17f462b44609bb82ff5b3defb65 P 3859384e3bed4d3c88c284d01ecf71be [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:43:00.635916 4837 raft_consensus.cc:729] T ab36c17f462b44609bb82ff5b3defb65 P 0217252a13be4e29a06a3278372656a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0217252a13be4e29a06a3278372656a5, State: Initialized, Role: FOLLOWER
I20260808 04:43:00.635928 4838 raft_consensus.cc:729] T ab36c17f462b44609bb82ff5b3defb65 P 3859384e3bed4d3c88c284d01ecf71be [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3859384e3bed4d3c88c284d01ecf71be, State: Initialized, Role: FOLLOWER
I20260808 04:43:00.636368 4837 consensus_queue.cc:260] T ab36c17f462b44609bb82ff5b3defb65 P 0217252a13be4e29a06a3278372656a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3859384e3bed4d3c88c284d01ecf71be" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 34749 } } peers { permanent_uuid: "0217252a13be4e29a06a3278372656a5" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 45275 } } peers { permanent_uuid: "64fe25f92a054bcc9b2ff7cbf43af06d" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 42575 } }
I20260808 04:43:00.636379 4838 consensus_queue.cc:260] T ab36c17f462b44609bb82ff5b3defb65 P 3859384e3bed4d3c88c284d01ecf71be [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3859384e3bed4d3c88c284d01ecf71be" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 34749 } } peers { permanent_uuid: "0217252a13be4e29a06a3278372656a5" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 45275 } } peers { permanent_uuid: "64fe25f92a054bcc9b2ff7cbf43af06d" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 42575 } }
I20260808 04:43:00.637102 4824 heartbeater.cc:503] Master 127.20.240.254:46087 was elected leader, sending a full tablet report...
I20260808 04:43:00.637101 4679 heartbeater.cc:503] Master 127.20.240.254:46087 was elected leader, sending a full tablet report...
I20260808 04:43:00.637531 4837 ts_tablet_manager.cc:1428] T ab36c17f462b44609bb82ff5b3defb65 P 0217252a13be4e29a06a3278372656a5: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20260808 04:43:00.638450 4838 ts_tablet_manager.cc:1428] T ab36c17f462b44609bb82ff5b3defb65 P 3859384e3bed4d3c88c284d01ecf71be: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260808 04:43:00.731065 4529 raft_consensus.cc:482] T ab36c17f462b44609bb82ff5b3defb65 P 64fe25f92a054bcc9b2ff7cbf43af06d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 04:43:00.731350 4529 raft_consensus.cc:504] T ab36c17f462b44609bb82ff5b3defb65 P 64fe25f92a054bcc9b2ff7cbf43af06d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3859384e3bed4d3c88c284d01ecf71be" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 34749 } } peers { permanent_uuid: "0217252a13be4e29a06a3278372656a5" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 45275 } } peers { permanent_uuid: "64fe25f92a054bcc9b2ff7cbf43af06d" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 42575 } }
I20260808 04:43:00.732513 4529 leader_election.cc:288] T ab36c17f462b44609bb82ff5b3defb65 P 64fe25f92a054bcc9b2ff7cbf43af06d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3859384e3bed4d3c88c284d01ecf71be (127.20.240.194:34749), 0217252a13be4e29a06a3278372656a5 (127.20.240.195:45275)
I20260808 04:43:00.736575 4835 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:43:00.732922 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.240.193:52055 (local address 127.20.240.195:45275)
0808 04:43:00.733060 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0808 04:43:00.733065 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 04:43:00.733297 (+ 232us) server_negotiation.cc:407] Connection header received
0808 04:43:00.733499 (+ 202us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:43:00.733502 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:43:00.733553 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:43:00.733635 (+ 82us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 04:43:00.733939 (+ 304us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:43:00.734458 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:43:00.735538 (+ 1080us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:43:00.735949 (+ 411us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:43:00.736091 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:43:00.736148 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0808 04:43:00.736365 (+ 217us) server_negotiation.cc:299] Negotiation successful
0808 04:43:00.736435 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260808 04:43:00.736578 4844 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:43:00.732785 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.195:45275 (local address 127.20.240.193:52055)
0808 04:43:00.733191 (+ 406us) negotiation.cc:107] Waiting for socket to connect
0808 04:43:00.733209 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0808 04:43:00.733358 (+ 149us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:43:00.733659 (+ 301us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:43:00.733661 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:43:00.733678 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 04:43:00.733816 (+ 138us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:43:00.733821 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:43:00.734576 (+ 755us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:43:00.734581 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:43:00.735403 (+ 822us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:43:00.735413 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:43:00.736091 (+ 678us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:43:00.736095 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:43:00.736189 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:43:00.736247 (+ 58us) client_negotiation.cc:769] Sending connection context
0808 04:43:00.736346 (+ 99us) client_negotiation.cc:240] Negotiation successful
0808 04:43:00.736430 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":288,"thread_start_us":114,"threads_started":1}
I20260808 04:43:00.736750 4834 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:43:00.732919 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.240.193:50689 (local address 127.20.240.194:34749)
0808 04:43:00.733074 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0808 04:43:00.733080 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 04:43:00.733395 (+ 315us) server_negotiation.cc:407] Connection header received
0808 04:43:00.733562 (+ 167us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:43:00.733566 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:43:00.733622 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:43:00.733720 (+ 98us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 04:43:00.734041 (+ 321us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:43:00.734589 (+ 548us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:43:00.735663 (+ 1074us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:43:00.736102 (+ 439us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:43:00.736244 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:43:00.736297 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0808 04:43:00.736500 (+ 203us) server_negotiation.cc:299] Negotiation successful
0808 04:43:00.736573 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260808 04:43:00.736785 4845 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:43:00.732796 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.194:34749 (local address 127.20.240.193:50689)
0808 04:43:00.733285 (+ 489us) negotiation.cc:107] Waiting for socket to connect
0808 04:43:00.733305 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0808 04:43:00.733435 (+ 130us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:43:00.733729 (+ 294us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:43:00.733751 (+ 22us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:43:00.733769 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 04:43:00.733909 (+ 140us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:43:00.733916 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:43:00.734716 (+ 800us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:43:00.734722 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:43:00.735525 (+ 803us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:43:00.735534 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:43:00.736237 (+ 703us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:43:00.736241 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:43:00.736368 (+ 127us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:43:00.736387 (+ 19us) client_negotiation.cc:769] Sending connection context
0808 04:43:00.736482 (+ 95us) client_negotiation.cc:240] Negotiation successful
0808 04:43:00.736562 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":426,"thread_start_us":91,"threads_started":1}
I20260808 04:43:00.737346 4774 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ab36c17f462b44609bb82ff5b3defb65" candidate_uuid: "64fe25f92a054bcc9b2ff7cbf43af06d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0217252a13be4e29a06a3278372656a5" is_pre_election: true
I20260808 04:43:00.737437 4627 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ab36c17f462b44609bb82ff5b3defb65" candidate_uuid: "64fe25f92a054bcc9b2ff7cbf43af06d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3859384e3bed4d3c88c284d01ecf71be" is_pre_election: true
I20260808 04:43:00.737712 4774 raft_consensus.cc:2454] T ab36c17f462b44609bb82ff5b3defb65 P 0217252a13be4e29a06a3278372656a5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 64fe25f92a054bcc9b2ff7cbf43af06d in term 0.
I20260808 04:43:00.737762 4627 raft_consensus.cc:2454] T ab36c17f462b44609bb82ff5b3defb65 P 3859384e3bed4d3c88c284d01ecf71be [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 64fe25f92a054bcc9b2ff7cbf43af06d in term 0.
I20260808 04:43:00.738256 4391 leader_election.cc:302] T ab36c17f462b44609bb82ff5b3defb65 P 64fe25f92a054bcc9b2ff7cbf43af06d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 0217252a13be4e29a06a3278372656a5, 3859384e3bed4d3c88c284d01ecf71be, 64fe25f92a054bcc9b2ff7cbf43af06d; no voters:
I20260808 04:43:00.738564 4529 raft_consensus.cc:2781] T ab36c17f462b44609bb82ff5b3defb65 P 64fe25f92a054bcc9b2ff7cbf43af06d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 04:43:00.738652 4529 raft_consensus.cc:482] T ab36c17f462b44609bb82ff5b3defb65 P 64fe25f92a054bcc9b2ff7cbf43af06d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 04:43:00.738695 4529 raft_consensus.cc:3037] T ab36c17f462b44609bb82ff5b3defb65 P 64fe25f92a054bcc9b2ff7cbf43af06d [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:43:00.740116 4529 raft_consensus.cc:504] T ab36c17f462b44609bb82ff5b3defb65 P 64fe25f92a054bcc9b2ff7cbf43af06d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3859384e3bed4d3c88c284d01ecf71be" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 34749 } } peers { permanent_uuid: "0217252a13be4e29a06a3278372656a5" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 45275 } } peers { permanent_uuid: "64fe25f92a054bcc9b2ff7cbf43af06d" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 42575 } }
I20260808 04:43:00.740685 4529 leader_election.cc:288] T ab36c17f462b44609bb82ff5b3defb65 P 64fe25f92a054bcc9b2ff7cbf43af06d [CANDIDATE]: Term 1 election: Requested vote from peers 3859384e3bed4d3c88c284d01ecf71be (127.20.240.194:34749), 0217252a13be4e29a06a3278372656a5 (127.20.240.195:45275)
I20260808 04:43:00.741062 4627 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ab36c17f462b44609bb82ff5b3defb65" candidate_uuid: "64fe25f92a054bcc9b2ff7cbf43af06d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3859384e3bed4d3c88c284d01ecf71be"
I20260808 04:43:00.741212 4774 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ab36c17f462b44609bb82ff5b3defb65" candidate_uuid: "64fe25f92a054bcc9b2ff7cbf43af06d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0217252a13be4e29a06a3278372656a5"
I20260808 04:43:00.741264 4627 raft_consensus.cc:3037] T ab36c17f462b44609bb82ff5b3defb65 P 3859384e3bed4d3c88c284d01ecf71be [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:43:00.741374 4774 raft_consensus.cc:3037] T ab36c17f462b44609bb82ff5b3defb65 P 0217252a13be4e29a06a3278372656a5 [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:43:00.742389 4627 raft_consensus.cc:2454] T ab36c17f462b44609bb82ff5b3defb65 P 3859384e3bed4d3c88c284d01ecf71be [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 64fe25f92a054bcc9b2ff7cbf43af06d in term 1.
I20260808 04:43:00.742581 4774 raft_consensus.cc:2454] T ab36c17f462b44609bb82ff5b3defb65 P 0217252a13be4e29a06a3278372656a5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 64fe25f92a054bcc9b2ff7cbf43af06d in term 1.
I20260808 04:43:00.742697 4397 leader_election.cc:302] T ab36c17f462b44609bb82ff5b3defb65 P 64fe25f92a054bcc9b2ff7cbf43af06d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3859384e3bed4d3c88c284d01ecf71be, 64fe25f92a054bcc9b2ff7cbf43af06d; no voters:
I20260808 04:43:00.742973 4529 raft_consensus.cc:2781] T ab36c17f462b44609bb82ff5b3defb65 P 64fe25f92a054bcc9b2ff7cbf43af06d [term 1 FOLLOWER]: Leader election won for term 1
I20260808 04:43:00.743201 4529 raft_consensus.cc:686] T ab36c17f462b44609bb82ff5b3defb65 P 64fe25f92a054bcc9b2ff7cbf43af06d [term 1 LEADER]: Becoming Leader. State: Replica: 64fe25f92a054bcc9b2ff7cbf43af06d, State: Running, Role: LEADER
I20260808 04:43:00.743503 4529 consensus_queue.cc:237] T ab36c17f462b44609bb82ff5b3defb65 P 64fe25f92a054bcc9b2ff7cbf43af06d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3859384e3bed4d3c88c284d01ecf71be" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 34749 } } peers { permanent_uuid: "0217252a13be4e29a06a3278372656a5" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 45275 } } peers { permanent_uuid: "64fe25f92a054bcc9b2ff7cbf43af06d" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 42575 } }
I20260808 04:43:00.746836 4309 catalog_manager.cc:5495] T ab36c17f462b44609bb82ff5b3defb65 P 64fe25f92a054bcc9b2ff7cbf43af06d reported cstate change: term changed from 0 to 1, leader changed from <none> to 64fe25f92a054bcc9b2ff7cbf43af06d (127.20.240.193). New cstate: current_term: 1 leader_uuid: "64fe25f92a054bcc9b2ff7cbf43af06d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3859384e3bed4d3c88c284d01ecf71be" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 34749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0217252a13be4e29a06a3278372656a5" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 45275 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "64fe25f92a054bcc9b2ff7cbf43af06d" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 42575 } health_report { overall_health: HEALTHY } } }
I20260808 04:43:00.769418 4849 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:43:00.765619 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44942 (local address 127.20.240.193:42575)
0808 04:43:00.765961 (+ 342us) server_negotiation.cc:206] Beginning negotiation
0808 04:43:00.765969 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 04:43:00.765980 (+ 11us) server_negotiation.cc:407] Connection header received
0808 04:43:00.766054 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:43:00.766056 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:43:00.766108 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:43:00.766240 (+ 132us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 04:43:00.766518 (+ 278us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:43:00.767031 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:43:00.767873 (+ 842us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:43:00.768101 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:43:00.768212 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:43:00.768506 (+ 294us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 04:43:00.768962 (+ 456us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 04:43:00.769084 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0808 04:43:00.769182 (+ 98us) server_negotiation.cc:299] Negotiation successful
0808 04:43:00.769241 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":260,"thread_start_us":105,"threads_started":1}
I20260808 04:43:00.773535 4627 raft_consensus.cc:1261] T ab36c17f462b44609bb82ff5b3defb65 P 3859384e3bed4d3c88c284d01ecf71be [term 1 FOLLOWER]: Refusing update from remote peer 64fe25f92a054bcc9b2ff7cbf43af06d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 04:43:00.773535 4774 raft_consensus.cc:1261] T ab36c17f462b44609bb82ff5b3defb65 P 0217252a13be4e29a06a3278372656a5 [term 1 FOLLOWER]: Refusing update from remote peer 64fe25f92a054bcc9b2ff7cbf43af06d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 04:43:00.774268 4846 consensus_queue.cc:1035] T ab36c17f462b44609bb82ff5b3defb65 P 64fe25f92a054bcc9b2ff7cbf43af06d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3859384e3bed4d3c88c284d01ecf71be" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 34749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 04:43:00.774489 4529 consensus_queue.cc:1035] T ab36c17f462b44609bb82ff5b3defb65 P 64fe25f92a054bcc9b2ff7cbf43af06d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0217252a13be4e29a06a3278372656a5" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 04:43:00.784307 4852 mvcc.cc:205] Tried to move back new op lower bound from 7316128484441751552 to 7316128484328394752. Current Snapshot: MvccSnapshot[applied={T|T < 7316128484441751552}]
I20260808 04:43:00.784533 4851 mvcc.cc:205] Tried to move back new op lower bound from 7316128484441751552 to 7316128484328394752. Current Snapshot: MvccSnapshot[applied={T|T < 7316128484441751552}]
I20260808 04:43:00.791146 4311 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin'} at 127.0.0.1:58972:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 04:43:00.791436 4311 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin'} at 127.0.0.1:58972:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 04:43:00.794004 4311 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 107010403a3944a09c963231a87a6b5e: Sending DeleteTablet for 3 replicas of tablet ab36c17f462b44609bb82ff5b3defb65
I20260808 04:43:00.794734 4450 tablet_service.cc:1514] Processing DeleteTablet for tablet ab36c17f462b44609bb82ff5b3defb65 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 04:43:00 UTC) from {username='kudu', principal='kudu/127.20.240.254@KRBTEST.COM'} at 127.0.0.1:44934
I20260808 04:43:00.794795 4604 tablet_service.cc:1514] Processing DeleteTablet for tablet ab36c17f462b44609bb82ff5b3defb65 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 04:43:00 UTC) from {username='kudu', principal='kudu/127.20.240.254@KRBTEST.COM'} at 127.0.0.1:40730
I20260808 04:43:00.794831 4752 tablet_service.cc:1514] Processing DeleteTablet for tablet ab36c17f462b44609bb82ff5b3defb65 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 04:43:00 UTC) from {username='kudu', principal='kudu/127.20.240.254@KRBTEST.COM'} at 127.0.0.1:36000
I20260808 04:43:00.795361 4861 tablet_replica.cc:330] T ab36c17f462b44609bb82ff5b3defb65 P 64fe25f92a054bcc9b2ff7cbf43af06d: stopping tablet replica
I20260808 04:43:00.795508 4861 raft_consensus.cc:2229] T ab36c17f462b44609bb82ff5b3defb65 P 64fe25f92a054bcc9b2ff7cbf43af06d [term 1 LEADER]: Raft consensus shutting down.
I20260808 04:43:00.795672 4862 tablet_replica.cc:330] T ab36c17f462b44609bb82ff5b3defb65 P 0217252a13be4e29a06a3278372656a5: stopping tablet replica
I20260808 04:43:00.795696 21443 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu with pid 4353
I20260808 04:43:00.797966 4862 raft_consensus.cc:2229] T ab36c17f462b44609bb82ff5b3defb65 P 0217252a13be4e29a06a3278372656a5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 04:43:00.798296 4862 raft_consensus.cc:2258] T ab36c17f462b44609bb82ff5b3defb65 P 0217252a13be4e29a06a3278372656a5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 04:43:00.798727 4863 tablet_replica.cc:330] T ab36c17f462b44609bb82ff5b3defb65 P 3859384e3bed4d3c88c284d01ecf71be: stopping tablet replica
I20260808 04:43:00.799015 4863 raft_consensus.cc:2229] T ab36c17f462b44609bb82ff5b3defb65 P 3859384e3bed4d3c88c284d01ecf71be [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 04:43:00.799310 4863 raft_consensus.cc:2258] T ab36c17f462b44609bb82ff5b3defb65 P 3859384e3bed4d3c88c284d01ecf71be [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 04:43:00.800704 4863 ts_tablet_manager.cc:1905] T ab36c17f462b44609bb82ff5b3defb65 P 3859384e3bed4d3c88c284d01ecf71be: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 04:43:00.801065 4862 ts_tablet_manager.cc:1905] T ab36c17f462b44609bb82ff5b3defb65 P 0217252a13be4e29a06a3278372656a5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 04:43:00.803130 4863 ts_tablet_manager.cc:1918] T ab36c17f462b44609bb82ff5b3defb65 P 3859384e3bed4d3c88c284d01ecf71be: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 04:43:00.803220 4863 log.cc:1196] T ab36c17f462b44609bb82ff5b3defb65 P 3859384e3bed4d3c88c284d01ecf71be: Deleting WAL directory at /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164000593138-21443-0/minicluster-data/ts-1/wal/wals/ab36c17f462b44609bb82ff5b3defb65
I20260808 04:43:00.803460 4863 ts_tablet_manager.cc:1939] T ab36c17f462b44609bb82ff5b3defb65 P 3859384e3bed4d3c88c284d01ecf71be: Deleting consensus metadata
I20260808 04:43:00.804808 4294 catalog_manager.cc:4841] TS 3859384e3bed4d3c88c284d01ecf71be (127.20.240.194:34749): tablet ab36c17f462b44609bb82ff5b3defb65 (table test-table [id=654a46482487492ba4caa9a38d1f2a45]) successfully deleted
I20260808 04:43:00.804888 4862 ts_tablet_manager.cc:1918] T ab36c17f462b44609bb82ff5b3defb65 P 0217252a13be4e29a06a3278372656a5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 04:43:00.805090 4862 log.cc:1196] T ab36c17f462b44609bb82ff5b3defb65 P 0217252a13be4e29a06a3278372656a5: Deleting WAL directory at /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164000593138-21443-0/minicluster-data/ts-2/wal/wals/ab36c17f462b44609bb82ff5b3defb65
I20260808 04:43:00.805495 4862 ts_tablet_manager.cc:1939] T ab36c17f462b44609bb82ff5b3defb65 P 0217252a13be4e29a06a3278372656a5: Deleting consensus metadata
I20260808 04:43:00.806061 21443 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu with pid 4527
W20260808 04:43:00.806064 4292 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.20.240.193:42575 (error 108)
I20260808 04:43:00.809051 4289 catalog_manager.cc:4841] TS 0217252a13be4e29a06a3278372656a5 (127.20.240.195:45275): tablet ab36c17f462b44609bb82ff5b3defb65 (table test-table [id=654a46482487492ba4caa9a38d1f2a45]) successfully deleted
I20260808 04:43:00.809329 4530 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:43:00.808825 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.193:42575 (local address 127.0.0.1:44956)
0808 04:43:00.809092 (+ 267us) negotiation.cc:107] Waiting for socket to connect
0808 04:43:00.809227 (+ 135us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.240.193:42575: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":180}
W20260808 04:43:00.809517 4292 catalog_manager.cc:4584] TS 64fe25f92a054bcc9b2ff7cbf43af06d (127.20.240.193:42575): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet ab36c17f462b44609bb82ff5b3defb65: Network error: Client connection negotiation failed: client connection to 127.20.240.193:42575: connect: Connection refused (error 111)
I20260808 04:43:00.813951 21443 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu with pid 4682
I20260808 04:43:00.821929 21443 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu with pid 4272
I20260808 04:43:00.829703 21443 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
/tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164000593138-21443-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164000593138-21443-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164000593138-21443-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164000593138-21443-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.240.254:46087
--webserver_interface=127.20.240.254
--webserver_port=44713
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.254.keytab
--principal=kudu/127.20.240.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.240.212:33995
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.240.254:46087
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164000593138-21443-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164000593138-21443-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164000593138-21443-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 04:43:00.943607 4865 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:43:00.943933 4865 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:43:00.944052 4865 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:43:00.948159 4865 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 04:43:00.948261 4865 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:43:00.948297 4865 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:43:00.948334 4865 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 04:43:00.948367 4865 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 04:43:00.953987 4865 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.240.212:33995
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164000593138-21443-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164000593138-21443-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.240.254:46087
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.254.keytab
--principal=kudu/127.20.240.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.240.254:46087
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164000593138-21443-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.240.254
--webserver_port=44713
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4865
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164000593138-21443-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 04:05:18 UTC on ccycloud.quasar-drfdgt.root.comops.site
build id 4574101
I20260808 04:43:00.955174 4865 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:43:00.956283 4865 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:43:00.965232 4870 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:43:00.965224 4871 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:43:00.965232 4873 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:43:00.965603 4865 server_base.cc:1034] running on GCE node
I20260808 04:43:00.966279 4865 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:43:00.967466 4865 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:43:00.968642 4865 hybrid_clock.cc:648] HybridClock initialized: now 1786164180968605 us; error 53 us; skew 500 ppm
Aug 08 04:43:00 dist-test-slave-vxj2 krb5kdc[3665](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164180, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.240.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:43:00.971474 4865 init.cc:377] Logged in from keytab as kudu/127.20.240.254@KRBTEST.COM (short username kudu)
I20260808 04:43:00.972361 4865 webserver.cc:460] Webserver started at http://127.20.240.254:44713/ using document root <none> and password file <none>
I20260808 04:43:00.972879 4865 fs_manager.cc:359] Metadata directory not provided
I20260808 04:43:00.972939 4865 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:43:00.976905 4865 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.001s
I20260808 04:43:00.979176 4881 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:43:00.980515 4865 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20260808 04:43:00.980623 4865 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164000593138-21443-0/minicluster-data/master-0/data,/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164000593138-21443-0/minicluster-data/master-0/wal
uuid: "107010403a3944a09c963231a87a6b5e"
format_stamp: "Formatted at 2026-08-08 04:42:58 on dist-test-slave-vxj2"
server_key: "beb698de7980809b1080ce76fc69508b"
server_key_iv: "9fc98e5bf9bd0575b57f71b4511c5982"
server_key_version: "encryptionkey@0"
I20260808 04:43:00.981308 4865 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164000593138-21443-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164000593138-21443-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164000593138-21443-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:43:00.996518 4865 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:43:00.999752 4865 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:43:00.999970 4865 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:43:01.007692 4865 rpc_server.cc:307] RPC server started. Bound to: 127.20.240.254:46087
I20260808 04:43:01.008008 4941 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.240.254:46087 every 8 connection(s)
I20260808 04:43:01.008934 4865 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164000593138-21443-0/minicluster-data/master-0/data/info.pb
I20260808 04:43:01.013473 4942 sys_catalog.cc:263] Verifying existing consensus state
I20260808 04:43:01.015305 4942 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 107010403a3944a09c963231a87a6b5e: Bootstrap starting.
I20260808 04:43:01.016942 21443 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu as pid 4865
I20260808 04:43:01.017505 21443 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
/tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164000593138-21443-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164000593138-21443-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164000593138-21443-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164000593138-21443-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.240.193:42575
--local_ip_for_outbound_sockets=127.20.240.193
--tserver_master_addrs=127.20.240.254:46087
--webserver_port=44435
--webserver_interface=127.20.240.193
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.193.keytab
--principal=kudu/127.20.240.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.240.212:33995
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164000593138-21443-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164000593138-21443-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164000593138-21443-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 04:43:01.034873 4942 log.cc:824] T 00000000000000000000000000000000 P 107010403a3944a09c963231a87a6b5e: Log is configured to *not* fsync() on all Append() calls
I20260808 04:43:01.047425 4942 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 107010403a3944a09c963231a87a6b5e: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=7 ignored=0} mutations{seen=9 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 04:43:01.047928 4942 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 107010403a3944a09c963231a87a6b5e: Bootstrap complete.
I20260808 04:43:01.052187 4942 raft_consensus.cc:348] T 00000000000000000000000000000000 P 107010403a3944a09c963231a87a6b5e [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "107010403a3944a09c963231a87a6b5e" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 46087 } }
I20260808 04:43:01.052717 4942 raft_consensus.cc:729] T 00000000000000000000000000000000 P 107010403a3944a09c963231a87a6b5e [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 107010403a3944a09c963231a87a6b5e, State: Initialized, Role: FOLLOWER
I20260808 04:43:01.053308 4942 consensus_queue.cc:260] T 00000000000000000000000000000000 P 107010403a3944a09c963231a87a6b5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "107010403a3944a09c963231a87a6b5e" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 46087 } }
I20260808 04:43:01.053433 4942 raft_consensus.cc:388] T 00000000000000000000000000000000 P 107010403a3944a09c963231a87a6b5e [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 04:43:01.053527 4942 raft_consensus.cc:482] T 00000000000000000000000000000000 P 107010403a3944a09c963231a87a6b5e [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 04:43:01.053653 4942 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 107010403a3944a09c963231a87a6b5e [term 2 FOLLOWER]: Advancing to term 3
I20260808 04:43:01.055734 4942 raft_consensus.cc:504] T 00000000000000000000000000000000 P 107010403a3944a09c963231a87a6b5e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "107010403a3944a09c963231a87a6b5e" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 46087 } }
I20260808 04:43:01.056114 4942 leader_election.cc:302] T 00000000000000000000000000000000 P 107010403a3944a09c963231a87a6b5e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 107010403a3944a09c963231a87a6b5e; no voters:
I20260808 04:43:01.056509 4942 leader_election.cc:288] T 00000000000000000000000000000000 P 107010403a3944a09c963231a87a6b5e [CANDIDATE]: Term 3 election: Requested vote from peers
I20260808 04:43:01.056612 4946 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 107010403a3944a09c963231a87a6b5e [term 3 FOLLOWER]: Leader election won for term 3
I20260808 04:43:01.056823 4946 raft_consensus.cc:686] T 00000000000000000000000000000000 P 107010403a3944a09c963231a87a6b5e [term 3 LEADER]: Becoming Leader. State: Replica: 107010403a3944a09c963231a87a6b5e, State: Running, Role: LEADER
I20260808 04:43:01.057137 4946 consensus_queue.cc:237] T 00000000000000000000000000000000 P 107010403a3944a09c963231a87a6b5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "107010403a3944a09c963231a87a6b5e" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 46087 } }
I20260808 04:43:01.057912 4942 sys_catalog.cc:564] T 00000000000000000000000000000000 P 107010403a3944a09c963231a87a6b5e [sys.catalog]: configured and running, proceeding with master startup.
I20260808 04:43:01.058600 4949 sys_catalog.cc:455] T 00000000000000000000000000000000 P 107010403a3944a09c963231a87a6b5e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "107010403a3944a09c963231a87a6b5e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "107010403a3944a09c963231a87a6b5e" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 46087 } } }
I20260808 04:43:01.058753 4949 sys_catalog.cc:458] T 00000000000000000000000000000000 P 107010403a3944a09c963231a87a6b5e [sys.catalog]: This master's current role is: LEADER
I20260808 04:43:01.059479 4956 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 04:43:01.059517 4950 sys_catalog.cc:455] T 00000000000000000000000000000000 P 107010403a3944a09c963231a87a6b5e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 107010403a3944a09c963231a87a6b5e. Latest consensus state: current_term: 3 leader_uuid: "107010403a3944a09c963231a87a6b5e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "107010403a3944a09c963231a87a6b5e" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 46087 } } }
I20260808 04:43:01.059645 4950 sys_catalog.cc:458] T 00000000000000000000000000000000 P 107010403a3944a09c963231a87a6b5e [sys.catalog]: This master's current role is: LEADER
I20260808 04:43:01.065490 4956 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 04:43:01.066571 4956 catalog_manager.cc:1259] Loaded cluster ID: 011e5d9609d5482ab7bc89a7c86def27
I20260808 04:43:01.066653 4956 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
F20260808 04:43:01.067793 4956 catalog_manager.cc:1466] Initializing Kudu internal certificate authority failed: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7fab441719ad google::LogMessage::Fail() at ??:0
@ 0x7fab4417488a google::LogMessage::SendToLog() at ??:0
@ 0x7fab441714de google::LogMessage::Flush() at ??:0
@ 0x7fab44172a19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7fab4eab0fdd _ZZN4kudu6master14CatalogManager24PrepareForLeadershipTaskEvENKUlSt8functionIFNS_6StatusEvEERKNS_9consensus13RaftConsensusElPKcE_clES5_S9_lSB_ at ??:0
@ 0x7fab4eab1d2f kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7fab4eaae579 _ZZN4kudu6master14CatalogManager17ElectedAsLeaderCbEvENKUlvE_clEv at ??:0
@ 0x7fab4eaf2640 _ZNSt17_Function_handlerIFvvEZN4kudu6master14CatalogManager17ElectedAsLeaderCbEvEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x61d838 std::function<>::operator()() at ??:0
@ 0x7fab463c33d7 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7fab463c3c83 _ZZN4kudu10ThreadPool12CreateThreadEvENKUlvE_clEv at ??:0
@ 0x7fab463c53f2 _ZNSt17_Function_handlerIFvvEZN4kudu10ThreadPool12CreateThreadEvEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x61d838 std::function<>::operator()() at ??:0
@ 0x7fab463b4512 kudu::Thread::SuperviseThread() at ??:0
@ 0x7fab479f86db start_thread at ??:0
@ 0x7fab42c6f61f clone at ??:0
W20260808 04:43:01.175170 4944 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:43:01.175575 4944 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:43:01.175649 4944 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:43:01.182199 4944 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:43:01.182446 4944 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:43:01.182552 4944 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.240.193
I20260808 04:43:01.191169 4944 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.240.212:33995
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164000593138-21443-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164000593138-21443-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.193.keytab
--principal=kudu/127.20.240.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.240.193:42575
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164000593138-21443-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.240.193
--webserver_port=44435
--tserver_master_addrs=127.20.240.254:46087
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4944
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.240.193
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164000593138-21443-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 04:05:18 UTC on ccycloud.quasar-drfdgt.root.comops.site
build id 4574101
I20260808 04:43:01.192663 4944 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:43:01.194087 4944 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:43:01.207847 4989 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:43:01.207847 4990 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:43:01.207847 4992 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:43:01.208124 4944 server_base.cc:1034] running on GCE node
I20260808 04:43:01.208855 4944 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:43:01.209781 4944 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:43:01.211011 4944 hybrid_clock.cc:648] HybridClock initialized: now 1786164181210972 us; error 50 us; skew 500 ppm
Aug 08 04:43:01 dist-test-slave-vxj2 krb5kdc[3665](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164181, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.240.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:43:01.214716 4944 init.cc:377] Logged in from keytab as kudu/127.20.240.193@KRBTEST.COM (short username kudu)
I20260808 04:43:01.216001 4944 webserver.cc:460] Webserver started at http://127.20.240.193:44435/ using document root <none> and password file <none>
I20260808 04:43:01.216571 4944 fs_manager.cc:359] Metadata directory not provided
I20260808 04:43:01.216634 4944 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:43:01.220944 4944 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.000s
I20260808 04:43:01.223505 5000 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:43:01.224972 4944 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260808 04:43:01.225190 4944 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164000593138-21443-0/minicluster-data/ts-0/data,/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164000593138-21443-0/minicluster-data/ts-0/wal
uuid: "64fe25f92a054bcc9b2ff7cbf43af06d"
format_stamp: "Formatted at 2026-08-08 04:42:58 on dist-test-slave-vxj2"
server_key: "617e2dd309f1e1a1643be80f47ea13fe"
server_key_iv: "9e362114cf5b7100bae2cc4c3a257fe3"
server_key_version: "encryptionkey@0"
I20260808 04:43:01.225850 4944 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164000593138-21443-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164000593138-21443-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164000593138-21443-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:43:01.245361 4944 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:43:01.248838 4944 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:43:01.249079 4944 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:43:01.249733 4944 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 04:43:01.250900 5008 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260808 04:43:01.256534 4944 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260808 04:43:01.256637 4944 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.006s user 0.000s sys 0.000s
I20260808 04:43:01.256745 4944 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260808 04:43:01.258630 4944 ts_tablet_manager.cc:610] Registered 1 tablets
I20260808 04:43:01.258709 4944 ts_tablet_manager.cc:589] Time spent register tablets: real 0.002s user 0.001s sys 0.000s
I20260808 04:43:01.259057 5008 tablet_bootstrap.cc:492] T ab36c17f462b44609bb82ff5b3defb65 P 64fe25f92a054bcc9b2ff7cbf43af06d: Bootstrap starting.
I20260808 04:43:01.270102 4944 rpc_server.cc:307] RPC server started. Bound to: 127.20.240.193:42575
I20260808 04:43:01.270499 5126 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.240.193:42575 every 8 connection(s)
I20260808 04:43:01.271312 4944 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164000593138-21443-0/minicluster-data/ts-0/data/info.pb
I20260808 04:43:01.276317 21443 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu as pid 4944
I20260808 04:43:01.276911 21443 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
/tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164000593138-21443-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164000593138-21443-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164000593138-21443-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164000593138-21443-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.240.194:34749
--local_ip_for_outbound_sockets=127.20.240.194
--tserver_master_addrs=127.20.240.254:46087
--webserver_port=38461
--webserver_interface=127.20.240.194
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.194.keytab
--principal=kudu/127.20.240.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.240.212:33995
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164000593138-21443-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164000593138-21443-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164000593138-21443-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 04:43:01.282078 5008 log.cc:824] T ab36c17f462b44609bb82ff5b3defb65 P 64fe25f92a054bcc9b2ff7cbf43af06d: Log is configured to *not* fsync() on all Append() calls
I20260808 04:43:01.291531 5008 tablet_bootstrap.cc:492] T ab36c17f462b44609bb82ff5b3defb65 P 64fe25f92a054bcc9b2ff7cbf43af06d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 04:43:01.292008 5008 tablet_bootstrap.cc:492] T ab36c17f462b44609bb82ff5b3defb65 P 64fe25f92a054bcc9b2ff7cbf43af06d: Bootstrap complete.
I20260808 04:43:01.293474 5008 ts_tablet_manager.cc:1397] T ab36c17f462b44609bb82ff5b3defb65 P 64fe25f92a054bcc9b2ff7cbf43af06d: Time spent bootstrapping tablet: real 0.035s user 0.022s sys 0.012s
I20260808 04:43:01.296905 5008 raft_consensus.cc:348] T ab36c17f462b44609bb82ff5b3defb65 P 64fe25f92a054bcc9b2ff7cbf43af06d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3859384e3bed4d3c88c284d01ecf71be" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 34749 } } peers { permanent_uuid: "0217252a13be4e29a06a3278372656a5" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 45275 } } peers { permanent_uuid: "64fe25f92a054bcc9b2ff7cbf43af06d" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 42575 } }
I20260808 04:43:01.297467 5008 raft_consensus.cc:729] T ab36c17f462b44609bb82ff5b3defb65 P 64fe25f92a054bcc9b2ff7cbf43af06d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 64fe25f92a054bcc9b2ff7cbf43af06d, State: Initialized, Role: FOLLOWER
I20260808 04:43:01.297995 5008 consensus_queue.cc:260] T ab36c17f462b44609bb82ff5b3defb65 P 64fe25f92a054bcc9b2ff7cbf43af06d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3859384e3bed4d3c88c284d01ecf71be" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 34749 } } peers { permanent_uuid: "0217252a13be4e29a06a3278372656a5" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 45275 } } peers { permanent_uuid: "64fe25f92a054bcc9b2ff7cbf43af06d" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 42575 } }
I20260808 04:43:01.299042 5008 ts_tablet_manager.cc:1428] T ab36c17f462b44609bb82ff5b3defb65 P 64fe25f92a054bcc9b2ff7cbf43af06d: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
W20260808 04:43:01.319813 5129 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 04:43:01.273551 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:46087 (local address 127.20.240.193:39489)
0808 04:43:01.274058 (+ 507us) negotiation.cc:107] Waiting for socket to connect
0808 04:43:01.274114 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0808 04:43:01.274958 (+ 844us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:43:01.318833 (+ 43875us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.240.254:46087: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":284,"thread_start_us":146,"threads_started":1}
W20260808 04:43:01.320410 5127 heartbeater.cc:644] Failed to heartbeat to 127.20.240.254:46087 (0 consecutive failures): Network error: Failed to ping master at 127.20.240.254:46087: Client connection negotiation failed: client connection to 127.20.240.254:46087: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260808 04:43:01.321228 5129 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:43:01.320884 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:46087 (local address 127.20.240.193:39287)
0808 04:43:01.321037 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0808 04:43:01.321126 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.240.254:46087: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
I20260808 04:43:01.321959 5129 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:43:01.321726 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:46087 (local address 127.20.240.193:52797)
0808 04:43:01.321843 (+ 117us) negotiation.cc:107] Waiting for socket to connect
0808 04:43:01.321896 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.240.254:46087: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
W20260808 04:43:01.322154 5127 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260808 04:43:01.402129 5130 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:43:01.402447 5130 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:43:01.402523 5130 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:43:01.407172 5130 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:43:01.407277 5130 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:43:01.407372 5130 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.240.194
I20260808 04:43:01.412935 5130 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.240.212:33995
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164000593138-21443-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164000593138-21443-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.194.keytab
--principal=kudu/127.20.240.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.240.194:34749
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164000593138-21443-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.240.194
--webserver_port=38461
--tserver_master_addrs=127.20.240.254:46087
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5130
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.240.194
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164000593138-21443-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 04:05:18 UTC on ccycloud.quasar-drfdgt.root.comops.site
build id 4574101
I20260808 04:43:01.414083 5130 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:43:01.415149 5130 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:43:01.424875 5137 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:43:01.424901 5141 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:43:01.424888 5138 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:43:01.425261 5130 server_base.cc:1034] running on GCE node
I20260808 04:43:01.425890 5130 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:43:01.426501 5130 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:43:01.427659 5130 hybrid_clock.cc:648] HybridClock initialized: now 1786164181427646 us; error 25 us; skew 500 ppm
Aug 08 04:43:01 dist-test-slave-vxj2 krb5kdc[3665](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164181, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.240.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:43:01.430534 5130 init.cc:377] Logged in from keytab as kudu/127.20.240.194@KRBTEST.COM (short username kudu)
I20260808 04:43:01.431465 5130 webserver.cc:460] Webserver started at http://127.20.240.194:38461/ using document root <none> and password file <none>
I20260808 04:43:01.432032 5130 fs_manager.cc:359] Metadata directory not provided
I20260808 04:43:01.432127 5130 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:43:01.435941 5130 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.001s sys 0.001s
I20260808 04:43:01.438043 5149 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:43:01.439393 5130 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 04:43:01.439572 5130 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164000593138-21443-0/minicluster-data/ts-1/data,/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164000593138-21443-0/minicluster-data/ts-1/wal
uuid: "3859384e3bed4d3c88c284d01ecf71be"
format_stamp: "Formatted at 2026-08-08 04:42:59 on dist-test-slave-vxj2"
server_key: "18344e6552b0a41168d36d0de9cedceb"
server_key_iv: "abfe9930238821ce0e5e1b2719c68012"
server_key_version: "encryptionkey@0"
I20260808 04:43:01.440136 5130 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164000593138-21443-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164000593138-21443-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164000593138-21443-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:43:01.451750 5130 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:43:01.454767 5130 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:43:01.454989 5130 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:43:01.455610 5130 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 04:43:01.456483 5130 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 04:43:01.456558 5130 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 04:43:01.456630 5130 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 04:43:01.456684 5130 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 04:43:01.466213 5130 rpc_server.cc:307] RPC server started. Bound to: 127.20.240.194:34749
I20260808 04:43:01.466233 5276 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.240.194:34749 every 8 connection(s)
I20260808 04:43:01.467315 5130 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164000593138-21443-0/minicluster-data/ts-1/data/info.pb
I20260808 04:43:01.471498 5280 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:43:01.469604 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:46087 (local address 127.20.240.194:53729)
0808 04:43:01.470080 (+ 476us) negotiation.cc:107] Waiting for socket to connect
0808 04:43:01.470210 (+ 130us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.240.254:46087: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":273,"thread_start_us":114,"threads_started":1}
W20260808 04:43:01.472069 5278 heartbeater.cc:644] Failed to heartbeat to 127.20.240.254:46087 (0 consecutive failures): Network error: Failed to ping master at 127.20.240.254:46087: Client connection negotiation failed: client connection to 127.20.240.254:46087: connect: Connection refused (error 111)
I20260808 04:43:01.472743 5280 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:43:01.472509 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:46087 (local address 127.20.240.194:51125)
0808 04:43:01.472626 (+ 117us) negotiation.cc:107] Waiting for socket to connect
0808 04:43:01.472681 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.240.254:46087: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
I20260808 04:43:01.473544 5280 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:43:01.473340 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:46087 (local address 127.20.240.194:51321)
0808 04:43:01.473448 (+ 108us) negotiation.cc:107] Waiting for socket to connect
0808 04:43:01.473492 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.240.254:46087: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
W20260808 04:43:01.473748 5278 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260808 04:43:01.474645 21443 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu as pid 5130
I20260808 04:43:01.475087 21443 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
/tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164000593138-21443-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164000593138-21443-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164000593138-21443-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164000593138-21443-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.240.195:45275
--local_ip_for_outbound_sockets=127.20.240.195
--tserver_master_addrs=127.20.240.254:46087
--webserver_port=43451
--webserver_interface=127.20.240.195
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.195.keytab
--principal=kudu/127.20.240.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.240.212:33995
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164000593138-21443-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164000593138-21443-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164000593138-21443-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 04:43:01.589376 5281 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:43:01.589648 5281 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:43:01.589717 5281 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:43:01.593752 5281 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:43:01.593815 5281 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:43:01.593892 5281 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.240.195
I20260808 04:43:01.599081 5281 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.240.212:33995
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164000593138-21443-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164000593138-21443-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.195.keytab
--principal=kudu/127.20.240.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.240.195:45275
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164000593138-21443-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.240.195
--webserver_port=43451
--tserver_master_addrs=127.20.240.254:46087
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5281
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.240.195
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164000593138-21443-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 04:05:18 UTC on ccycloud.quasar-drfdgt.root.comops.site
build id 4574101
I20260808 04:43:01.600194 5281 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:43:01.601327 5281 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:43:01.611299 5290 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:43:01.611263 5287 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:43:01.611397 5281 server_base.cc:1034] running on GCE node
W20260808 04:43:01.611621 5288 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:43:01.612015 5281 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:43:01.612758 5281 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:43:01.613919 5281 hybrid_clock.cc:648] HybridClock initialized: now 1786164181613884 us; error 46 us; skew 500 ppm
Aug 08 04:43:01 dist-test-slave-vxj2 krb5kdc[3665](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164181, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.240.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:43:01.616864 5281 init.cc:377] Logged in from keytab as kudu/127.20.240.195@KRBTEST.COM (short username kudu)
I20260808 04:43:01.617882 5281 webserver.cc:460] Webserver started at http://127.20.240.195:43451/ using document root <none> and password file <none>
I20260808 04:43:01.618453 5281 fs_manager.cc:359] Metadata directory not provided
I20260808 04:43:01.618515 5281 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:43:01.622741 5281 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260808 04:43:01.624888 5297 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:43:01.626255 5281 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 04:43:01.626407 5281 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164000593138-21443-0/minicluster-data/ts-2/data,/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164000593138-21443-0/minicluster-data/ts-2/wal
uuid: "0217252a13be4e29a06a3278372656a5"
format_stamp: "Formatted at 2026-08-08 04:42:59 on dist-test-slave-vxj2"
server_key: "dbb37e4962e56d7a3085312d70520474"
server_key_iv: "a8c14e10faac394df636ac2af53cca90"
server_key_version: "encryptionkey@0"
I20260808 04:43:01.627035 5281 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164000593138-21443-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164000593138-21443-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164000593138-21443-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:43:01.659690 5281 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:43:01.663319 5281 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:43:01.663543 5281 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:43:01.664191 5281 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 04:43:01.665064 5281 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 04:43:01.665139 5281 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 04:43:01.665238 5281 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 04:43:01.665292 5281 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 04:43:01.674963 5281 rpc_server.cc:307] RPC server started. Bound to: 127.20.240.195:45275
I20260808 04:43:01.674991 5425 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.240.195:45275 every 8 connection(s)
I20260808 04:43:01.675984 5281 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164000593138-21443-0/minicluster-data/ts-2/data/info.pb
I20260808 04:43:01.680166 5432 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:43:01.678281 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:46087 (local address 127.20.240.195:36811)
0808 04:43:01.678760 (+ 479us) negotiation.cc:107] Waiting for socket to connect
0808 04:43:01.678963 (+ 203us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.240.254:46087: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":277,"thread_start_us":114,"threads_started":1}
W20260808 04:43:01.680609 5426 heartbeater.cc:644] Failed to heartbeat to 127.20.240.254:46087 (0 consecutive failures): Network error: Failed to ping master at 127.20.240.254:46087: Client connection negotiation failed: client connection to 127.20.240.254:46087: connect: Connection refused (error 111)
I20260808 04:43:01.681321 5432 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:43:01.681064 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:46087 (local address 127.20.240.195:53461)
0808 04:43:01.681207 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0808 04:43:01.681268 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.240.254:46087: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
I20260808 04:43:01.681937 5432 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:43:01.681729 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:46087 (local address 127.20.240.195:55723)
0808 04:43:01.681833 (+ 104us) negotiation.cc:107] Waiting for socket to connect
0808 04:43:01.681880 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.240.254:46087: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
W20260808 04:43:01.682138 5426 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260808 04:43:01.683578 21443 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu as pid 5281
I20260808 04:43:02.323421 5434 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:43:02.322889 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:46087 (local address 127.20.240.193:39791)
0808 04:43:02.323208 (+ 319us) negotiation.cc:107] Waiting for socket to connect
0808 04:43:02.323282 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.240.254:46087: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":231,"thread_start_us":84,"threads_started":1}
I20260808 04:43:02.435056 5435 raft_consensus.cc:482] T ab36c17f462b44609bb82ff5b3defb65 P 64fe25f92a054bcc9b2ff7cbf43af06d [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 04:43:02.435283 5435 raft_consensus.cc:504] T ab36c17f462b44609bb82ff5b3defb65 P 64fe25f92a054bcc9b2ff7cbf43af06d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3859384e3bed4d3c88c284d01ecf71be" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 34749 } } peers { permanent_uuid: "0217252a13be4e29a06a3278372656a5" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 45275 } } peers { permanent_uuid: "64fe25f92a054bcc9b2ff7cbf43af06d" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 42575 } }
I20260808 04:43:02.436450 5435 leader_election.cc:288] T ab36c17f462b44609bb82ff5b3defb65 P 64fe25f92a054bcc9b2ff7cbf43af06d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3859384e3bed4d3c88c284d01ecf71be (127.20.240.194:34749), 0217252a13be4e29a06a3278372656a5 (127.20.240.195:45275)
Aug 08 04:43:02 dist-test-slave-vxj2 krb5kdc[3665](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164181, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.240.193@KRBTEST.COM for kudu/127.20.240.194@KRBTEST.COM
Aug 08 04:43:02 dist-test-slave-vxj2 krb5kdc[3665](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164181, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.240.193@KRBTEST.COM for kudu/127.20.240.195@KRBTEST.COM
I20260808 04:43:02.451797 5436 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:43:02.436729 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.195:45275 (local address 127.20.240.193:56033)
0808 04:43:02.437088 (+ 359us) negotiation.cc:107] Waiting for socket to connect
0808 04:43:02.437102 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 04:43:02.437223 (+ 121us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:43:02.439046 (+ 1823us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:43:02.439049 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:43:02.439275 (+ 226us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:43:02.439724 (+ 449us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:43:02.439739 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:43:02.441249 (+ 1510us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:43:02.441252 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:43:02.442149 (+ 897us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:43:02.442159 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:43:02.442879 (+ 720us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:43:02.442883 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:43:02.443049 (+ 166us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:43:02.443792 (+ 743us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:43:02.443809 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:43:02.445979 (+ 2170us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:43:02.448456 (+ 2477us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:43:02.448458 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:43:02.448470 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:43:02.448982 (+ 512us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:43:02.449441 (+ 459us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:43:02.449445 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:43:02.449460 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:43:02.449683 (+ 223us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:43:02.450504 (+ 821us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:43:02.450511 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:43:02.450914 (+ 403us) client_negotiation.cc:769] Sending connection context
0808 04:43:02.451138 (+ 224us) client_negotiation.cc:240] Negotiation successful
0808 04:43:02.451576 (+ 438us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":289,"mutex_wait_us":138,"spinlock_wait_cycles":16640,"thread_start_us":109,"threads_started":1}
I20260808 04:43:02.451854 5438 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:43:02.436941 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.240.193:56033 (local address 127.20.240.195:45275)
0808 04:43:02.437344 (+ 403us) server_negotiation.cc:206] Beginning negotiation
0808 04:43:02.437357 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0808 04:43:02.437395 (+ 38us) server_negotiation.cc:407] Connection header received
0808 04:43:02.438045 (+ 650us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:43:02.438050 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:43:02.438405 (+ 355us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:43:02.438697 (+ 292us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:43:02.440098 (+ 1401us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:43:02.441051 (+ 953us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:43:02.442296 (+ 1245us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:43:02.442749 (+ 453us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:43:02.442913 (+ 164us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:43:02.446186 (+ 3273us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:43:02.446192 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:43:02.446205 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:43:02.446241 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:43:02.448278 (+ 2037us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:43:02.449118 (+ 840us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:43:02.449124 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:43:02.449129 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:43:02.449346 (+ 217us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:43:02.449797 (+ 451us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:43:02.449801 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:43:02.449802 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:43:02.450382 (+ 580us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:43:02.450509 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0808 04:43:02.451341 (+ 832us) server_negotiation.cc:299] Negotiation successful
0808 04:43:02.451649 (+ 308us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":255,"thread_start_us":65,"threads_started":1}
I20260808 04:43:02.451905 5437 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:43:02.436930 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.240.193:35095 (local address 127.20.240.194:34749)
0808 04:43:02.437373 (+ 443us) server_negotiation.cc:206] Beginning negotiation
0808 04:43:02.437384 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 04:43:02.437418 (+ 34us) server_negotiation.cc:407] Connection header received
0808 04:43:02.438045 (+ 627us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:43:02.438050 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:43:02.438406 (+ 356us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:43:02.438675 (+ 269us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:43:02.439940 (+ 1265us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:43:02.441056 (+ 1116us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:43:02.442280 (+ 1224us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:43:02.442761 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:43:02.442956 (+ 195us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:43:02.445981 (+ 3025us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:43:02.445987 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:43:02.446000 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:43:02.446055 (+ 55us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:43:02.448278 (+ 2223us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:43:02.449117 (+ 839us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:43:02.449124 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:43:02.449129 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:43:02.449323 (+ 194us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:43:02.449789 (+ 466us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:43:02.449792 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:43:02.449794 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:43:02.450371 (+ 577us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:43:02.450509 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0808 04:43:02.451328 (+ 819us) server_negotiation.cc:299] Negotiation successful
0808 04:43:02.451649 (+ 321us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":328,"thread_start_us":70,"threads_started":1}
I20260808 04:43:02.451795 5434 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:43:02.436688 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.194:34749 (local address 127.20.240.193:35095)
0808 04:43:02.436892 (+ 204us) negotiation.cc:107] Waiting for socket to connect
0808 04:43:02.436907 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 04:43:02.437018 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:43:02.438768 (+ 1750us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:43:02.438774 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:43:02.439307 (+ 533us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:43:02.439725 (+ 418us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:43:02.439739 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:43:02.441238 (+ 1499us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:43:02.441240 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:43:02.442150 (+ 910us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:43:02.442160 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:43:02.442932 (+ 772us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:43:02.442935 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:43:02.443052 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:43:02.443867 (+ 815us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:43:02.443879 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:43:02.445687 (+ 1808us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:43:02.448447 (+ 2760us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:43:02.448455 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:43:02.448470 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:43:02.448982 (+ 512us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:43:02.449441 (+ 459us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:43:02.449445 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:43:02.449447 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:43:02.449683 (+ 236us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:43:02.450504 (+ 821us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:43:02.450511 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:43:02.450914 (+ 403us) client_negotiation.cc:769] Sending connection context
0808 04:43:02.451138 (+ 224us) client_negotiation.cc:240] Negotiation successful
0808 04:43:02.451630 (+ 492us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":109,"mutex_wait_us":351,"spinlock_wait_cycles":42240}
W20260808 04:43:02.454735 5001 leader_election.cc:341] T ab36c17f462b44609bb82ff5b3defb65 P 64fe25f92a054bcc9b2ff7cbf43af06d [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 0217252a13be4e29a06a3278372656a5 (127.20.240.195:45275): Not found: Tablet not found: ab36c17f462b44609bb82ff5b3defb65
W20260808 04:43:02.454916 5004 leader_election.cc:341] T ab36c17f462b44609bb82ff5b3defb65 P 64fe25f92a054bcc9b2ff7cbf43af06d [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 3859384e3bed4d3c88c284d01ecf71be (127.20.240.194:34749): Not found: Tablet not found: ab36c17f462b44609bb82ff5b3defb65
I20260808 04:43:02.454996 5004 leader_election.cc:302] T ab36c17f462b44609bb82ff5b3defb65 P 64fe25f92a054bcc9b2ff7cbf43af06d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 64fe25f92a054bcc9b2ff7cbf43af06d; no voters: 0217252a13be4e29a06a3278372656a5, 3859384e3bed4d3c88c284d01ecf71be
I20260808 04:43:02.455236 5435 raft_consensus.cc:2726] T ab36c17f462b44609bb82ff5b3defb65 P 64fe25f92a054bcc9b2ff7cbf43af06d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 04:43:02.474690 5439 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:43:02.474294 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:46087 (local address 127.20.240.194:34409)
0808 04:43:02.474546 (+ 252us) negotiation.cc:107] Waiting for socket to connect
0808 04:43:02.474602 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.240.254:46087: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":185,"thread_start_us":97,"threads_started":1}
I20260808 04:43:02.683097 5440 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:43:02.682677 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:46087 (local address 127.20.240.195:46967)
0808 04:43:02.682943 (+ 266us) negotiation.cc:107] Waiting for socket to connect
0808 04:43:02.683000 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.240.254:46087: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":187,"thread_start_us":88,"threads_started":1}
I20260808 04:43:03.324865 5441 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:43:03.324362 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:46087 (local address 127.20.240.193:52449)
0808 04:43:03.324689 (+ 327us) negotiation.cc:107] Waiting for socket to connect
0808 04:43:03.324759 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.240.254:46087: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":230,"thread_start_us":89,"threads_started":1}
I20260808 04:43:03.475973 5443 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:43:03.475530 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:46087 (local address 127.20.240.194:48349)
0808 04:43:03.475798 (+ 268us) negotiation.cc:107] Waiting for socket to connect
0808 04:43:03.475855 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.240.254:46087: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":199,"thread_start_us":79,"threads_started":1}
I20260808 04:43:03.684616 5445 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:43:03.684074 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:46087 (local address 127.20.240.195:41275)
0808 04:43:03.684424 (+ 350us) negotiation.cc:107] Waiting for socket to connect
0808 04:43:03.684498 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.240.254:46087: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":246,"thread_start_us":117,"threads_started":1}
I20260808 04:43:03.965819 5446 raft_consensus.cc:482] T ab36c17f462b44609bb82ff5b3defb65 P 64fe25f92a054bcc9b2ff7cbf43af06d [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 04:43:03.965962 5446 raft_consensus.cc:504] T ab36c17f462b44609bb82ff5b3defb65 P 64fe25f92a054bcc9b2ff7cbf43af06d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3859384e3bed4d3c88c284d01ecf71be" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 34749 } } peers { permanent_uuid: "0217252a13be4e29a06a3278372656a5" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 45275 } } peers { permanent_uuid: "64fe25f92a054bcc9b2ff7cbf43af06d" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 42575 } }
I20260808 04:43:03.966383 5446 leader_election.cc:288] T ab36c17f462b44609bb82ff5b3defb65 P 64fe25f92a054bcc9b2ff7cbf43af06d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3859384e3bed4d3c88c284d01ecf71be (127.20.240.194:34749), 0217252a13be4e29a06a3278372656a5 (127.20.240.195:45275)
W20260808 04:43:03.967336 5004 leader_election.cc:341] T ab36c17f462b44609bb82ff5b3defb65 P 64fe25f92a054bcc9b2ff7cbf43af06d [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 3859384e3bed4d3c88c284d01ecf71be (127.20.240.194:34749): Not found: Tablet not found: ab36c17f462b44609bb82ff5b3defb65
W20260808 04:43:03.967499 5001 leader_election.cc:341] T ab36c17f462b44609bb82ff5b3defb65 P 64fe25f92a054bcc9b2ff7cbf43af06d [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 0217252a13be4e29a06a3278372656a5 (127.20.240.195:45275): Not found: Tablet not found: ab36c17f462b44609bb82ff5b3defb65
I20260808 04:43:03.967590 5001 leader_election.cc:302] T ab36c17f462b44609bb82ff5b3defb65 P 64fe25f92a054bcc9b2ff7cbf43af06d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 64fe25f92a054bcc9b2ff7cbf43af06d; no voters: 0217252a13be4e29a06a3278372656a5, 3859384e3bed4d3c88c284d01ecf71be
I20260808 04:43:03.967795 5446 raft_consensus.cc:2726] T ab36c17f462b44609bb82ff5b3defb65 P 64fe25f92a054bcc9b2ff7cbf43af06d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 04:43:04.326277 5447 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:43:04.325747 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:46087 (local address 127.20.240.193:35851)
0808 04:43:04.326108 (+ 361us) negotiation.cc:107] Waiting for socket to connect
0808 04:43:04.326172 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.240.254:46087: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":281,"thread_start_us":107,"threads_started":1}
I20260808 04:43:04.477242 5448 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:43:04.476748 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:46087 (local address 127.20.240.194:46215)
0808 04:43:04.477024 (+ 276us) negotiation.cc:107] Waiting for socket to connect
0808 04:43:04.477079 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.240.254:46087: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":206,"thread_start_us":111,"threads_started":1}
I20260808 04:43:04.686033 5449 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:43:04.685567 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:46087 (local address 127.20.240.195:59113)
0808 04:43:04.685862 (+ 295us) negotiation.cc:107] Waiting for socket to connect
0808 04:43:04.685937 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.240.254:46087: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":210,"thread_start_us":101,"threads_started":1}
I20260808 04:43:05.327695 5450 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:43:05.327200 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:46087 (local address 127.20.240.193:34185)
0808 04:43:05.327524 (+ 324us) negotiation.cc:107] Waiting for socket to connect
0808 04:43:05.327591 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.240.254:46087: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":239,"thread_start_us":96,"threads_started":1}
I20260808 04:43:05.478556 5451 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:43:05.478043 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:46087 (local address 127.20.240.194:49751)
0808 04:43:05.478394 (+ 351us) negotiation.cc:107] Waiting for socket to connect
0808 04:43:05.478456 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.240.254:46087: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":268,"thread_start_us":80,"threads_started":1}
I20260808 04:43:05.687637 5452 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:43:05.687059 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:46087 (local address 127.20.240.195:43377)
0808 04:43:05.687437 (+ 378us) negotiation.cc:107] Waiting for socket to connect
0808 04:43:05.687515 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.240.254:46087: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":251,"thread_start_us":116,"threads_started":1}
I20260808 04:43:06.012223 5453 raft_consensus.cc:482] T ab36c17f462b44609bb82ff5b3defb65 P 64fe25f92a054bcc9b2ff7cbf43af06d [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 04:43:06.012362 5453 raft_consensus.cc:504] T ab36c17f462b44609bb82ff5b3defb65 P 64fe25f92a054bcc9b2ff7cbf43af06d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3859384e3bed4d3c88c284d01ecf71be" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 34749 } } peers { permanent_uuid: "0217252a13be4e29a06a3278372656a5" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 45275 } } peers { permanent_uuid: "64fe25f92a054bcc9b2ff7cbf43af06d" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 42575 } }
I20260808 04:43:06.012880 5453 leader_election.cc:288] T ab36c17f462b44609bb82ff5b3defb65 P 64fe25f92a054bcc9b2ff7cbf43af06d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3859384e3bed4d3c88c284d01ecf71be (127.20.240.194:34749), 0217252a13be4e29a06a3278372656a5 (127.20.240.195:45275)
W20260808 04:43:06.013845 5001 leader_election.cc:341] T ab36c17f462b44609bb82ff5b3defb65 P 64fe25f92a054bcc9b2ff7cbf43af06d [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 0217252a13be4e29a06a3278372656a5 (127.20.240.195:45275): Not found: Tablet not found: ab36c17f462b44609bb82ff5b3defb65
W20260808 04:43:06.013993 5004 leader_election.cc:341] T ab36c17f462b44609bb82ff5b3defb65 P 64fe25f92a054bcc9b2ff7cbf43af06d [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 3859384e3bed4d3c88c284d01ecf71be (127.20.240.194:34749): Not found: Tablet not found: ab36c17f462b44609bb82ff5b3defb65
I20260808 04:43:06.014115 5004 leader_election.cc:302] T ab36c17f462b44609bb82ff5b3defb65 P 64fe25f92a054bcc9b2ff7cbf43af06d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 64fe25f92a054bcc9b2ff7cbf43af06d; no voters: 0217252a13be4e29a06a3278372656a5, 3859384e3bed4d3c88c284d01ecf71be
I20260808 04:43:06.014328 5453 raft_consensus.cc:2726] T ab36c17f462b44609bb82ff5b3defb65 P 64fe25f92a054bcc9b2ff7cbf43af06d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 04:43:06.329481 5454 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:43:06.328763 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:46087 (local address 127.20.240.193:42997)
0808 04:43:06.329294 (+ 531us) negotiation.cc:107] Waiting for socket to connect
0808 04:43:06.329371 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.240.254:46087: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":363,"thread_start_us":102,"threads_started":1}
I20260808 04:43:06.479861 5455 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:43:06.479388 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:46087 (local address 127.20.240.194:35163)
0808 04:43:06.479664 (+ 276us) negotiation.cc:107] Waiting for socket to connect
0808 04:43:06.479724 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.240.254:46087: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":199,"thread_start_us":76,"threads_started":1}
I20260808 04:43:06.689023 5457 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:43:06.688556 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:46087 (local address 127.20.240.195:52161)
0808 04:43:06.688845 (+ 289us) negotiation.cc:107] Waiting for socket to connect
0808 04:43:06.688916 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.240.254:46087: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":202,"thread_start_us":96,"threads_started":1}
I20260808 04:43:07.331072 5458 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:43:07.330455 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:46087 (local address 127.20.240.193:60877)
0808 04:43:07.330885 (+ 430us) negotiation.cc:107] Waiting for socket to connect
0808 04:43:07.330970 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.240.254:46087: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":247,"thread_start_us":79,"threads_started":1}
I20260808 04:43:07.481240 5459 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:43:07.480719 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:46087 (local address 127.20.240.194:51393)
0808 04:43:07.481004 (+ 285us) negotiation.cc:107] Waiting for socket to connect
0808 04:43:07.481062 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.240.254:46087: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":209,"thread_start_us":147,"threads_started":1}
I20260808 04:43:07.690408 5460 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:43:07.689908 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:46087 (local address 127.20.240.195:57493)
0808 04:43:07.690240 (+ 332us) negotiation.cc:107] Waiting for socket to connect
0808 04:43:07.690307 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.240.254:46087: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":240,"thread_start_us":100,"threads_started":1}
I20260808 04:43:08.332566 5461 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:43:08.332072 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:46087 (local address 127.20.240.193:44393)
0808 04:43:08.332391 (+ 319us) negotiation.cc:107] Waiting for socket to connect
0808 04:43:08.332461 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.240.254:46087: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":230,"thread_start_us":97,"threads_started":1}
I20260808 04:43:08.482704 5462 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:43:08.482147 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:46087 (local address 127.20.240.194:44833)
0808 04:43:08.482517 (+ 370us) negotiation.cc:107] Waiting for socket to connect
0808 04:43:08.482602 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.240.254:46087: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":285,"thread_start_us":83,"threads_started":1}
I20260808 04:43:08.662477 5463 raft_consensus.cc:482] T ab36c17f462b44609bb82ff5b3defb65 P 64fe25f92a054bcc9b2ff7cbf43af06d [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 04:43:08.662683 5463 raft_consensus.cc:504] T ab36c17f462b44609bb82ff5b3defb65 P 64fe25f92a054bcc9b2ff7cbf43af06d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3859384e3bed4d3c88c284d01ecf71be" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 34749 } } peers { permanent_uuid: "0217252a13be4e29a06a3278372656a5" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 45275 } } peers { permanent_uuid: "64fe25f92a054bcc9b2ff7cbf43af06d" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 42575 } }
I20260808 04:43:08.663157 5463 leader_election.cc:288] T ab36c17f462b44609bb82ff5b3defb65 P 64fe25f92a054bcc9b2ff7cbf43af06d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3859384e3bed4d3c88c284d01ecf71be (127.20.240.194:34749), 0217252a13be4e29a06a3278372656a5 (127.20.240.195:45275)
W20260808 04:43:08.664130 5004 leader_election.cc:341] T ab36c17f462b44609bb82ff5b3defb65 P 64fe25f92a054bcc9b2ff7cbf43af06d [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 3859384e3bed4d3c88c284d01ecf71be (127.20.240.194:34749): Not found: Tablet not found: ab36c17f462b44609bb82ff5b3defb65
W20260808 04:43:08.664264 5001 leader_election.cc:341] T ab36c17f462b44609bb82ff5b3defb65 P 64fe25f92a054bcc9b2ff7cbf43af06d [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 0217252a13be4e29a06a3278372656a5 (127.20.240.195:45275): Not found: Tablet not found: ab36c17f462b44609bb82ff5b3defb65
I20260808 04:43:08.664390 5001 leader_election.cc:302] T ab36c17f462b44609bb82ff5b3defb65 P 64fe25f92a054bcc9b2ff7cbf43af06d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 64fe25f92a054bcc9b2ff7cbf43af06d; no voters: 0217252a13be4e29a06a3278372656a5, 3859384e3bed4d3c88c284d01ecf71be
I20260808 04:43:08.664592 5463 raft_consensus.cc:2726] T ab36c17f462b44609bb82ff5b3defb65 P 64fe25f92a054bcc9b2ff7cbf43af06d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 04:43:08.691900 5464 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:43:08.691339 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:46087 (local address 127.20.240.195:51085)
0808 04:43:08.691711 (+ 372us) negotiation.cc:107] Waiting for socket to connect
0808 04:43:08.691779 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.240.254:46087: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":288,"thread_start_us":102,"threads_started":1}
I20260808 04:43:09.334082 5465 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:43:09.333622 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:46087 (local address 127.20.240.193:45383)
0808 04:43:09.333888 (+ 266us) negotiation.cc:107] Waiting for socket to connect
0808 04:43:09.333981 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.240.254:46087: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":187,"thread_start_us":78,"threads_started":1}
I20260808 04:43:09.484144 5466 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:43:09.483700 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:46087 (local address 127.20.240.194:51873)
0808 04:43:09.483974 (+ 274us) negotiation.cc:107] Waiting for socket to connect
0808 04:43:09.484037 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.240.254:46087: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":194,"thread_start_us":81,"threads_started":1}
I20260808 04:43:09.693234 5468 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:43:09.692716 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:46087 (local address 127.20.240.195:51839)
0808 04:43:09.693004 (+ 288us) negotiation.cc:107] Waiting for socket to connect
0808 04:43:09.693067 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.240.254:46087: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":209,"thread_start_us":123,"threads_started":1}
I20260808 04:43:10.335433 5469 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:43:10.334928 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:46087 (local address 127.20.240.193:50301)
0808 04:43:10.335243 (+ 315us) negotiation.cc:107] Waiting for socket to connect
0808 04:43:10.335329 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.240.254:46087: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":227,"thread_start_us":84,"threads_started":1}
I20260808 04:43:10.485546 5471 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:43:10.485058 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:46087 (local address 127.20.240.194:52381)
0808 04:43:10.485366 (+ 308us) negotiation.cc:107] Waiting for socket to connect
0808 04:43:10.485429 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.240.254:46087: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":226,"thread_start_us":99,"threads_started":1}
I20260808 04:43:10.694594 5472 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:43:10.694152 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:46087 (local address 127.20.240.195:36201)
0808 04:43:10.694430 (+ 278us) negotiation.cc:107] Waiting for socket to connect
0808 04:43:10.694491 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.240.254:46087: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":199,"thread_start_us":77,"threads_started":1}
I20260808 04:43:10.810377 5473 raft_consensus.cc:482] T ab36c17f462b44609bb82ff5b3defb65 P 64fe25f92a054bcc9b2ff7cbf43af06d [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 04:43:10.810587 5473 raft_consensus.cc:504] T ab36c17f462b44609bb82ff5b3defb65 P 64fe25f92a054bcc9b2ff7cbf43af06d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3859384e3bed4d3c88c284d01ecf71be" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 34749 } } peers { permanent_uuid: "0217252a13be4e29a06a3278372656a5" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 45275 } } peers { permanent_uuid: "64fe25f92a054bcc9b2ff7cbf43af06d" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 42575 } }
I20260808 04:43:10.811118 5473 leader_election.cc:288] T ab36c17f462b44609bb82ff5b3defb65 P 64fe25f92a054bcc9b2ff7cbf43af06d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3859384e3bed4d3c88c284d01ecf71be (127.20.240.194:34749), 0217252a13be4e29a06a3278372656a5 (127.20.240.195:45275)
W20260808 04:43:10.812077 5001 leader_election.cc:341] T ab36c17f462b44609bb82ff5b3defb65 P 64fe25f92a054bcc9b2ff7cbf43af06d [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 0217252a13be4e29a06a3278372656a5 (127.20.240.195:45275): Not found: Tablet not found: ab36c17f462b44609bb82ff5b3defb65
W20260808 04:43:10.812227 5004 leader_election.cc:341] T ab36c17f462b44609bb82ff5b3defb65 P 64fe25f92a054bcc9b2ff7cbf43af06d [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 3859384e3bed4d3c88c284d01ecf71be (127.20.240.194:34749): Not found: Tablet not found: ab36c17f462b44609bb82ff5b3defb65
I20260808 04:43:10.812323 5004 leader_election.cc:302] T ab36c17f462b44609bb82ff5b3defb65 P 64fe25f92a054bcc9b2ff7cbf43af06d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 64fe25f92a054bcc9b2ff7cbf43af06d; no voters: 0217252a13be4e29a06a3278372656a5, 3859384e3bed4d3c88c284d01ecf71be
I20260808 04:43:10.812548 5473 raft_consensus.cc:2726] T ab36c17f462b44609bb82ff5b3defb65 P 64fe25f92a054bcc9b2ff7cbf43af06d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 04:43:11.337049 5474 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:43:11.336507 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:46087 (local address 127.20.240.193:50751)
0808 04:43:11.336859 (+ 352us) negotiation.cc:107] Waiting for socket to connect
0808 04:43:11.336936 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.240.254:46087: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":223,"thread_start_us":101,"threads_started":1}
I20260808 04:43:11.487082 5475 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:43:11.486577 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:46087 (local address 127.20.240.194:42023)
0808 04:43:11.486907 (+ 330us) negotiation.cc:107] Waiting for socket to connect
0808 04:43:11.486975 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.240.254:46087: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":246,"thread_start_us":97,"threads_started":1}
I20260808 04:43:11.696045 5476 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:43:11.695551 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:46087 (local address 127.20.240.195:36369)
0808 04:43:11.695872 (+ 321us) negotiation.cc:107] Waiting for socket to connect
0808 04:43:11.695941 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.240.254:46087: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":246,"thread_start_us":94,"threads_started":1}
I20260808 04:43:12.338544 5477 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:43:12.338036 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:46087 (local address 127.20.240.193:48863)
0808 04:43:12.338368 (+ 332us) negotiation.cc:107] Waiting for socket to connect
0808 04:43:12.338440 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.240.254:46087: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":230,"thread_start_us":86,"threads_started":1}
I20260808 04:43:12.488569 5478 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:43:12.488064 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:46087 (local address 127.20.240.194:51671)
0808 04:43:12.488380 (+ 316us) negotiation.cc:107] Waiting for socket to connect
0808 04:43:12.488461 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.240.254:46087: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":227,"thread_start_us":89,"threads_started":1}
I20260808 04:43:12.697579 5479 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:43:12.697003 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:46087 (local address 127.20.240.195:40633)
0808 04:43:12.697397 (+ 394us) negotiation.cc:107] Waiting for socket to connect
0808 04:43:12.697468 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.240.254:46087: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":307,"thread_start_us":106,"threads_started":1}
I20260808 04:43:13.339901 5480 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:43:13.339442 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:46087 (local address 127.20.240.193:37091)
0808 04:43:13.339736 (+ 294us) negotiation.cc:107] Waiting for socket to connect
0808 04:43:13.339796 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.240.254:46087: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":217,"thread_start_us":88,"threads_started":1}
I20260808 04:43:13.490252 5481 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:43:13.489719 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:46087 (local address 127.20.240.194:42405)
0808 04:43:13.490073 (+ 354us) negotiation.cc:107] Waiting for socket to connect
0808 04:43:13.490144 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.240.254:46087: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":265,"thread_start_us":95,"threads_started":1}
I20260808 04:43:13.699051 5482 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:43:13.698535 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:46087 (local address 127.20.240.195:60333)
0808 04:43:13.698870 (+ 335us) negotiation.cc:107] Waiting for socket to connect
0808 04:43:13.698938 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.240.254:46087: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":252,"thread_start_us":108,"threads_started":1}
I20260808 04:43:14.341454 5484 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:43:14.340854 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:46087 (local address 127.20.240.193:40591)
0808 04:43:14.341280 (+ 426us) negotiation.cc:107] Waiting for socket to connect
0808 04:43:14.341350 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.240.254:46087: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":249,"thread_start_us":94,"threads_started":1}
I20260808 04:43:14.491782 5485 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:43:14.491309 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:46087 (local address 127.20.240.194:44965)
0808 04:43:14.491605 (+ 296us) negotiation.cc:107] Waiting for socket to connect
0808 04:43:14.491671 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.240.254:46087: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":215,"thread_start_us":105,"threads_started":1}
I20260808 04:43:14.700482 5486 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:43:14.699884 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:46087 (local address 127.20.240.195:53023)
0808 04:43:14.700290 (+ 406us) negotiation.cc:107] Waiting for socket to connect
0808 04:43:14.700372 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.240.254:46087: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":306,"thread_start_us":87,"threads_started":1}
I20260808 04:43:14.739111 5487 raft_consensus.cc:482] T ab36c17f462b44609bb82ff5b3defb65 P 64fe25f92a054bcc9b2ff7cbf43af06d [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 04:43:14.739295 5487 raft_consensus.cc:504] T ab36c17f462b44609bb82ff5b3defb65 P 64fe25f92a054bcc9b2ff7cbf43af06d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3859384e3bed4d3c88c284d01ecf71be" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 34749 } } peers { permanent_uuid: "0217252a13be4e29a06a3278372656a5" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 45275 } } peers { permanent_uuid: "64fe25f92a054bcc9b2ff7cbf43af06d" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 42575 } }
I20260808 04:43:14.739761 5487 leader_election.cc:288] T ab36c17f462b44609bb82ff5b3defb65 P 64fe25f92a054bcc9b2ff7cbf43af06d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3859384e3bed4d3c88c284d01ecf71be (127.20.240.194:34749), 0217252a13be4e29a06a3278372656a5 (127.20.240.195:45275)
W20260808 04:43:14.740612 5001 leader_election.cc:341] T ab36c17f462b44609bb82ff5b3defb65 P 64fe25f92a054bcc9b2ff7cbf43af06d [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 0217252a13be4e29a06a3278372656a5 (127.20.240.195:45275): Not found: Tablet not found: ab36c17f462b44609bb82ff5b3defb65
W20260808 04:43:14.740762 5004 leader_election.cc:341] T ab36c17f462b44609bb82ff5b3defb65 P 64fe25f92a054bcc9b2ff7cbf43af06d [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 3859384e3bed4d3c88c284d01ecf71be (127.20.240.194:34749): Not found: Tablet not found: ab36c17f462b44609bb82ff5b3defb65
I20260808 04:43:14.740859 5004 leader_election.cc:302] T ab36c17f462b44609bb82ff5b3defb65 P 64fe25f92a054bcc9b2ff7cbf43af06d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 64fe25f92a054bcc9b2ff7cbf43af06d; no voters: 0217252a13be4e29a06a3278372656a5, 3859384e3bed4d3c88c284d01ecf71be
I20260808 04:43:14.741017 5487 raft_consensus.cc:2726] T ab36c17f462b44609bb82ff5b3defb65 P 64fe25f92a054bcc9b2ff7cbf43af06d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 04:43:15.342775 5488 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:43:15.342300 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:46087 (local address 127.20.240.193:38493)
0808 04:43:15.342602 (+ 302us) negotiation.cc:107] Waiting for socket to connect
0808 04:43:15.342663 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.240.254:46087: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":225,"thread_start_us":98,"threads_started":1}
I20260808 04:43:15.493278 5489 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:43:15.492716 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:46087 (local address 127.20.240.194:47405)
0808 04:43:15.493069 (+ 353us) negotiation.cc:107] Waiting for socket to connect
0808 04:43:15.493138 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.240.254:46087: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":267,"thread_start_us":102,"threads_started":1}
I20260808 04:43:15.701874 5491 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:43:15.701411 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:46087 (local address 127.20.240.195:33479)
0808 04:43:15.701679 (+ 268us) negotiation.cc:107] Waiting for socket to connect
0808 04:43:15.701740 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.240.254:46087: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":192,"thread_start_us":75,"threads_started":1}
I20260808 04:43:16.344638 5492 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:43:16.344104 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:46087 (local address 127.20.240.193:60583)
0808 04:43:16.344468 (+ 364us) negotiation.cc:107] Waiting for socket to connect
0808 04:43:16.344536 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.240.254:46087: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":257,"thread_start_us":92,"threads_started":1}
I20260808 04:43:16.494813 5493 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:43:16.494323 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:46087 (local address 127.20.240.194:45083)
0808 04:43:16.494625 (+ 302us) negotiation.cc:107] Waiting for socket to connect
0808 04:43:16.494691 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.240.254:46087: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":212,"thread_start_us":81,"threads_started":1}
I20260808 04:43:16.689815 21443 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu with pid 4944
I20260808 04:43:16.698105 21443 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu with pid 5130
I20260808 04:43:16.703476 5494 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:43:16.702977 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:46087 (local address 127.20.240.195:56905)
0808 04:43:16.703285 (+ 308us) negotiation.cc:107] Waiting for socket to connect
0808 04:43:16.703372 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.240.254:46087: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":217,"thread_start_us":92,"threads_started":1}
I20260808 04:43:16.705552 21443 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu with pid 5281
2026-08-08T04:43:16Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedIPKICert (19459 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedTSK
Loading random data
Initializing database '/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164000593138-21443-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 04:43:16 dist-test-slave-vxj2 krb5kdc[5498](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 04:43:16 dist-test-slave-vxj2 krb5kdc[5498](info): set up 2 sockets
Aug 08 04:43:16 dist-test-slave-vxj2 krb5kdc[5498](info): commencing operation
krb5kdc: starting...
W20260808 04:43:17.814335 21443 mini_kdc.cc:121] Time spent starting KDC: real 1.083s user 0.002s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164000593138-21443-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164000593138-21443-0/krb5kdc/test-user.keytab.
Aug 08 04:43:17 dist-test-slave-vxj2 krb5kdc[5498](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164197, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T04:43:17Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T04:43:17Z Disabled control of system clock
WARNING: no policy specified for kudu/127.20.240.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.240.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.240.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.254.keytab.
Entry for principal kudu/127.20.240.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.254.keytab.
I20260808 04:43:17.945750 21443 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
/tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164000593138-21443-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164000593138-21443-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164000593138-21443-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164000593138-21443-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.240.254:42631
--webserver_interface=127.20.240.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.254.keytab
--principal=kudu/127.20.240.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.240.212:44813
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.240.254:42631
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164000593138-21443-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164000593138-21443-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164000593138-21443-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 04:43:18.062022 5515 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:43:18.062379 5515 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:43:18.062469 5515 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:43:18.066864 5515 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260808 04:43:18.066991 5515 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260808 04:43:18.067021 5515 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260808 04:43:18.067046 5515 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 04:43:18.067088 5515 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:43:18.067138 5515 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:43:18.067194 5515 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 04:43:18.067234 5515 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 04:43:18.073207 5515 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.240.212:44813
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164000593138-21443-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164000593138-21443-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.20.240.254:42631
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.254.keytab
--principal=kudu/127.20.240.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.240.254:42631
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164000593138-21443-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.240.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5515
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164000593138-21443-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 04:05:18 UTC on ccycloud.quasar-drfdgt.root.comops.site
build id 4574101
I20260808 04:43:18.074447 5515 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:43:18.075555 5515 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:43:18.084983 5521 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:43:18.084990 5520 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:43:18.085286 5524 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:43:18.085083 5515 server_base.cc:1034] running on GCE node
I20260808 04:43:18.085889 5515 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:43:18.087123 5515 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:43:18.088289 5515 hybrid_clock.cc:648] HybridClock initialized: now 1786164198088274 us; error 28 us; skew 500 ppm
Aug 08 04:43:18 dist-test-slave-vxj2 krb5kdc[5498](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164198, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.240.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:43:18.091302 5515 init.cc:377] Logged in from keytab as kudu/127.20.240.254@KRBTEST.COM (short username kudu)
I20260808 04:43:18.092267 5515 webserver.cc:460] Webserver started at http://127.20.240.254:41973/ using document root <none> and password file <none>
I20260808 04:43:18.092860 5515 fs_manager.cc:359] Metadata directory not provided
I20260808 04:43:18.092926 5515 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:43:18.093207 5515 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 04:43:18.095412 5515 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164000593138-21443-0/minicluster-data/master-0/data/instance:
uuid: "b44539d028104d79a7fd51cfc6e31178"
format_stamp: "Formatted at 2026-08-08 04:43:18 on dist-test-slave-vxj2"
server_key: "017726d87f8b2218865cb60adba7ff33"
server_key_iv: "26879a73ee0a858f7d901de7a7c616c5"
server_key_version: "encryptionkey@0"
I20260808 04:43:18.096099 5515 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164000593138-21443-0/minicluster-data/master-0/wal/instance:
uuid: "b44539d028104d79a7fd51cfc6e31178"
format_stamp: "Formatted at 2026-08-08 04:43:18 on dist-test-slave-vxj2"
server_key: "017726d87f8b2218865cb60adba7ff33"
server_key_iv: "26879a73ee0a858f7d901de7a7c616c5"
server_key_version: "encryptionkey@0"
I20260808 04:43:18.100134 5515 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260808 04:43:18.102705 5532 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:43:18.103968 5515 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260808 04:43:18.104120 5515 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164000593138-21443-0/minicluster-data/master-0/data,/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164000593138-21443-0/minicluster-data/master-0/wal
uuid: "b44539d028104d79a7fd51cfc6e31178"
format_stamp: "Formatted at 2026-08-08 04:43:18 on dist-test-slave-vxj2"
server_key: "017726d87f8b2218865cb60adba7ff33"
server_key_iv: "26879a73ee0a858f7d901de7a7c616c5"
server_key_version: "encryptionkey@0"
I20260808 04:43:18.104238 5515 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164000593138-21443-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164000593138-21443-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164000593138-21443-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:43:18.114634 5515 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:43:18.117882 5515 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:43:18.118099 5515 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:43:18.125669 5515 rpc_server.cc:307] RPC server started. Bound to: 127.20.240.254:42631
I20260808 04:43:18.125962 5590 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.240.254:42631 every 8 connection(s)
I20260808 04:43:18.126756 5515 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164000593138-21443-0/minicluster-data/master-0/data/info.pb
I20260808 04:43:18.129772 5591 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:43:18.133095 21443 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu as pid 5515
I20260808 04:43:18.133239 21443 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164000593138-21443-0/minicluster-data/master-0/wal/instance
I20260808 04:43:18.133553 21443 external_mini_cluster.cc:1428] Setting key 2b5d0cf255a10832ac769c20f18dd519
I20260808 04:43:18.136292 5591 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b44539d028104d79a7fd51cfc6e31178: Bootstrap starting.
I20260808 04:43:18.139055 5591 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b44539d028104d79a7fd51cfc6e31178: Neither blocks nor log segments found. Creating new log.
I20260808 04:43:18.140053 5591 log.cc:824] T 00000000000000000000000000000000 P b44539d028104d79a7fd51cfc6e31178: Log is configured to *not* fsync() on all Append() calls
I20260808 04:43:18.143030 5591 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b44539d028104d79a7fd51cfc6e31178: No bootstrap required, opened a new log
Aug 08 04:43:18 dist-test-slave-vxj2 krb5kdc[5498](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164197, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.240.254@KRBTEST.COM
I20260808 04:43:18.146497 5591 raft_consensus.cc:348] T 00000000000000000000000000000000 P b44539d028104d79a7fd51cfc6e31178 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b44539d028104d79a7fd51cfc6e31178" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 42631 } }
I20260808 04:43:18.146744 5591 raft_consensus.cc:374] T 00000000000000000000000000000000 P b44539d028104d79a7fd51cfc6e31178 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:43:18.146811 5591 raft_consensus.cc:729] T 00000000000000000000000000000000 P b44539d028104d79a7fd51cfc6e31178 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b44539d028104d79a7fd51cfc6e31178, State: Initialized, Role: FOLLOWER
I20260808 04:43:18.147253 5591 consensus_queue.cc:260] T 00000000000000000000000000000000 P b44539d028104d79a7fd51cfc6e31178 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b44539d028104d79a7fd51cfc6e31178" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 42631 } }
I20260808 04:43:18.147413 5591 raft_consensus.cc:388] T 00000000000000000000000000000000 P b44539d028104d79a7fd51cfc6e31178 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 04:43:18.147498 5591 raft_consensus.cc:482] T 00000000000000000000000000000000 P b44539d028104d79a7fd51cfc6e31178 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 04:43:18.147614 5591 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b44539d028104d79a7fd51cfc6e31178 [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:43:18.148568 5591 raft_consensus.cc:504] T 00000000000000000000000000000000 P b44539d028104d79a7fd51cfc6e31178 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b44539d028104d79a7fd51cfc6e31178" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 42631 } }
I20260808 04:43:18.148916 5591 leader_election.cc:302] T 00000000000000000000000000000000 P b44539d028104d79a7fd51cfc6e31178 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b44539d028104d79a7fd51cfc6e31178; no voters:
I20260808 04:43:18.149329 5591 leader_election.cc:288] T 00000000000000000000000000000000 P b44539d028104d79a7fd51cfc6e31178 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 04:43:18.149417 5598 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b44539d028104d79a7fd51cfc6e31178 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 04:43:18.149698 5598 raft_consensus.cc:686] T 00000000000000000000000000000000 P b44539d028104d79a7fd51cfc6e31178 [term 1 LEADER]: Becoming Leader. State: Replica: b44539d028104d79a7fd51cfc6e31178, State: Running, Role: LEADER
I20260808 04:43:18.150094 5598 consensus_queue.cc:237] T 00000000000000000000000000000000 P b44539d028104d79a7fd51cfc6e31178 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b44539d028104d79a7fd51cfc6e31178" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 42631 } }
I20260808 04:43:18.150722 5596 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:43:18.135006 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40466 (local address 127.20.240.254:42631)
0808 04:43:18.135462 (+ 456us) server_negotiation.cc:206] Beginning negotiation
0808 04:43:18.135479 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0808 04:43:18.135520 (+ 41us) server_negotiation.cc:407] Connection header received
0808 04:43:18.136197 (+ 677us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:43:18.136213 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:43:18.136631 (+ 418us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:43:18.136925 (+ 294us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:43:18.138005 (+ 1080us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:43:18.139272 (+ 1267us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:43:18.140649 (+ 1377us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:43:18.141494 (+ 845us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:43:18.141655 (+ 161us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:43:18.144654 (+ 2999us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:43:18.144660 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:43:18.144676 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:43:18.144706 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:43:18.147256 (+ 2550us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:43:18.147801 (+ 545us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:43:18.147812 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:43:18.147817 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:43:18.147945 (+ 128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:43:18.148242 (+ 297us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:43:18.148245 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:43:18.148247 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:43:18.148665 (+ 418us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:43:18.148860 (+ 195us) server_negotiation.cc:1035] Waiting for connection context
0808 04:43:18.149351 (+ 491us) server_negotiation.cc:299] Negotiation successful
0808 04:43:18.149719 (+ 368us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":308,"thread_start_us":158,"threads_started":1}
I20260808 04:43:18.150815 5591 sys_catalog.cc:564] T 00000000000000000000000000000000 P b44539d028104d79a7fd51cfc6e31178 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 04:43:18.151974 5599 sys_catalog.cc:455] T 00000000000000000000000000000000 P b44539d028104d79a7fd51cfc6e31178 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b44539d028104d79a7fd51cfc6e31178. Latest consensus state: current_term: 1 leader_uuid: "b44539d028104d79a7fd51cfc6e31178" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b44539d028104d79a7fd51cfc6e31178" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 42631 } } }
I20260808 04:43:18.152109 5599 sys_catalog.cc:458] T 00000000000000000000000000000000 P b44539d028104d79a7fd51cfc6e31178 [sys.catalog]: This master's current role is: LEADER
I20260808 04:43:18.152537 5608 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 04:43:18.154306 5600 sys_catalog.cc:455] T 00000000000000000000000000000000 P b44539d028104d79a7fd51cfc6e31178 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b44539d028104d79a7fd51cfc6e31178" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b44539d028104d79a7fd51cfc6e31178" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 42631 } } }
I20260808 04:43:18.154419 5600 sys_catalog.cc:458] T 00000000000000000000000000000000 P b44539d028104d79a7fd51cfc6e31178 [sys.catalog]: This master's current role is: LEADER
I20260808 04:43:18.156234 5608 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 04:43:18.162602 5608 catalog_manager.cc:1347] Generated new cluster ID: 6430311a072e44229a99fe0e5e0650fd
I20260808 04:43:18.162695 5608 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 04:43:18.194911 5608 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 04:43:18.195986 5608 catalog_manager.cc:1504] Loading token signing keys...
I20260808 04:43:18.208273 5608 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b44539d028104d79a7fd51cfc6e31178: Generated new TSK 0
I20260808 04:43:18.209087 5608 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.20.240.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.240.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.240.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.193.keytab.
Entry for principal kudu/127.20.240.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.193.keytab.
I20260808 04:43:18.246610 21443 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
/tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164000593138-21443-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164000593138-21443-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164000593138-21443-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164000593138-21443-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.240.193:0
--local_ip_for_outbound_sockets=127.20.240.193
--webserver_interface=127.20.240.193
--webserver_port=0
--tserver_master_addrs=127.20.240.254:42631
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.193.keytab
--principal=kudu/127.20.240.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.240.212:44813
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164000593138-21443-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164000593138-21443-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164000593138-21443-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 04:43:18.383097 5625 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:43:18.383397 5625 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:43:18.383445 5625 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:43:18.387878 5625 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:43:18.387960 5625 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:43:18.388051 5625 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.240.193
I20260808 04:43:18.393751 5625 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.240.212:44813
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164000593138-21443-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164000593138-21443-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.193.keytab
--principal=kudu/127.20.240.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.240.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164000593138-21443-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.240.193
--webserver_port=0
--tserver_master_addrs=127.20.240.254:42631
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5625
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.240.193
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164000593138-21443-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 04:05:18 UTC on ccycloud.quasar-drfdgt.root.comops.site
build id 4574101
I20260808 04:43:18.394949 5625 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:43:18.396023 5625 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:43:18.406612 5630 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:43:18.406689 5633 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:43:18.406622 5631 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:43:18.406824 5625 server_base.cc:1034] running on GCE node
I20260808 04:43:18.407377 5625 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:43:18.408159 5625 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:43:18.409325 5625 hybrid_clock.cc:648] HybridClock initialized: now 1786164198409308 us; error 38 us; skew 500 ppm
Aug 08 04:43:18 dist-test-slave-vxj2 krb5kdc[5498](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164198, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.240.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:43:18.412233 5625 init.cc:377] Logged in from keytab as kudu/127.20.240.193@KRBTEST.COM (short username kudu)
I20260808 04:43:18.413189 5625 webserver.cc:460] Webserver started at http://127.20.240.193:43429/ using document root <none> and password file <none>
I20260808 04:43:18.413771 5625 fs_manager.cc:359] Metadata directory not provided
I20260808 04:43:18.413832 5625 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:43:18.414006 5625 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 04:43:18.416093 5625 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164000593138-21443-0/minicluster-data/ts-0/data/instance:
uuid: "17256af032074b1b9b1276bc078bf23f"
format_stamp: "Formatted at 2026-08-08 04:43:18 on dist-test-slave-vxj2"
server_key: "1cd64b0a3773d4a699c528abe9253bbc"
server_key_iv: "4ac8f7095cd4f35373bf8799f6fe804f"
server_key_version: "encryptionkey@0"
I20260808 04:43:18.416631 5625 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164000593138-21443-0/minicluster-data/ts-0/wal/instance:
uuid: "17256af032074b1b9b1276bc078bf23f"
format_stamp: "Formatted at 2026-08-08 04:43:18 on dist-test-slave-vxj2"
server_key: "1cd64b0a3773d4a699c528abe9253bbc"
server_key_iv: "4ac8f7095cd4f35373bf8799f6fe804f"
server_key_version: "encryptionkey@0"
I20260808 04:43:18.420585 5625 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.004s
I20260808 04:43:18.423094 5642 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:43:18.424603 5625 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260808 04:43:18.424748 5625 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164000593138-21443-0/minicluster-data/ts-0/data,/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164000593138-21443-0/minicluster-data/ts-0/wal
uuid: "17256af032074b1b9b1276bc078bf23f"
format_stamp: "Formatted at 2026-08-08 04:43:18 on dist-test-slave-vxj2"
server_key: "1cd64b0a3773d4a699c528abe9253bbc"
server_key_iv: "4ac8f7095cd4f35373bf8799f6fe804f"
server_key_version: "encryptionkey@0"
I20260808 04:43:18.424882 5625 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164000593138-21443-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164000593138-21443-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164000593138-21443-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:43:18.464166 5625 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:43:18.468364 5625 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:43:18.468627 5625 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:43:18.469383 5625 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 04:43:18.470332 5625 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 04:43:18.470407 5625 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 04:43:18.470476 5625 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 04:43:18.470516 5625 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 04:43:18.479964 5625 rpc_server.cc:307] RPC server started. Bound to: 127.20.240.193:33027
I20260808 04:43:18.479988 5771 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.240.193:33027 every 8 connection(s)
I20260808 04:43:18.480963 5625 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164000593138-21443-0/minicluster-data/ts-0/data/info.pb
I20260808 04:43:18.485687 21443 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu as pid 5625
I20260808 04:43:18.485878 21443 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164000593138-21443-0/minicluster-data/ts-0/wal/instance
I20260808 04:43:18.486184 21443 external_mini_cluster.cc:1428] Setting key 36fc61201d59fe8cb3ef0281c30f1196
Aug 08 04:43:18 dist-test-slave-vxj2 krb5kdc[5498](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164198, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.240.193@KRBTEST.COM for kudu/127.20.240.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.20.240.194@KRBTEST.COM; defaulting to no policy
I20260808 04:43:18.496833 5596 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:43:18.482884 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.240.193:48921 (local address 127.20.240.254:42631)
0808 04:43:18.483035 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0808 04:43:18.483039 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:43:18.483914 (+ 875us) server_negotiation.cc:407] Connection header received
0808 04:43:18.485307 (+ 1393us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:43:18.485310 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:43:18.485382 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:43:18.485488 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:43:18.486887 (+ 1399us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:43:18.487491 (+ 604us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:43:18.488675 (+ 1184us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:43:18.489147 (+ 472us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:43:18.489317 (+ 170us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:43:18.492609 (+ 3292us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:43:18.492613 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:43:18.492615 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:43:18.492641 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:43:18.494333 (+ 1692us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:43:18.494983 (+ 650us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:43:18.494988 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:43:18.494989 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:43:18.495072 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:43:18.495473 (+ 401us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:43:18.495478 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:43:18.495480 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:43:18.495701 (+ 221us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:43:18.495833 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0808 04:43:18.496438 (+ 605us) server_negotiation.cc:299] Negotiation successful
0808 04:43:18.496591 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260808 04:43:18.497803 5776 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:43:18.483296 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:42631 (local address 127.20.240.193:48921)
0808 04:43:18.483754 (+ 458us) negotiation.cc:107] Waiting for socket to connect
0808 04:43:18.483798 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0808 04:43:18.485039 (+ 1241us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:43:18.485654 (+ 615us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:43:18.485661 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:43:18.486155 (+ 494us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:43:18.486722 (+ 567us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:43:18.486743 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:43:18.487641 (+ 898us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:43:18.487645 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:43:18.488545 (+ 900us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:43:18.488554 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:43:18.489406 (+ 852us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:43:18.489412 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:43:18.489702 (+ 290us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:43:18.490465 (+ 763us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:43:18.490496 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:43:18.492407 (+ 1911us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:43:18.494471 (+ 2064us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:43:18.494478 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:43:18.494497 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:43:18.494839 (+ 342us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:43:18.495193 (+ 354us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:43:18.495197 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:43:18.495199 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:43:18.495368 (+ 169us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:43:18.495834 (+ 466us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:43:18.495842 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:43:18.496169 (+ 327us) client_negotiation.cc:769] Sending connection context
0808 04:43:18.496393 (+ 224us) client_negotiation.cc:240] Negotiation successful
0808 04:43:18.496768 (+ 375us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":277,"thread_start_us":110,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.240.194@KRBTEST.COM" created.
I20260808 04:43:18.499408 5772 heartbeater.cc:347] Connected to a master server at 127.20.240.254:42631
I20260808 04:43:18.499703 5772 heartbeater.cc:464] Registering TS with master...
I20260808 04:43:18.500325 5772 heartbeater.cc:511] Master 127.20.240.254:42631 requested a full tablet report, sending...
I20260808 04:43:18.502272 5551 ts_manager.cc:194] Registered new tserver with Master: 17256af032074b1b9b1276bc078bf23f (127.20.240.193:33027)
I20260808 04:43:18.504133 5551 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.240.193@KRBTEST.COM'} at 127.20.240.193:48921
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.240.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.194.keytab.
Entry for principal kudu/127.20.240.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.194.keytab.
I20260808 04:43:18.519893 21443 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
/tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164000593138-21443-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164000593138-21443-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164000593138-21443-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164000593138-21443-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.240.194:0
--local_ip_for_outbound_sockets=127.20.240.194
--webserver_interface=127.20.240.194
--webserver_port=0
--tserver_master_addrs=127.20.240.254:42631
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.194.keytab
--principal=kudu/127.20.240.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.240.212:44813
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164000593138-21443-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164000593138-21443-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164000593138-21443-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 04:43:18.640038 5779 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:43:18.640342 5779 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:43:18.640389 5779 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:43:18.644490 5779 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:43:18.644564 5779 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:43:18.644624 5779 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.240.194
I20260808 04:43:18.650035 5779 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.240.212:44813
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164000593138-21443-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164000593138-21443-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.194.keytab
--principal=kudu/127.20.240.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.240.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164000593138-21443-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.240.194
--webserver_port=0
--tserver_master_addrs=127.20.240.254:42631
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5779
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.240.194
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164000593138-21443-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 04:05:18 UTC on ccycloud.quasar-drfdgt.root.comops.site
build id 4574101
I20260808 04:43:18.651197 5779 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:43:18.652398 5779 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260808 04:43:18.662791 5779 server_base.cc:1034] running on GCE node
W20260808 04:43:18.662740 5787 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:43:18.662729 5785 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:43:18.662729 5784 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:43:18.663535 5779 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:43:18.664191 5779 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:43:18.665349 5779 hybrid_clock.cc:648] HybridClock initialized: now 1786164198665336 us; error 25 us; skew 500 ppm
Aug 08 04:43:18 dist-test-slave-vxj2 krb5kdc[5498](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164198, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.240.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:43:18.668274 5779 init.cc:377] Logged in from keytab as kudu/127.20.240.194@KRBTEST.COM (short username kudu)
I20260808 04:43:18.669255 5779 webserver.cc:460] Webserver started at http://127.20.240.194:40943/ using document root <none> and password file <none>
I20260808 04:43:18.669847 5779 fs_manager.cc:359] Metadata directory not provided
I20260808 04:43:18.669939 5779 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:43:18.670174 5779 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 04:43:18.672299 5779 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164000593138-21443-0/minicluster-data/ts-1/data/instance:
uuid: "f9f60f08a7dc4fbda63770a3b26a861e"
format_stamp: "Formatted at 2026-08-08 04:43:18 on dist-test-slave-vxj2"
server_key: "3e7999911ff6797d78b5e8fd1673438e"
server_key_iv: "97b7ec248c2a07b63d6196f5d324536e"
server_key_version: "encryptionkey@0"
I20260808 04:43:18.672911 5779 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164000593138-21443-0/minicluster-data/ts-1/wal/instance:
uuid: "f9f60f08a7dc4fbda63770a3b26a861e"
format_stamp: "Formatted at 2026-08-08 04:43:18 on dist-test-slave-vxj2"
server_key: "3e7999911ff6797d78b5e8fd1673438e"
server_key_iv: "97b7ec248c2a07b63d6196f5d324536e"
server_key_version: "encryptionkey@0"
I20260808 04:43:18.676986 5779 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20260808 04:43:18.679873 5797 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:43:18.681454 5779 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 04:43:18.681608 5779 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164000593138-21443-0/minicluster-data/ts-1/data,/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164000593138-21443-0/minicluster-data/ts-1/wal
uuid: "f9f60f08a7dc4fbda63770a3b26a861e"
format_stamp: "Formatted at 2026-08-08 04:43:18 on dist-test-slave-vxj2"
server_key: "3e7999911ff6797d78b5e8fd1673438e"
server_key_iv: "97b7ec248c2a07b63d6196f5d324536e"
server_key_version: "encryptionkey@0"
I20260808 04:43:18.681738 5779 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164000593138-21443-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164000593138-21443-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164000593138-21443-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:43:18.704730 5779 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:43:18.708603 5779 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:43:18.708844 5779 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:43:18.709604 5779 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 04:43:18.710600 5779 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 04:43:18.710671 5779 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 04:43:18.710742 5779 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 04:43:18.710788 5779 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 04:43:18.720212 5779 rpc_server.cc:307] RPC server started. Bound to: 127.20.240.194:45369
I20260808 04:43:18.720237 5921 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.240.194:45369 every 8 connection(s)
I20260808 04:43:18.721192 5779 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164000593138-21443-0/minicluster-data/ts-1/data/info.pb
I20260808 04:43:18.728102 21443 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu as pid 5779
I20260808 04:43:18.728245 21443 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164000593138-21443-0/minicluster-data/ts-1/wal/instance
I20260808 04:43:18.728585 21443 external_mini_cluster.cc:1428] Setting key 1453b3bb35dc5357529fc2d73c5969a4
Aug 08 04:43:18 dist-test-slave-vxj2 krb5kdc[5498](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164198, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.240.194@KRBTEST.COM for kudu/127.20.240.254@KRBTEST.COM
I20260808 04:43:18.736948 5596 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:43:18.723152 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.240.194:43479 (local address 127.20.240.254:42631)
0808 04:43:18.723334 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0808 04:43:18.723339 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 04:43:18.724186 (+ 847us) server_negotiation.cc:407] Connection header received
0808 04:43:18.725590 (+ 1404us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:43:18.725592 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:43:18.725639 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:43:18.725715 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:43:18.727205 (+ 1490us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:43:18.727891 (+ 686us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:43:18.729626 (+ 1735us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:43:18.729993 (+ 367us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:43:18.730118 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:43:18.733247 (+ 3129us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:43:18.733250 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:43:18.733253 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:43:18.733285 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:43:18.734765 (+ 1480us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:43:18.735323 (+ 558us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:43:18.735326 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:43:18.735328 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:43:18.735410 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:43:18.735766 (+ 356us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:43:18.735769 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:43:18.735771 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:43:18.735979 (+ 208us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:43:18.736082 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0808 04:43:18.736625 (+ 543us) server_negotiation.cc:299] Negotiation successful
0808 04:43:18.736760 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260808 04:43:18.737826 5924 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:43:18.723552 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:42631 (local address 127.20.240.194:43479)
0808 04:43:18.724026 (+ 474us) negotiation.cc:107] Waiting for socket to connect
0808 04:43:18.724072 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0808 04:43:18.725402 (+ 1330us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:43:18.725906 (+ 504us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:43:18.725912 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:43:18.726303 (+ 391us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:43:18.727010 (+ 707us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:43:18.727031 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:43:18.728050 (+ 1019us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:43:18.728067 (+ 17us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:43:18.729508 (+ 1441us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:43:18.729518 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:43:18.730237 (+ 719us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:43:18.730243 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:43:18.730443 (+ 200us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:43:18.731123 (+ 680us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:43:18.731140 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:43:18.733029 (+ 1889us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:43:18.734899 (+ 1870us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:43:18.734905 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:43:18.734923 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:43:18.735209 (+ 286us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:43:18.735501 (+ 292us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:43:18.735506 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:43:18.735508 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:43:18.735666 (+ 158us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:43:18.736086 (+ 420us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:43:18.736095 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:43:18.736367 (+ 272us) client_negotiation.cc:769] Sending connection context
0808 04:43:18.736564 (+ 197us) client_negotiation.cc:240] Negotiation successful
0808 04:43:18.736919 (+ 355us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":287,"thread_start_us":105,"threads_started":1}
WARNING: no policy specified for kudu/127.20.240.195@KRBTEST.COM; defaulting to no policy
I20260808 04:43:18.738988 5922 heartbeater.cc:347] Connected to a master server at 127.20.240.254:42631
I20260808 04:43:18.739248 5922 heartbeater.cc:464] Registering TS with master...
I20260808 04:43:18.739852 5922 heartbeater.cc:511] Master 127.20.240.254:42631 requested a full tablet report, sending...
I20260808 04:43:18.740947 5551 ts_manager.cc:194] Registered new tserver with Master: f9f60f08a7dc4fbda63770a3b26a861e (127.20.240.194:45369)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.240.195@KRBTEST.COM" created.
I20260808 04:43:18.741677 5551 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.240.194@KRBTEST.COM'} at 127.20.240.194:43479
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.240.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.195.keytab.
Entry for principal kudu/127.20.240.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.195.keytab.
I20260808 04:43:18.758479 21443 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
/tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164000593138-21443-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164000593138-21443-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164000593138-21443-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164000593138-21443-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.240.195:0
--local_ip_for_outbound_sockets=127.20.240.195
--webserver_interface=127.20.240.195
--webserver_port=0
--tserver_master_addrs=127.20.240.254:42631
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.195.keytab
--principal=kudu/127.20.240.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.240.212:44813
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164000593138-21443-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164000593138-21443-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164000593138-21443-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 04:43:18.876896 5927 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:43:18.877264 5927 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:43:18.877318 5927 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:43:18.881578 5927 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:43:18.881652 5927 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:43:18.881740 5927 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.240.195
I20260808 04:43:18.887377 5927 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.240.212:44813
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164000593138-21443-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164000593138-21443-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.195.keytab
--principal=kudu/127.20.240.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.240.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164000593138-21443-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.240.195
--webserver_port=0
--tserver_master_addrs=127.20.240.254:42631
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5927
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.240.195
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164000593138-21443-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 04:05:18 UTC on ccycloud.quasar-drfdgt.root.comops.site
build id 4574101
I20260808 04:43:18.888449 5927 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:43:18.889547 5927 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:43:18.899267 5936 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:43:18.899267 5934 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:43:18.899315 5933 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:43:18.899551 5927 server_base.cc:1034] running on GCE node
I20260808 04:43:18.900027 5927 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:43:18.900679 5927 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:43:18.901863 5927 hybrid_clock.cc:648] HybridClock initialized: now 1786164198901837 us; error 37 us; skew 500 ppm
Aug 08 04:43:18 dist-test-slave-vxj2 krb5kdc[5498](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164198, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.240.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:43:18.904599 5927 init.cc:377] Logged in from keytab as kudu/127.20.240.195@KRBTEST.COM (short username kudu)
I20260808 04:43:18.905622 5927 webserver.cc:460] Webserver started at http://127.20.240.195:36523/ using document root <none> and password file <none>
I20260808 04:43:18.906203 5927 fs_manager.cc:359] Metadata directory not provided
I20260808 04:43:18.906291 5927 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:43:18.906534 5927 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 04:43:18.908846 5927 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164000593138-21443-0/minicluster-data/ts-2/data/instance:
uuid: "d5d9247b9d6e4516ab91bbbdec1c2fb1"
format_stamp: "Formatted at 2026-08-08 04:43:18 on dist-test-slave-vxj2"
server_key: "494584af004e89751c8790b8dc9b386c"
server_key_iv: "c8cb85ce9fae9f0602225a06d2962c6f"
server_key_version: "encryptionkey@0"
I20260808 04:43:18.909459 5927 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164000593138-21443-0/minicluster-data/ts-2/wal/instance:
uuid: "d5d9247b9d6e4516ab91bbbdec1c2fb1"
format_stamp: "Formatted at 2026-08-08 04:43:18 on dist-test-slave-vxj2"
server_key: "494584af004e89751c8790b8dc9b386c"
server_key_iv: "c8cb85ce9fae9f0602225a06d2962c6f"
server_key_version: "encryptionkey@0"
I20260808 04:43:18.913493 5927 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260808 04:43:18.916147 5945 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:43:18.917626 5927 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 04:43:18.917774 5927 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164000593138-21443-0/minicluster-data/ts-2/data,/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164000593138-21443-0/minicluster-data/ts-2/wal
uuid: "d5d9247b9d6e4516ab91bbbdec1c2fb1"
format_stamp: "Formatted at 2026-08-08 04:43:18 on dist-test-slave-vxj2"
server_key: "494584af004e89751c8790b8dc9b386c"
server_key_iv: "c8cb85ce9fae9f0602225a06d2962c6f"
server_key_version: "encryptionkey@0"
I20260808 04:43:18.917907 5927 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164000593138-21443-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164000593138-21443-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164000593138-21443-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:43:18.934675 5927 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:43:18.937940 5927 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:43:18.938140 5927 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:43:18.938747 5927 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 04:43:18.939580 5927 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 04:43:18.939627 5927 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 04:43:18.939694 5927 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 04:43:18.939729 5927 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 04:43:18.948768 5927 rpc_server.cc:307] RPC server started. Bound to: 127.20.240.195:38511
I20260808 04:43:18.948791 6071 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.240.195:38511 every 8 connection(s)
I20260808 04:43:18.949793 5927 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164000593138-21443-0/minicluster-data/ts-2/data/info.pb
I20260808 04:43:18.956151 21443 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu as pid 5927
I20260808 04:43:18.956298 21443 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164000593138-21443-0/minicluster-data/ts-2/wal/instance
I20260808 04:43:18.956657 21443 external_mini_cluster.cc:1428] Setting key 636fae852a64a35f36adba92f6b11246
Aug 08 04:43:18 dist-test-slave-vxj2 krb5kdc[5498](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164198, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.240.195@KRBTEST.COM for kudu/127.20.240.254@KRBTEST.COM
I20260808 04:43:18.965296 5596 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:43:18.951833 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.240.195:33279 (local address 127.20.240.254:42631)
0808 04:43:18.952004 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0808 04:43:18.952010 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 04:43:18.952971 (+ 961us) server_negotiation.cc:407] Connection header received
0808 04:43:18.954424 (+ 1453us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:43:18.954427 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:43:18.954478 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:43:18.954562 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:43:18.955985 (+ 1423us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:43:18.956888 (+ 903us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:43:18.958616 (+ 1728us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:43:18.958920 (+ 304us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:43:18.959011 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:43:18.961663 (+ 2652us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:43:18.961666 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:43:18.961668 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:43:18.961694 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:43:18.963184 (+ 1490us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:43:18.963760 (+ 576us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:43:18.963763 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:43:18.963765 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:43:18.963863 (+ 98us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:43:18.964208 (+ 345us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:43:18.964211 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:43:18.964212 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:43:18.964416 (+ 204us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:43:18.964501 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0808 04:43:18.964992 (+ 491us) server_negotiation.cc:299] Negotiation successful
0808 04:43:18.965101 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260808 04:43:18.966203 6074 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:43:18.952320 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:42631 (local address 127.20.240.195:33279)
0808 04:43:18.952781 (+ 461us) negotiation.cc:107] Waiting for socket to connect
0808 04:43:18.952845 (+ 64us) client_negotiation.cc:174] Beginning negotiation
0808 04:43:18.954186 (+ 1341us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:43:18.954771 (+ 585us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:43:18.954778 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:43:18.955205 (+ 427us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:43:18.955735 (+ 530us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:43:18.955786 (+ 51us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:43:18.957089 (+ 1303us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:43:18.957093 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:43:18.958503 (+ 1410us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:43:18.958515 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:43:18.959099 (+ 584us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:43:18.959102 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:43:18.959254 (+ 152us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:43:18.959847 (+ 593us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:43:18.959864 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:43:18.961475 (+ 1611us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:43:18.963290 (+ 1815us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:43:18.963295 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:43:18.963308 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:43:18.963581 (+ 273us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:43:18.963956 (+ 375us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:43:18.963958 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:43:18.963959 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:43:18.964090 (+ 131us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:43:18.964508 (+ 418us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:43:18.964514 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:43:18.964760 (+ 246us) client_negotiation.cc:769] Sending connection context
0808 04:43:18.964913 (+ 153us) client_negotiation.cc:240] Negotiation successful
0808 04:43:18.965248 (+ 335us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":272,"thread_start_us":123,"threads_started":1}
I20260808 04:43:18.967480 6072 heartbeater.cc:347] Connected to a master server at 127.20.240.254:42631
I20260808 04:43:18.967748 6072 heartbeater.cc:464] Registering TS with master...
I20260808 04:43:18.968264 6072 heartbeater.cc:511] Master 127.20.240.254:42631 requested a full tablet report, sending...
I20260808 04:43:18.969427 5551 ts_manager.cc:194] Registered new tserver with Master: d5d9247b9d6e4516ab91bbbdec1c2fb1 (127.20.240.195:38511)
I20260808 04:43:18.970214 5551 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.240.195@KRBTEST.COM'} at 127.20.240.195:33279
I20260808 04:43:18.970945 21443 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 04:43:18.980682 5596 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:43:18.973028 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40478 (local address 127.20.240.254:42631)
0808 04:43:18.973209 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0808 04:43:18.973214 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 04:43:18.973399 (+ 185us) server_negotiation.cc:407] Connection header received
0808 04:43:18.973552 (+ 153us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:43:18.973554 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:43:18.973599 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:43:18.973686 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:43:18.974404 (+ 718us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:43:18.974924 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:43:18.975819 (+ 895us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:43:18.976054 (+ 235us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:43:18.976165 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:43:18.977652 (+ 1487us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:43:18.977657 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:43:18.977660 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:43:18.977687 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:43:18.979007 (+ 1320us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:43:18.979426 (+ 419us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:43:18.979431 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:43:18.979432 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:43:18.979517 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:43:18.979780 (+ 263us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:43:18.979784 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:43:18.979786 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:43:18.980026 (+ 240us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:43:18.980168 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0808 04:43:18.980396 (+ 228us) server_negotiation.cc:299] Negotiation successful
0808 04:43:18.980517 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260808 04:43:18.983589 5551 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40478:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 04:43:18.986847 5551 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 04:43:19.002581 6088 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:43:18.996738 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53648 (local address 127.20.240.195:38511)
0808 04:43:18.997329 (+ 591us) server_negotiation.cc:206] Beginning negotiation
0808 04:43:18.997339 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 04:43:18.997360 (+ 21us) server_negotiation.cc:407] Connection header received
0808 04:43:18.997431 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:43:18.997436 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:43:18.997598 (+ 162us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:43:18.997727 (+ 129us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 04:43:18.997953 (+ 226us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:43:18.998981 (+ 1028us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:43:19.000918 (+ 1937us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:43:19.001859 (+ 941us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:43:19.002001 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:43:19.002147 (+ 146us) server_negotiation.cc:1035] Waiting for connection context
0808 04:43:19.002334 (+ 187us) server_negotiation.cc:299] Negotiation successful
0808 04:43:19.002418 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":497,"thread_start_us":92,"threads_started":1}
I20260808 04:43:19.002622 6086 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:43:18.996358 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.195:38511 (local address 127.0.0.1:53648)
0808 04:43:18.996810 (+ 452us) negotiation.cc:107] Waiting for socket to connect
0808 04:43:18.996825 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 04:43:18.996906 (+ 81us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:43:18.997707 (+ 801us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:43:18.997709 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:43:18.997723 (+ 14us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 04:43:18.997829 (+ 106us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:43:18.997835 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:43:18.999106 (+ 1271us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:43:18.999112 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:43:19.000775 (+ 1663us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:43:19.000787 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:43:19.001993 (+ 1206us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:43:19.001996 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:43:19.002120 (+ 124us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:43:19.002165 (+ 45us) client_negotiation.cc:769] Sending connection context
0808 04:43:19.002304 (+ 139us) client_negotiation.cc:240] Negotiation successful
0808 04:43:19.002443 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":366,"mutex_wait_us":101,"thread_start_us":102,"threads_started":1}
I20260808 04:43:19.003082 6084 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:43:18.995972 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.194:45369 (local address 127.0.0.1:39634)
0808 04:43:18.996506 (+ 534us) negotiation.cc:107] Waiting for socket to connect
0808 04:43:18.996565 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0808 04:43:18.996710 (+ 145us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:43:18.997604 (+ 894us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:43:18.997610 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:43:18.997639 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 04:43:18.997820 (+ 181us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:43:18.997827 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:43:18.999249 (+ 1422us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:43:18.999252 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:43:19.001572 (+ 2320us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:43:19.001581 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:43:19.002622 (+ 1041us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:43:19.002626 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:43:19.002736 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:43:19.002772 (+ 36us) client_negotiation.cc:769] Sending connection context
0808 04:43:19.002849 (+ 77us) client_negotiation.cc:240] Negotiation successful
0808 04:43:19.002915 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":344,"mutex_wait_us":1242,"thread_start_us":90,"threads_started":1}
I20260808 04:43:19.003238 6087 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:43:18.996703 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.193:33027 (local address 127.0.0.1:33002)
0808 04:43:18.997889 (+ 1186us) negotiation.cc:107] Waiting for socket to connect
0808 04:43:18.997903 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 04:43:18.998008 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:43:18.998489 (+ 481us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:43:18.998492 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:43:18.998511 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 04:43:18.998605 (+ 94us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:43:18.998612 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:43:18.999803 (+ 1191us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:43:18.999807 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:43:19.000920 (+ 1113us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:43:19.000927 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:43:19.002834 (+ 1907us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:43:19.002838 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:43:19.002933 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:43:19.002956 (+ 23us) client_negotiation.cc:769] Sending connection context
0808 04:43:19.003033 (+ 77us) client_negotiation.cc:240] Negotiation successful
0808 04:43:19.003109 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1122,"thread_start_us":93,"threads_started":1}
I20260808 04:43:19.003341 6089 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:43:18.997263 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33002 (local address 127.20.240.193:33027)
0808 04:43:18.997622 (+ 359us) server_negotiation.cc:206] Beginning negotiation
0808 04:43:18.997638 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0808 04:43:18.997992 (+ 354us) server_negotiation.cc:407] Connection header received
0808 04:43:18.998125 (+ 133us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:43:18.998130 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:43:18.998342 (+ 212us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:43:18.998494 (+ 152us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 04:43:18.998727 (+ 233us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:43:18.999691 (+ 964us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:43:19.001040 (+ 1349us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:43:19.001859 (+ 819us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:43:19.002002 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:43:19.002147 (+ 145us) server_negotiation.cc:1035] Waiting for connection context
0808 04:43:19.003084 (+ 937us) server_negotiation.cc:299] Negotiation successful
0808 04:43:19.003189 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":265,"thread_start_us":74,"threads_started":1}
I20260808 04:43:19.003801 6085 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:43:18.996181 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39634 (local address 127.20.240.194:45369)
0808 04:43:18.997027 (+ 846us) server_negotiation.cc:206] Beginning negotiation
0808 04:43:18.997042 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0808 04:43:18.997066 (+ 24us) server_negotiation.cc:407] Connection header received
0808 04:43:18.997173 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:43:18.997179 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:43:18.997411 (+ 232us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:43:18.997598 (+ 187us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 04:43:18.997966 (+ 368us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:43:18.999103 (+ 1137us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:43:19.001702 (+ 2599us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:43:19.002486 (+ 784us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:43:19.002609 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:43:19.002740 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0808 04:43:19.003524 (+ 784us) server_negotiation.cc:299] Negotiation successful
0808 04:43:19.003637 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":731,"thread_start_us":140,"threads_started":1}
I20260808 04:43:19.006816 5851 tablet_service.cc:1467] Processing CreateTablet for tablet e8f1780f709c414db06ecb51affd1c32 (DEFAULT_TABLE table=test-table [id=d30f7bdc37b0428fa8748dbeccd12b4d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 04:43:19.007257 5702 tablet_service.cc:1467] Processing CreateTablet for tablet e8f1780f709c414db06ecb51affd1c32 (DEFAULT_TABLE table=test-table [id=d30f7bdc37b0428fa8748dbeccd12b4d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 04:43:19.007259 5997 tablet_service.cc:1467] Processing CreateTablet for tablet e8f1780f709c414db06ecb51affd1c32 (DEFAULT_TABLE table=test-table [id=d30f7bdc37b0428fa8748dbeccd12b4d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 04:43:19.008046 5851 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e8f1780f709c414db06ecb51affd1c32. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:43:19.008265 5702 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e8f1780f709c414db06ecb51affd1c32. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:43:19.008275 5997 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e8f1780f709c414db06ecb51affd1c32. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:43:19.014581 6090 tablet_bootstrap.cc:492] T e8f1780f709c414db06ecb51affd1c32 P f9f60f08a7dc4fbda63770a3b26a861e: Bootstrap starting.
I20260808 04:43:19.015846 6091 tablet_bootstrap.cc:492] T e8f1780f709c414db06ecb51affd1c32 P 17256af032074b1b9b1276bc078bf23f: Bootstrap starting.
I20260808 04:43:19.015853 6092 tablet_bootstrap.cc:492] T e8f1780f709c414db06ecb51affd1c32 P d5d9247b9d6e4516ab91bbbdec1c2fb1: Bootstrap starting.
I20260808 04:43:19.017814 6092 tablet_bootstrap.cc:654] T e8f1780f709c414db06ecb51affd1c32 P d5d9247b9d6e4516ab91bbbdec1c2fb1: Neither blocks nor log segments found. Creating new log.
I20260808 04:43:19.017822 6091 tablet_bootstrap.cc:654] T e8f1780f709c414db06ecb51affd1c32 P 17256af032074b1b9b1276bc078bf23f: Neither blocks nor log segments found. Creating new log.
I20260808 04:43:19.018543 6090 tablet_bootstrap.cc:654] T e8f1780f709c414db06ecb51affd1c32 P f9f60f08a7dc4fbda63770a3b26a861e: Neither blocks nor log segments found. Creating new log.
I20260808 04:43:19.018836 6091 log.cc:824] T e8f1780f709c414db06ecb51affd1c32 P 17256af032074b1b9b1276bc078bf23f: Log is configured to *not* fsync() on all Append() calls
I20260808 04:43:19.019232 6092 log.cc:824] T e8f1780f709c414db06ecb51affd1c32 P d5d9247b9d6e4516ab91bbbdec1c2fb1: Log is configured to *not* fsync() on all Append() calls
I20260808 04:43:19.019871 6090 log.cc:824] T e8f1780f709c414db06ecb51affd1c32 P f9f60f08a7dc4fbda63770a3b26a861e: Log is configured to *not* fsync() on all Append() calls
I20260808 04:43:19.020931 6091 tablet_bootstrap.cc:492] T e8f1780f709c414db06ecb51affd1c32 P 17256af032074b1b9b1276bc078bf23f: No bootstrap required, opened a new log
I20260808 04:43:19.021108 6092 tablet_bootstrap.cc:492] T e8f1780f709c414db06ecb51affd1c32 P d5d9247b9d6e4516ab91bbbdec1c2fb1: No bootstrap required, opened a new log
I20260808 04:43:19.021139 6091 ts_tablet_manager.cc:1397] T e8f1780f709c414db06ecb51affd1c32 P 17256af032074b1b9b1276bc078bf23f: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260808 04:43:19.021327 6092 ts_tablet_manager.cc:1397] T e8f1780f709c414db06ecb51affd1c32 P d5d9247b9d6e4516ab91bbbdec1c2fb1: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.001s
I20260808 04:43:19.021843 6090 tablet_bootstrap.cc:492] T e8f1780f709c414db06ecb51affd1c32 P f9f60f08a7dc4fbda63770a3b26a861e: No bootstrap required, opened a new log
I20260808 04:43:19.022028 6090 ts_tablet_manager.cc:1397] T e8f1780f709c414db06ecb51affd1c32 P f9f60f08a7dc4fbda63770a3b26a861e: Time spent bootstrapping tablet: real 0.008s user 0.005s sys 0.000s
I20260808 04:43:19.025059 6091 raft_consensus.cc:348] T e8f1780f709c414db06ecb51affd1c32 P 17256af032074b1b9b1276bc078bf23f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9f60f08a7dc4fbda63770a3b26a861e" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 45369 } } peers { permanent_uuid: "17256af032074b1b9b1276bc078bf23f" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 33027 } } peers { permanent_uuid: "d5d9247b9d6e4516ab91bbbdec1c2fb1" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 38511 } }
I20260808 04:43:19.025189 6092 raft_consensus.cc:348] T e8f1780f709c414db06ecb51affd1c32 P d5d9247b9d6e4516ab91bbbdec1c2fb1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9f60f08a7dc4fbda63770a3b26a861e" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 45369 } } peers { permanent_uuid: "17256af032074b1b9b1276bc078bf23f" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 33027 } } peers { permanent_uuid: "d5d9247b9d6e4516ab91bbbdec1c2fb1" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 38511 } }
I20260808 04:43:19.025487 6091 raft_consensus.cc:374] T e8f1780f709c414db06ecb51affd1c32 P 17256af032074b1b9b1276bc078bf23f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:43:19.025545 6092 raft_consensus.cc:374] T e8f1780f709c414db06ecb51affd1c32 P d5d9247b9d6e4516ab91bbbdec1c2fb1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:43:19.025624 6091 raft_consensus.cc:729] T e8f1780f709c414db06ecb51affd1c32 P 17256af032074b1b9b1276bc078bf23f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17256af032074b1b9b1276bc078bf23f, State: Initialized, Role: FOLLOWER
I20260808 04:43:19.025676 6092 raft_consensus.cc:729] T e8f1780f709c414db06ecb51affd1c32 P d5d9247b9d6e4516ab91bbbdec1c2fb1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d5d9247b9d6e4516ab91bbbdec1c2fb1, State: Initialized, Role: FOLLOWER
I20260808 04:43:19.026053 6090 raft_consensus.cc:348] T e8f1780f709c414db06ecb51affd1c32 P f9f60f08a7dc4fbda63770a3b26a861e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9f60f08a7dc4fbda63770a3b26a861e" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 45369 } } peers { permanent_uuid: "17256af032074b1b9b1276bc078bf23f" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 33027 } } peers { permanent_uuid: "d5d9247b9d6e4516ab91bbbdec1c2fb1" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 38511 } }
I20260808 04:43:19.026172 6091 consensus_queue.cc:260] T e8f1780f709c414db06ecb51affd1c32 P 17256af032074b1b9b1276bc078bf23f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9f60f08a7dc4fbda63770a3b26a861e" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 45369 } } peers { permanent_uuid: "17256af032074b1b9b1276bc078bf23f" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 33027 } } peers { permanent_uuid: "d5d9247b9d6e4516ab91bbbdec1c2fb1" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 38511 } }
I20260808 04:43:19.026178 6092 consensus_queue.cc:260] T e8f1780f709c414db06ecb51affd1c32 P d5d9247b9d6e4516ab91bbbdec1c2fb1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9f60f08a7dc4fbda63770a3b26a861e" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 45369 } } peers { permanent_uuid: "17256af032074b1b9b1276bc078bf23f" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 33027 } } peers { permanent_uuid: "d5d9247b9d6e4516ab91bbbdec1c2fb1" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 38511 } }
I20260808 04:43:19.026322 6090 raft_consensus.cc:374] T e8f1780f709c414db06ecb51affd1c32 P f9f60f08a7dc4fbda63770a3b26a861e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:43:19.026409 6090 raft_consensus.cc:729] T e8f1780f709c414db06ecb51affd1c32 P f9f60f08a7dc4fbda63770a3b26a861e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f9f60f08a7dc4fbda63770a3b26a861e, State: Initialized, Role: FOLLOWER
I20260808 04:43:19.026896 6090 consensus_queue.cc:260] T e8f1780f709c414db06ecb51affd1c32 P f9f60f08a7dc4fbda63770a3b26a861e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9f60f08a7dc4fbda63770a3b26a861e" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 45369 } } peers { permanent_uuid: "17256af032074b1b9b1276bc078bf23f" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 33027 } } peers { permanent_uuid: "d5d9247b9d6e4516ab91bbbdec1c2fb1" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 38511 } }
I20260808 04:43:19.027196 6091 ts_tablet_manager.cc:1428] T e8f1780f709c414db06ecb51affd1c32 P 17256af032074b1b9b1276bc078bf23f: Time spent starting tablet: real 0.006s user 0.003s sys 0.002s
I20260808 04:43:19.027217 6092 ts_tablet_manager.cc:1428] T e8f1780f709c414db06ecb51affd1c32 P d5d9247b9d6e4516ab91bbbdec1c2fb1: Time spent starting tablet: real 0.006s user 0.003s sys 0.002s
I20260808 04:43:19.027587 5772 heartbeater.cc:503] Master 127.20.240.254:42631 was elected leader, sending a full tablet report...
I20260808 04:43:19.027588 5922 heartbeater.cc:503] Master 127.20.240.254:42631 was elected leader, sending a full tablet report...
I20260808 04:43:19.027734 6090 ts_tablet_manager.cc:1428] T e8f1780f709c414db06ecb51affd1c32 P f9f60f08a7dc4fbda63770a3b26a861e: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260808 04:43:19.028306 6072 heartbeater.cc:503] Master 127.20.240.254:42631 was elected leader, sending a full tablet report...
W20260808 04:43:19.200944 6073 tablet.cc:2369] T e8f1780f709c414db06ecb51affd1c32 P d5d9247b9d6e4516ab91bbbdec1c2fb1: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 04:43:19.222620 5923 tablet.cc:2369] T e8f1780f709c414db06ecb51affd1c32 P f9f60f08a7dc4fbda63770a3b26a861e: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 04:43:19.233286 5774 tablet.cc:2369] T e8f1780f709c414db06ecb51affd1c32 P 17256af032074b1b9b1276bc078bf23f: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 04:43:19.311250 6097 raft_consensus.cc:482] T e8f1780f709c414db06ecb51affd1c32 P 17256af032074b1b9b1276bc078bf23f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 04:43:19.311530 6097 raft_consensus.cc:504] T e8f1780f709c414db06ecb51affd1c32 P 17256af032074b1b9b1276bc078bf23f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9f60f08a7dc4fbda63770a3b26a861e" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 45369 } } peers { permanent_uuid: "17256af032074b1b9b1276bc078bf23f" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 33027 } } peers { permanent_uuid: "d5d9247b9d6e4516ab91bbbdec1c2fb1" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 38511 } }
I20260808 04:43:19.312759 6097 leader_election.cc:288] T e8f1780f709c414db06ecb51affd1c32 P 17256af032074b1b9b1276bc078bf23f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f9f60f08a7dc4fbda63770a3b26a861e (127.20.240.194:45369), d5d9247b9d6e4516ab91bbbdec1c2fb1 (127.20.240.195:38511)
I20260808 04:43:19.316970 6088 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:43:19.313225 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.240.193:38449 (local address 127.20.240.195:38511)
0808 04:43:19.313377 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0808 04:43:19.313382 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 04:43:19.313583 (+ 201us) server_negotiation.cc:407] Connection header received
0808 04:43:19.313791 (+ 208us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:43:19.313796 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:43:19.313846 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:43:19.313911 (+ 65us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 04:43:19.314246 (+ 335us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:43:19.314759 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:43:19.315958 (+ 1199us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:43:19.316368 (+ 410us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:43:19.316504 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:43:19.316564 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0808 04:43:19.316762 (+ 198us) server_negotiation.cc:299] Negotiation successful
0808 04:43:19.316838 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260808 04:43:19.316978 6085 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:43:19.313126 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.240.193:60503 (local address 127.20.240.194:45369)
0808 04:43:19.313315 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0808 04:43:19.313321 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 04:43:19.313678 (+ 357us) server_negotiation.cc:407] Connection header received
0808 04:43:19.313819 (+ 141us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:43:19.313822 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:43:19.313865 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:43:19.313960 (+ 95us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 04:43:19.314293 (+ 333us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:43:19.314766 (+ 473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:43:19.315992 (+ 1226us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:43:19.316375 (+ 383us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:43:19.316504 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:43:19.316563 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0808 04:43:19.316786 (+ 223us) server_negotiation.cc:299] Negotiation successful
0808 04:43:19.316857 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":83}
I20260808 04:43:19.317008 6100 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:43:19.313070 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.194:45369 (local address 127.20.240.193:60503)
0808 04:43:19.313592 (+ 522us) negotiation.cc:107] Waiting for socket to connect
0808 04:43:19.313604 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 04:43:19.313695 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:43:19.313977 (+ 282us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:43:19.313980 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:43:19.314020 (+ 40us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 04:43:19.314158 (+ 138us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:43:19.314162 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:43:19.314900 (+ 738us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:43:19.314904 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:43:19.315841 (+ 937us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:43:19.315851 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:43:19.316504 (+ 653us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:43:19.316508 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:43:19.316653 (+ 145us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:43:19.316670 (+ 17us) client_negotiation.cc:769] Sending connection context
0808 04:43:19.316759 (+ 89us) client_negotiation.cc:240] Negotiation successful
0808 04:43:19.316831 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":437,"mutex_wait_us":275,"spinlock_wait_cycles":768,"thread_start_us":159,"threads_started":1}
I20260808 04:43:19.317018 6099 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:43:19.313071 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.195:38511 (local address 127.20.240.193:38449)
0808 04:43:19.313485 (+ 414us) negotiation.cc:107] Waiting for socket to connect
0808 04:43:19.313498 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 04:43:19.313640 (+ 142us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:43:19.313944 (+ 304us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:43:19.313951 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:43:19.313967 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 04:43:19.314132 (+ 165us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:43:19.314137 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:43:19.314870 (+ 733us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:43:19.314876 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:43:19.315831 (+ 955us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:43:19.315841 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:43:19.316504 (+ 663us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:43:19.316508 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:43:19.316640 (+ 132us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:43:19.316660 (+ 20us) client_negotiation.cc:769] Sending connection context
0808 04:43:19.316720 (+ 60us) client_negotiation.cc:240] Negotiation successful
0808 04:43:19.316813 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":356,"mutex_wait_us":51,"spinlock_wait_cycles":11648,"thread_start_us":167,"threads_started":1}
I20260808 04:43:19.317842 5872 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e8f1780f709c414db06ecb51affd1c32" candidate_uuid: "17256af032074b1b9b1276bc078bf23f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9f60f08a7dc4fbda63770a3b26a861e" is_pre_election: true
I20260808 04:43:19.317925 6018 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e8f1780f709c414db06ecb51affd1c32" candidate_uuid: "17256af032074b1b9b1276bc078bf23f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5d9247b9d6e4516ab91bbbdec1c2fb1" is_pre_election: true
I20260808 04:43:19.318202 5872 raft_consensus.cc:2454] T e8f1780f709c414db06ecb51affd1c32 P f9f60f08a7dc4fbda63770a3b26a861e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17256af032074b1b9b1276bc078bf23f in term 0.
I20260808 04:43:19.318225 6018 raft_consensus.cc:2454] T e8f1780f709c414db06ecb51affd1c32 P d5d9247b9d6e4516ab91bbbdec1c2fb1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17256af032074b1b9b1276bc078bf23f in term 0.
I20260808 04:43:19.318746 5646 leader_election.cc:302] T e8f1780f709c414db06ecb51affd1c32 P 17256af032074b1b9b1276bc078bf23f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 17256af032074b1b9b1276bc078bf23f, d5d9247b9d6e4516ab91bbbdec1c2fb1, f9f60f08a7dc4fbda63770a3b26a861e; no voters:
I20260808 04:43:19.319167 6097 raft_consensus.cc:2781] T e8f1780f709c414db06ecb51affd1c32 P 17256af032074b1b9b1276bc078bf23f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 04:43:19.319306 6097 raft_consensus.cc:482] T e8f1780f709c414db06ecb51affd1c32 P 17256af032074b1b9b1276bc078bf23f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 04:43:19.319350 6097 raft_consensus.cc:3037] T e8f1780f709c414db06ecb51affd1c32 P 17256af032074b1b9b1276bc078bf23f [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:43:19.320420 6097 raft_consensus.cc:504] T e8f1780f709c414db06ecb51affd1c32 P 17256af032074b1b9b1276bc078bf23f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9f60f08a7dc4fbda63770a3b26a861e" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 45369 } } peers { permanent_uuid: "17256af032074b1b9b1276bc078bf23f" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 33027 } } peers { permanent_uuid: "d5d9247b9d6e4516ab91bbbdec1c2fb1" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 38511 } }
I20260808 04:43:19.320778 6097 leader_election.cc:288] T e8f1780f709c414db06ecb51affd1c32 P 17256af032074b1b9b1276bc078bf23f [CANDIDATE]: Term 1 election: Requested vote from peers f9f60f08a7dc4fbda63770a3b26a861e (127.20.240.194:45369), d5d9247b9d6e4516ab91bbbdec1c2fb1 (127.20.240.195:38511)
I20260808 04:43:19.321219 6018 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e8f1780f709c414db06ecb51affd1c32" candidate_uuid: "17256af032074b1b9b1276bc078bf23f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5d9247b9d6e4516ab91bbbdec1c2fb1"
I20260808 04:43:19.321265 5872 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e8f1780f709c414db06ecb51affd1c32" candidate_uuid: "17256af032074b1b9b1276bc078bf23f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9f60f08a7dc4fbda63770a3b26a861e"
I20260808 04:43:19.321376 6018 raft_consensus.cc:3037] T e8f1780f709c414db06ecb51affd1c32 P d5d9247b9d6e4516ab91bbbdec1c2fb1 [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:43:19.321440 5872 raft_consensus.cc:3037] T e8f1780f709c414db06ecb51affd1c32 P f9f60f08a7dc4fbda63770a3b26a861e [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:43:19.322628 6018 raft_consensus.cc:2454] T e8f1780f709c414db06ecb51affd1c32 P d5d9247b9d6e4516ab91bbbdec1c2fb1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17256af032074b1b9b1276bc078bf23f in term 1.
I20260808 04:43:19.322682 5872 raft_consensus.cc:2454] T e8f1780f709c414db06ecb51affd1c32 P f9f60f08a7dc4fbda63770a3b26a861e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17256af032074b1b9b1276bc078bf23f in term 1.
I20260808 04:43:19.322965 5646 leader_election.cc:302] T e8f1780f709c414db06ecb51affd1c32 P 17256af032074b1b9b1276bc078bf23f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17256af032074b1b9b1276bc078bf23f, d5d9247b9d6e4516ab91bbbdec1c2fb1; no voters:
I20260808 04:43:19.323161 6097 raft_consensus.cc:2781] T e8f1780f709c414db06ecb51affd1c32 P 17256af032074b1b9b1276bc078bf23f [term 1 FOLLOWER]: Leader election won for term 1
I20260808 04:43:19.323428 6097 raft_consensus.cc:686] T e8f1780f709c414db06ecb51affd1c32 P 17256af032074b1b9b1276bc078bf23f [term 1 LEADER]: Becoming Leader. State: Replica: 17256af032074b1b9b1276bc078bf23f, State: Running, Role: LEADER
I20260808 04:43:19.323786 6097 consensus_queue.cc:237] T e8f1780f709c414db06ecb51affd1c32 P 17256af032074b1b9b1276bc078bf23f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9f60f08a7dc4fbda63770a3b26a861e" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 45369 } } peers { permanent_uuid: "17256af032074b1b9b1276bc078bf23f" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 33027 } } peers { permanent_uuid: "d5d9247b9d6e4516ab91bbbdec1c2fb1" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 38511 } }
I20260808 04:43:19.327150 5551 catalog_manager.cc:5495] T e8f1780f709c414db06ecb51affd1c32 P 17256af032074b1b9b1276bc078bf23f reported cstate change: term changed from 0 to 1, leader changed from <none> to 17256af032074b1b9b1276bc078bf23f (127.20.240.193). New cstate: current_term: 1 leader_uuid: "17256af032074b1b9b1276bc078bf23f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9f60f08a7dc4fbda63770a3b26a861e" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 45369 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17256af032074b1b9b1276bc078bf23f" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 33027 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d5d9247b9d6e4516ab91bbbdec1c2fb1" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 38511 } health_report { overall_health: UNKNOWN } } }
I20260808 04:43:19.367581 6089 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:43:19.363785 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33014 (local address 127.20.240.193:33027)
0808 04:43:19.363920 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0808 04:43:19.363925 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 04:43:19.363942 (+ 17us) server_negotiation.cc:407] Connection header received
0808 04:43:19.364030 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:43:19.364032 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:43:19.364087 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:43:19.364178 (+ 91us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 04:43:19.364465 (+ 287us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:43:19.364975 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:43:19.365892 (+ 917us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:43:19.366161 (+ 269us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:43:19.366268 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:43:19.366723 (+ 455us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 04:43:19.367190 (+ 467us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 04:43:19.367291 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0808 04:43:19.367395 (+ 104us) server_negotiation.cc:299] Negotiation successful
0808 04:43:19.367459 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260808 04:43:19.374506 5872 raft_consensus.cc:1261] T e8f1780f709c414db06ecb51affd1c32 P f9f60f08a7dc4fbda63770a3b26a861e [term 1 FOLLOWER]: Refusing update from remote peer 17256af032074b1b9b1276bc078bf23f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 04:43:19.374506 6018 raft_consensus.cc:1261] T e8f1780f709c414db06ecb51affd1c32 P d5d9247b9d6e4516ab91bbbdec1c2fb1 [term 1 FOLLOWER]: Refusing update from remote peer 17256af032074b1b9b1276bc078bf23f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 04:43:19.375427 6097 consensus_queue.cc:1035] T e8f1780f709c414db06ecb51affd1c32 P 17256af032074b1b9b1276bc078bf23f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d5d9247b9d6e4516ab91bbbdec1c2fb1" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 38511 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 04:43:19.375711 6101 consensus_queue.cc:1035] T e8f1780f709c414db06ecb51affd1c32 P 17256af032074b1b9b1276bc078bf23f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9f60f08a7dc4fbda63770a3b26a861e" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 45369 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 04:43:19.383991 6104 mvcc.cc:205] Tried to move back new op lower bound from 7316128560629149696 to 7316128560433053696. Current Snapshot: MvccSnapshot[applied={T|T < 7316128560629149696}]
I20260808 04:43:19.387084 6107 mvcc.cc:205] Tried to move back new op lower bound from 7316128560629149696 to 7316128560433053696. Current Snapshot: MvccSnapshot[applied={T|T < 7316128560629149696}]
I20260808 04:43:19.400497 5551 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40478:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 04:43:19.400717 5551 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40478:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 04:43:19.404026 5551 catalog_manager.cc:5782] T 00000000000000000000000000000000 P b44539d028104d79a7fd51cfc6e31178: Sending DeleteTablet for 3 replicas of tablet e8f1780f709c414db06ecb51affd1c32
I20260808 04:43:19.405047 5997 tablet_service.cc:1514] Processing DeleteTablet for tablet e8f1780f709c414db06ecb51affd1c32 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 04:43:19 UTC) from {username='kudu', principal='kudu/127.20.240.254@KRBTEST.COM'} at 127.0.0.1:53648
I20260808 04:43:19.405119 5851 tablet_service.cc:1514] Processing DeleteTablet for tablet e8f1780f709c414db06ecb51affd1c32 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 04:43:19 UTC) from {username='kudu', principal='kudu/127.20.240.254@KRBTEST.COM'} at 127.0.0.1:39634
I20260808 04:43:19.405321 5702 tablet_service.cc:1514] Processing DeleteTablet for tablet e8f1780f709c414db06ecb51affd1c32 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 04:43:19 UTC) from {username='kudu', principal='kudu/127.20.240.254@KRBTEST.COM'} at 127.0.0.1:33002
I20260808 04:43:19.406116 6118 tablet_replica.cc:330] T e8f1780f709c414db06ecb51affd1c32 P 17256af032074b1b9b1276bc078bf23f: stopping tablet replica
I20260808 04:43:19.406312 21443 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu with pid 5625
I20260808 04:43:19.408295 6117 tablet_replica.cc:330] T e8f1780f709c414db06ecb51affd1c32 P d5d9247b9d6e4516ab91bbbdec1c2fb1: stopping tablet replica
I20260808 04:43:19.408782 6117 raft_consensus.cc:2229] T e8f1780f709c414db06ecb51affd1c32 P d5d9247b9d6e4516ab91bbbdec1c2fb1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 04:43:19.409207 6116 tablet_replica.cc:330] T e8f1780f709c414db06ecb51affd1c32 P f9f60f08a7dc4fbda63770a3b26a861e: stopping tablet replica
I20260808 04:43:19.410048 6116 raft_consensus.cc:2229] T e8f1780f709c414db06ecb51affd1c32 P f9f60f08a7dc4fbda63770a3b26a861e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 04:43:19.410463 6116 raft_consensus.cc:2258] T e8f1780f709c414db06ecb51affd1c32 P f9f60f08a7dc4fbda63770a3b26a861e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 04:43:19.411026 6117 raft_consensus.cc:2258] T e8f1780f709c414db06ecb51affd1c32 P d5d9247b9d6e4516ab91bbbdec1c2fb1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 04:43:19.412346 6116 ts_tablet_manager.cc:1905] T e8f1780f709c414db06ecb51affd1c32 P f9f60f08a7dc4fbda63770a3b26a861e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 04:43:19.412549 6117 ts_tablet_manager.cc:1905] T e8f1780f709c414db06ecb51affd1c32 P d5d9247b9d6e4516ab91bbbdec1c2fb1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 04:43:19.415421 6117 ts_tablet_manager.cc:1918] T e8f1780f709c414db06ecb51affd1c32 P d5d9247b9d6e4516ab91bbbdec1c2fb1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 04:43:19.415412 6116 ts_tablet_manager.cc:1918] T e8f1780f709c414db06ecb51affd1c32 P f9f60f08a7dc4fbda63770a3b26a861e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 04:43:19.415532 6117 log.cc:1196] T e8f1780f709c414db06ecb51affd1c32 P d5d9247b9d6e4516ab91bbbdec1c2fb1: Deleting WAL directory at /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164000593138-21443-0/minicluster-data/ts-2/wal/wals/e8f1780f709c414db06ecb51affd1c32
I20260808 04:43:19.415532 6116 log.cc:1196] T e8f1780f709c414db06ecb51affd1c32 P f9f60f08a7dc4fbda63770a3b26a861e: Deleting WAL directory at /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164000593138-21443-0/minicluster-data/ts-1/wal/wals/e8f1780f709c414db06ecb51affd1c32
I20260808 04:43:19.415925 6117 ts_tablet_manager.cc:1939] T e8f1780f709c414db06ecb51affd1c32 P d5d9247b9d6e4516ab91bbbdec1c2fb1: Deleting consensus metadata
I20260808 04:43:19.415925 6116 ts_tablet_manager.cc:1939] T e8f1780f709c414db06ecb51affd1c32 P f9f60f08a7dc4fbda63770a3b26a861e: Deleting consensus metadata
W20260808 04:43:19.417256 5535 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.20.240.193:33027 (error 108)
I20260808 04:43:19.417378 5536 catalog_manager.cc:4841] TS d5d9247b9d6e4516ab91bbbdec1c2fb1 (127.20.240.195:38511): tablet e8f1780f709c414db06ecb51affd1c32 (table test-table [id=d30f7bdc37b0428fa8748dbeccd12b4d]) successfully deleted
I20260808 04:43:19.417778 5535 catalog_manager.cc:4841] TS f9f60f08a7dc4fbda63770a3b26a861e (127.20.240.194:45369): tablet e8f1780f709c414db06ecb51affd1c32 (table test-table [id=d30f7bdc37b0428fa8748dbeccd12b4d]) successfully deleted
I20260808 04:43:19.418376 21443 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu with pid 5779
I20260808 04:43:19.418486 6087 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:43:19.418119 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.193:33027 (local address 127.0.0.1:33016)
0808 04:43:19.418293 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0808 04:43:19.418378 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.240.193:33027: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
W20260808 04:43:19.421236 5535 catalog_manager.cc:4584] TS 17256af032074b1b9b1276bc078bf23f (127.20.240.193:33027): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet e8f1780f709c414db06ecb51affd1c32: Network error: Client connection negotiation failed: client connection to 127.20.240.193:33027: connect: Connection refused (error 111)
I20260808 04:43:19.429241 21443 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu with pid 5927
I20260808 04:43:19.436803 21443 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu with pid 5515
I20260808 04:43:39.445749 21443 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
/tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164000593138-21443-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164000593138-21443-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164000593138-21443-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164000593138-21443-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.240.254:42631
--webserver_interface=127.20.240.254
--webserver_port=41973
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.254.keytab
--principal=kudu/127.20.240.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.240.212:44813
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.240.254:42631
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--tsk_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164000593138-21443-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164000593138-21443-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164000593138-21443-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 04:43:39.563730 6120 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:43:39.564040 6120 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:43:39.564085 6120 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:43:39.568271 6120 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260808 04:43:39.568344 6120 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260808 04:43:39.568362 6120 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260808 04:43:39.568377 6120 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 04:43:39.568396 6120 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:43:39.568414 6120 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:43:39.568430 6120 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 04:43:39.568446 6120 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 04:43:39.574378 6120 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.240.212:44813
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164000593138-21443-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164000593138-21443-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_private_key_password_cmd=echo foo
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.20.240.254:42631
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.254.keytab
--principal=kudu/127.20.240.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.240.254:42631
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164000593138-21443-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.240.254
--webserver_port=41973
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6120
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164000593138-21443-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 04:05:18 UTC on ccycloud.quasar-drfdgt.root.comops.site
build id 4574101
I20260808 04:43:39.575508 6120 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:43:39.576498 6120 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:43:39.590451 6126 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:43:39.590535 6129 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:43:39.590433 6127 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:43:39.590912 6120 server_base.cc:1034] running on GCE node
I20260808 04:43:39.591678 6120 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:43:39.593087 6120 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:43:39.594314 6120 hybrid_clock.cc:648] HybridClock initialized: now 1786164219594275 us; error 54 us; skew 500 ppm
Aug 08 04:43:39 dist-test-slave-vxj2 krb5kdc[5498](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164219, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.240.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:43:39.602701 6120 init.cc:377] Logged in from keytab as kudu/127.20.240.254@KRBTEST.COM (short username kudu)
I20260808 04:43:39.603797 6120 webserver.cc:460] Webserver started at http://127.20.240.254:41973/ using document root <none> and password file <none>
I20260808 04:43:39.604400 6120 fs_manager.cc:359] Metadata directory not provided
I20260808 04:43:39.604490 6120 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:43:39.609004 6120 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.000s
I20260808 04:43:39.611505 6136 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:43:39.612972 6120 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260808 04:43:39.613091 6120 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164000593138-21443-0/minicluster-data/master-0/data,/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164000593138-21443-0/minicluster-data/master-0/wal
uuid: "b44539d028104d79a7fd51cfc6e31178"
format_stamp: "Formatted at 2026-08-08 04:43:18 on dist-test-slave-vxj2"
server_key: "017726d87f8b2218865cb60adba7ff33"
server_key_iv: "26879a73ee0a858f7d901de7a7c616c5"
server_key_version: "encryptionkey@0"
I20260808 04:43:39.613814 6120 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164000593138-21443-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164000593138-21443-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164000593138-21443-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:43:39.632031 6120 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:43:39.635754 6120 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:43:39.635929 6120 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:43:39.643622 6120 rpc_server.cc:307] RPC server started. Bound to: 127.20.240.254:42631
I20260808 04:43:39.643970 6196 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.240.254:42631 every 8 connection(s)
I20260808 04:43:39.644834 6120 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164000593138-21443-0/minicluster-data/master-0/data/info.pb
I20260808 04:43:39.649529 6197 sys_catalog.cc:263] Verifying existing consensus state
I20260808 04:43:39.651336 6197 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b44539d028104d79a7fd51cfc6e31178: Bootstrap starting.
I20260808 04:43:39.653852 21443 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu as pid 6120
I20260808 04:43:39.654359 21443 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
/tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164000593138-21443-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164000593138-21443-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164000593138-21443-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164000593138-21443-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.240.193:33027
--local_ip_for_outbound_sockets=127.20.240.193
--tserver_master_addrs=127.20.240.254:42631
--webserver_port=43429
--webserver_interface=127.20.240.193
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.193.keytab
--principal=kudu/127.20.240.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.240.212:44813
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164000593138-21443-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164000593138-21443-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164000593138-21443-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 04:43:39.670284 6197 log.cc:824] T 00000000000000000000000000000000 P b44539d028104d79a7fd51cfc6e31178: Log is configured to *not* fsync() on all Append() calls
I20260808 04:43:39.679888 6197 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b44539d028104d79a7fd51cfc6e31178: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 04:43:39.680342 6197 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b44539d028104d79a7fd51cfc6e31178: Bootstrap complete.
I20260808 04:43:39.684686 6197 raft_consensus.cc:348] T 00000000000000000000000000000000 P b44539d028104d79a7fd51cfc6e31178 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b44539d028104d79a7fd51cfc6e31178" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 42631 } }
I20260808 04:43:39.685117 6197 raft_consensus.cc:729] T 00000000000000000000000000000000 P b44539d028104d79a7fd51cfc6e31178 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b44539d028104d79a7fd51cfc6e31178, State: Initialized, Role: FOLLOWER
I20260808 04:43:39.685658 6197 consensus_queue.cc:260] T 00000000000000000000000000000000 P b44539d028104d79a7fd51cfc6e31178 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b44539d028104d79a7fd51cfc6e31178" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 42631 } }
I20260808 04:43:39.685776 6197 raft_consensus.cc:388] T 00000000000000000000000000000000 P b44539d028104d79a7fd51cfc6e31178 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 04:43:39.685875 6197 raft_consensus.cc:482] T 00000000000000000000000000000000 P b44539d028104d79a7fd51cfc6e31178 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 04:43:39.685993 6197 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b44539d028104d79a7fd51cfc6e31178 [term 1 FOLLOWER]: Advancing to term 2
I20260808 04:43:39.688078 6197 raft_consensus.cc:504] T 00000000000000000000000000000000 P b44539d028104d79a7fd51cfc6e31178 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b44539d028104d79a7fd51cfc6e31178" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 42631 } }
I20260808 04:43:39.688438 6197 leader_election.cc:302] T 00000000000000000000000000000000 P b44539d028104d79a7fd51cfc6e31178 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b44539d028104d79a7fd51cfc6e31178; no voters:
I20260808 04:43:39.688787 6197 leader_election.cc:288] T 00000000000000000000000000000000 P b44539d028104d79a7fd51cfc6e31178 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260808 04:43:39.688901 6202 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b44539d028104d79a7fd51cfc6e31178 [term 2 FOLLOWER]: Leader election won for term 2
I20260808 04:43:39.689113 6202 raft_consensus.cc:686] T 00000000000000000000000000000000 P b44539d028104d79a7fd51cfc6e31178 [term 2 LEADER]: Becoming Leader. State: Replica: b44539d028104d79a7fd51cfc6e31178, State: Running, Role: LEADER
I20260808 04:43:39.689599 6202 consensus_queue.cc:237] T 00000000000000000000000000000000 P b44539d028104d79a7fd51cfc6e31178 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b44539d028104d79a7fd51cfc6e31178" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 42631 } }
I20260808 04:43:39.690363 6197 sys_catalog.cc:564] T 00000000000000000000000000000000 P b44539d028104d79a7fd51cfc6e31178 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 04:43:39.691226 6204 sys_catalog.cc:455] T 00000000000000000000000000000000 P b44539d028104d79a7fd51cfc6e31178 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b44539d028104d79a7fd51cfc6e31178. Latest consensus state: current_term: 2 leader_uuid: "b44539d028104d79a7fd51cfc6e31178" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b44539d028104d79a7fd51cfc6e31178" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 42631 } } }
I20260808 04:43:39.691367 6204 sys_catalog.cc:458] T 00000000000000000000000000000000 P b44539d028104d79a7fd51cfc6e31178 [sys.catalog]: This master's current role is: LEADER
I20260808 04:43:39.691289 6203 sys_catalog.cc:455] T 00000000000000000000000000000000 P b44539d028104d79a7fd51cfc6e31178 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "b44539d028104d79a7fd51cfc6e31178" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b44539d028104d79a7fd51cfc6e31178" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 42631 } } }
I20260808 04:43:39.691439 6203 sys_catalog.cc:458] T 00000000000000000000000000000000 P b44539d028104d79a7fd51cfc6e31178 [sys.catalog]: This master's current role is: LEADER
I20260808 04:43:39.695679 6220 catalog_manager.cc:1259] Loaded cluster ID: 6430311a072e44229a99fe0e5e0650fd
I20260808 04:43:39.695781 6220 catalog_manager.cc:1552] T 00000000000000000000000000000000 P b44539d028104d79a7fd51cfc6e31178: loading cluster ID for follower catalog manager: success
I20260808 04:43:39.697772 6220 catalog_manager.cc:1574] T 00000000000000000000000000000000 P b44539d028104d79a7fd51cfc6e31178: acquiring CA information for follower catalog manager: success
I20260808 04:43:39.699097 6220 catalog_manager.cc:1602] T 00000000000000000000000000000000 P b44539d028104d79a7fd51cfc6e31178: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260808 04:43:39.699273 6211 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 04:43:39.701830 6211 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 04:43:39.702343 6211 catalog_manager.cc:1259] Loaded cluster ID: 6430311a072e44229a99fe0e5e0650fd
I20260808 04:43:39.702405 6211 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 04:43:39.703076 6211 catalog_manager.cc:1504] Loading token signing keys...
I20260808 04:43:39.703661 6211 catalog_manager.cc:5879] T 00000000000000000000000000000000 P b44539d028104d79a7fd51cfc6e31178: Loaded TSK: 0
I20260808 04:43:39.728361 6211 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b44539d028104d79a7fd51cfc6e31178: Generated new TSK 1
I20260808 04:43:39.728684 6211 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260808 04:43:39.785211 6200 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:43:39.785526 6200 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:43:39.785576 6200 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:43:39.790196 6200 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:43:39.790275 6200 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:43:39.790372 6200 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.240.193
I20260808 04:43:39.796340 6200 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.240.212:44813
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164000593138-21443-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164000593138-21443-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.193.keytab
--principal=kudu/127.20.240.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.240.193:33027
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164000593138-21443-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.240.193
--webserver_port=43429
--tserver_master_addrs=127.20.240.254:42631
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6200
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.240.193
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164000593138-21443-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 04:05:18 UTC on ccycloud.quasar-drfdgt.root.comops.site
build id 4574101
I20260808 04:43:39.797575 6200 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:43:39.798648 6200 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:43:39.808781 6228 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:43:39.808818 6229 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:43:39.808760 6231 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:43:39.809237 6200 server_base.cc:1034] running on GCE node
I20260808 04:43:39.809849 6200 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:43:39.810842 6200 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:43:39.812074 6200 hybrid_clock.cc:648] HybridClock initialized: now 1786164219812044 us; error 65 us; skew 500 ppm
Aug 08 04:43:39 dist-test-slave-vxj2 krb5kdc[5498](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164219, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.240.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:43:39.815984 6200 init.cc:377] Logged in from keytab as kudu/127.20.240.193@KRBTEST.COM (short username kudu)
I20260808 04:43:39.817474 6200 webserver.cc:460] Webserver started at http://127.20.240.193:43429/ using document root <none> and password file <none>
I20260808 04:43:39.818323 6200 fs_manager.cc:359] Metadata directory not provided
I20260808 04:43:39.818450 6200 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:43:39.824664 6200 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.006s sys 0.000s
I20260808 04:43:39.828284 6239 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:43:39.830070 6200 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.001s sys 0.002s
I20260808 04:43:39.830225 6200 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164000593138-21443-0/minicluster-data/ts-0/data,/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164000593138-21443-0/minicluster-data/ts-0/wal
uuid: "17256af032074b1b9b1276bc078bf23f"
format_stamp: "Formatted at 2026-08-08 04:43:18 on dist-test-slave-vxj2"
server_key: "1cd64b0a3773d4a699c528abe9253bbc"
server_key_iv: "4ac8f7095cd4f35373bf8799f6fe804f"
server_key_version: "encryptionkey@0"
I20260808 04:43:39.830979 6200 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164000593138-21443-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164000593138-21443-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164000593138-21443-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:43:39.858774 6200 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:43:39.862921 6200 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:43:39.863148 6200 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:43:39.863850 6200 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 04:43:39.865033 6247 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260808 04:43:39.871683 6200 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260808 04:43:39.871794 6200 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.007s user 0.000s sys 0.000s
I20260808 04:43:39.871870 6200 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260808 04:43:39.873884 6200 ts_tablet_manager.cc:610] Registered 1 tablets
I20260808 04:43:39.873975 6200 ts_tablet_manager.cc:589] Time spent register tablets: real 0.002s user 0.002s sys 0.000s
I20260808 04:43:39.874351 6247 tablet_bootstrap.cc:492] T e8f1780f709c414db06ecb51affd1c32 P 17256af032074b1b9b1276bc078bf23f: Bootstrap starting.
I20260808 04:43:39.882668 6200 rpc_server.cc:307] RPC server started. Bound to: 127.20.240.193:33027
I20260808 04:43:39.882728 6369 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.240.193:33027 every 8 connection(s)
I20260808 04:43:39.883848 6200 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164000593138-21443-0/minicluster-data/ts-0/data/info.pb
I20260808 04:43:39.892755 21443 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu as pid 6200
I20260808 04:43:39.893388 21443 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
/tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164000593138-21443-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164000593138-21443-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164000593138-21443-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164000593138-21443-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.240.194:45369
--local_ip_for_outbound_sockets=127.20.240.194
--tserver_master_addrs=127.20.240.254:42631
--webserver_port=40943
--webserver_interface=127.20.240.194
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.194.keytab
--principal=kudu/127.20.240.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.240.212:44813
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164000593138-21443-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164000593138-21443-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164000593138-21443-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 04:43:39.895750 6247 log.cc:824] T e8f1780f709c414db06ecb51affd1c32 P 17256af032074b1b9b1276bc078bf23f: Log is configured to *not* fsync() on all Append() calls
Aug 08 04:43:39 dist-test-slave-vxj2 krb5kdc[5498](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164219, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.240.193@KRBTEST.COM for kudu/127.20.240.254@KRBTEST.COM
I20260808 04:43:39.904919 6247 tablet_bootstrap.cc:492] T e8f1780f709c414db06ecb51affd1c32 P 17256af032074b1b9b1276bc078bf23f: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 04:43:39.905419 6247 tablet_bootstrap.cc:492] T e8f1780f709c414db06ecb51affd1c32 P 17256af032074b1b9b1276bc078bf23f: Bootstrap complete.
I20260808 04:43:39.906888 6247 ts_tablet_manager.cc:1397] T e8f1780f709c414db06ecb51affd1c32 P 17256af032074b1b9b1276bc078bf23f: Time spent bootstrapping tablet: real 0.033s user 0.023s sys 0.007s
I20260808 04:43:39.908951 6373 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:43:39.886145 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:42631 (local address 127.20.240.193:37355)
0808 04:43:39.887262 (+ 1117us) negotiation.cc:107] Waiting for socket to connect
0808 04:43:39.887306 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0808 04:43:39.888166 (+ 860us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:43:39.889398 (+ 1232us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:43:39.889406 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:43:39.889876 (+ 470us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:43:39.890499 (+ 623us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:43:39.890517 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:43:39.892217 (+ 1700us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:43:39.892220 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:43:39.893512 (+ 1292us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:43:39.893532 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:43:39.895034 (+ 1502us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:43:39.895040 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:43:39.895306 (+ 266us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:43:39.896118 (+ 812us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:43:39.896143 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:43:39.901850 (+ 5707us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:43:39.904886 (+ 3036us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:43:39.904896 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:43:39.904912 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:43:39.905535 (+ 623us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:43:39.906023 (+ 488us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:43:39.906026 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:43:39.906029 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:43:39.906211 (+ 182us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:43:39.907060 (+ 849us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:43:39.907068 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:43:39.907379 (+ 311us) client_negotiation.cc:769] Sending connection context
0808 04:43:39.907580 (+ 201us) client_negotiation.cc:240] Negotiation successful
0808 04:43:39.907940 (+ 360us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":913,"thread_start_us":160,"threads_started":1}
I20260808 04:43:39.909284 6372 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:43:39.886249 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.240.193:37355 (local address 127.20.240.254:42631)
0808 04:43:39.886690 (+ 441us) server_negotiation.cc:206] Beginning negotiation
0808 04:43:39.886710 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0808 04:43:39.887448 (+ 738us) server_negotiation.cc:407] Connection header received
0808 04:43:39.888616 (+ 1168us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:43:39.888626 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:43:39.888951 (+ 325us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:43:39.889330 (+ 379us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:43:39.890703 (+ 1373us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:43:39.892022 (+ 1319us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:43:39.893702 (+ 1680us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:43:39.894573 (+ 871us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:43:39.894773 (+ 200us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:43:39.902192 (+ 7419us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:43:39.902199 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:43:39.902216 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:43:39.902258 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:43:39.904704 (+ 2446us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:43:39.905693 (+ 989us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:43:39.905700 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:43:39.905705 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:43:39.905903 (+ 198us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:43:39.906338 (+ 435us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:43:39.906344 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:43:39.906349 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:43:39.906879 (+ 530us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:43:39.907074 (+ 195us) server_negotiation.cc:1035] Waiting for connection context
0808 04:43:39.907751 (+ 677us) server_negotiation.cc:299] Negotiation successful
0808 04:43:39.908080 (+ 329us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":281,"thread_start_us":143,"threads_started":1}
I20260808 04:43:39.910090 6247 raft_consensus.cc:348] T e8f1780f709c414db06ecb51affd1c32 P 17256af032074b1b9b1276bc078bf23f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9f60f08a7dc4fbda63770a3b26a861e" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 45369 } } peers { permanent_uuid: "17256af032074b1b9b1276bc078bf23f" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 33027 } } peers { permanent_uuid: "d5d9247b9d6e4516ab91bbbdec1c2fb1" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 38511 } }
I20260808 04:43:39.910502 6247 raft_consensus.cc:729] T e8f1780f709c414db06ecb51affd1c32 P 17256af032074b1b9b1276bc078bf23f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17256af032074b1b9b1276bc078bf23f, State: Initialized, Role: FOLLOWER
I20260808 04:43:39.911015 6247 consensus_queue.cc:260] T e8f1780f709c414db06ecb51affd1c32 P 17256af032074b1b9b1276bc078bf23f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9f60f08a7dc4fbda63770a3b26a861e" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 45369 } } peers { permanent_uuid: "17256af032074b1b9b1276bc078bf23f" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 33027 } } peers { permanent_uuid: "d5d9247b9d6e4516ab91bbbdec1c2fb1" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 38511 } }
I20260808 04:43:39.912045 6247 ts_tablet_manager.cc:1428] T e8f1780f709c414db06ecb51affd1c32 P 17256af032074b1b9b1276bc078bf23f: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20260808 04:43:39.912197 6370 heartbeater.cc:347] Connected to a master server at 127.20.240.254:42631
I20260808 04:43:39.912427 6370 heartbeater.cc:464] Registering TS with master...
I20260808 04:43:39.912967 6370 heartbeater.cc:511] Master 127.20.240.254:42631 requested a full tablet report, sending...
I20260808 04:43:39.915596 6156 ts_manager.cc:194] Registered new tserver with Master: 17256af032074b1b9b1276bc078bf23f (127.20.240.193:33027)
I20260808 04:43:39.919610 6156 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.240.193@KRBTEST.COM'} at 127.20.240.193:37355
I20260808 04:43:39.922482 6370 heartbeater.cc:503] Master 127.20.240.254:42631 was elected leader, sending a full tablet report...
Aug 08 04:43:39 dist-test-slave-vxj2 krb5kdc[5498](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164219, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.240.254@KRBTEST.COM for kudu/127.20.240.193@KRBTEST.COM
I20260808 04:43:39.930925 6378 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:43:39.918844 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.193:33027 (local address 127.0.0.1:40802)
0808 04:43:39.919507 (+ 663us) negotiation.cc:107] Waiting for socket to connect
0808 04:43:39.919564 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0808 04:43:39.919708 (+ 144us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:43:39.920742 (+ 1034us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:43:39.920747 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:43:39.921090 (+ 343us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:43:39.921292 (+ 202us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:43:39.921300 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:43:39.922294 (+ 994us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:43:39.922299 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:43:39.923132 (+ 833us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:43:39.923143 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:43:39.923908 (+ 765us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:43:39.923912 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:43:39.924024 (+ 112us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:43:39.924737 (+ 713us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:43:39.924749 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:43:39.926437 (+ 1688us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:43:39.929006 (+ 2569us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:43:39.929021 (+ 15us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:43:39.929036 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:43:39.929326 (+ 290us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:43:39.929656 (+ 330us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:43:39.929659 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:43:39.929660 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:43:39.929748 (+ 88us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:43:39.930340 (+ 592us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:43:39.930345 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:43:39.930483 (+ 138us) client_negotiation.cc:769] Sending connection context
0808 04:43:39.930598 (+ 115us) client_negotiation.cc:240] Negotiation successful
0808 04:43:39.930778 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":460,"thread_start_us":125,"threads_started":1}
I20260808 04:43:39.931104 6379 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:43:39.918950 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40802 (local address 127.20.240.193:33027)
0808 04:43:39.919998 (+ 1048us) server_negotiation.cc:206] Beginning negotiation
0808 04:43:39.920010 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 04:43:39.920034 (+ 24us) server_negotiation.cc:407] Connection header received
0808 04:43:39.920110 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:43:39.920115 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:43:39.920312 (+ 197us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:43:39.920472 (+ 160us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:43:39.921426 (+ 954us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:43:39.922168 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:43:39.923254 (+ 1086us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:43:39.923760 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:43:39.923875 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:43:39.926652 (+ 2777us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:43:39.926663 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:43:39.926678 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:43:39.926710 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:43:39.928762 (+ 2052us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:43:39.929443 (+ 681us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:43:39.929451 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:43:39.929453 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:43:39.929555 (+ 102us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:43:39.929855 (+ 300us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:43:39.929858 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:43:39.929860 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:43:39.930203 (+ 343us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:43:39.930343 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0808 04:43:39.930733 (+ 390us) server_negotiation.cc:299] Negotiation successful
0808 04:43:39.930923 (+ 190us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":944,"thread_start_us":115,"threads_started":1}
I20260808 04:43:39.932197 6294 tablet_service.cc:1514] Processing DeleteTablet for tablet e8f1780f709c414db06ecb51affd1c32 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 04:43:19 UTC) from {username='kudu', principal='kudu/127.20.240.254@KRBTEST.COM'} at 127.0.0.1:40802
I20260808 04:43:39.933090 6380 tablet_replica.cc:330] stopping tablet replica
I20260808 04:43:39.933454 6380 raft_consensus.cc:2229] T e8f1780f709c414db06ecb51affd1c32 P 17256af032074b1b9b1276bc078bf23f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 04:43:39.933720 6380 raft_consensus.cc:2258] T e8f1780f709c414db06ecb51affd1c32 P 17256af032074b1b9b1276bc078bf23f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 04:43:39.934764 6380 ts_tablet_manager.cc:1905] T e8f1780f709c414db06ecb51affd1c32 P 17256af032074b1b9b1276bc078bf23f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 04:43:39.938951 6380 ts_tablet_manager.cc:1918] T e8f1780f709c414db06ecb51affd1c32 P 17256af032074b1b9b1276bc078bf23f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 04:43:39.939131 6380 log.cc:1196] T e8f1780f709c414db06ecb51affd1c32 P 17256af032074b1b9b1276bc078bf23f: Deleting WAL directory at /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164000593138-21443-0/minicluster-data/ts-0/wal/wals/e8f1780f709c414db06ecb51affd1c32
I20260808 04:43:39.939419 6380 ts_tablet_manager.cc:1939] T e8f1780f709c414db06ecb51affd1c32 P 17256af032074b1b9b1276bc078bf23f: Deleting consensus metadata
I20260808 04:43:39.941398 6138 catalog_manager.cc:4841] TS 17256af032074b1b9b1276bc078bf23f (127.20.240.193:33027): tablet e8f1780f709c414db06ecb51affd1c32 (table test-table [id=d30f7bdc37b0428fa8748dbeccd12b4d]) successfully deleted
W20260808 04:43:40.024086 6374 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:43:40.024434 6374 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:43:40.024484 6374 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:43:40.029448 6374 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:43:40.029553 6374 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:43:40.029624 6374 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.240.194
I20260808 04:43:40.035943 6374 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.240.212:44813
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164000593138-21443-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164000593138-21443-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.194.keytab
--principal=kudu/127.20.240.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.240.194:45369
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164000593138-21443-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.240.194
--webserver_port=40943
--tserver_master_addrs=127.20.240.254:42631
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6374
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.240.194
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164000593138-21443-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 04:05:18 UTC on ccycloud.quasar-drfdgt.root.comops.site
build id 4574101
I20260808 04:43:40.037309 6374 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:43:40.038542 6374 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260808 04:43:40.049577 6374 server_base.cc:1034] running on GCE node
W20260808 04:43:40.049528 6389 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:43:40.049528 6387 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:43:40.049530 6386 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:43:40.050379 6374 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:43:40.051158 6374 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:43:40.052377 6374 hybrid_clock.cc:648] HybridClock initialized: now 1786164220052357 us; error 38 us; skew 500 ppm
Aug 08 04:43:40 dist-test-slave-vxj2 krb5kdc[5498](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164220, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.240.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:43:40.055580 6374 init.cc:377] Logged in from keytab as kudu/127.20.240.194@KRBTEST.COM (short username kudu)
I20260808 04:43:40.056720 6374 webserver.cc:460] Webserver started at http://127.20.240.194:40943/ using document root <none> and password file <none>
I20260808 04:43:40.057603 6374 fs_manager.cc:359] Metadata directory not provided
I20260808 04:43:40.057756 6374 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:43:40.062444 6374 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.001s
I20260808 04:43:40.064968 6399 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:43:40.066558 6374 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260808 04:43:40.066740 6374 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164000593138-21443-0/minicluster-data/ts-1/data,/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164000593138-21443-0/minicluster-data/ts-1/wal
uuid: "f9f60f08a7dc4fbda63770a3b26a861e"
format_stamp: "Formatted at 2026-08-08 04:43:18 on dist-test-slave-vxj2"
server_key: "3e7999911ff6797d78b5e8fd1673438e"
server_key_iv: "97b7ec248c2a07b63d6196f5d324536e"
server_key_version: "encryptionkey@0"
I20260808 04:43:40.067373 6374 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164000593138-21443-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164000593138-21443-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164000593138-21443-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:43:40.082794 6374 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:43:40.086352 6374 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:43:40.086616 6374 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:43:40.087276 6374 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 04:43:40.088171 6374 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 04:43:40.088253 6374 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 04:43:40.088336 6374 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 04:43:40.088392 6374 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 04:43:40.098882 6374 rpc_server.cc:307] RPC server started. Bound to: 127.20.240.194:45369
I20260808 04:43:40.098924 6529 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.240.194:45369 every 8 connection(s)
I20260808 04:43:40.100026 6374 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164000593138-21443-0/minicluster-data/ts-1/data/info.pb
I20260808 04:43:40.102576 21443 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu as pid 6374
I20260808 04:43:40.103107 21443 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
/tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164000593138-21443-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164000593138-21443-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164000593138-21443-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164000593138-21443-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.240.195:38511
--local_ip_for_outbound_sockets=127.20.240.195
--tserver_master_addrs=127.20.240.254:42631
--webserver_port=36523
--webserver_interface=127.20.240.195
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.195.keytab
--principal=kudu/127.20.240.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.240.212:44813
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164000593138-21443-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164000593138-21443-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164000593138-21443-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 08 04:43:40 dist-test-slave-vxj2 krb5kdc[5498](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164220, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.240.194@KRBTEST.COM for kudu/127.20.240.254@KRBTEST.COM
I20260808 04:43:40.117544 6372 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:43:40.102297 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.240.194:49759 (local address 127.20.240.254:42631)
0808 04:43:40.102458 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0808 04:43:40.102462 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:43:40.104264 (+ 1802us) server_negotiation.cc:407] Connection header received
0808 04:43:40.105325 (+ 1061us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:43:40.105329 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:43:40.105398 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:43:40.105532 (+ 134us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:43:40.107148 (+ 1616us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:43:40.108078 (+ 930us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:43:40.109463 (+ 1385us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:43:40.109948 (+ 485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:43:40.110100 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:43:40.112867 (+ 2767us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:43:40.112873 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:43:40.112878 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:43:40.112919 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:43:40.115042 (+ 2123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:43:40.115646 (+ 604us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:43:40.115654 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:43:40.115657 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:43:40.115766 (+ 109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:43:40.116141 (+ 375us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:43:40.116144 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:43:40.116146 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:43:40.116398 (+ 252us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:43:40.116504 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0808 04:43:40.117129 (+ 625us) server_negotiation.cc:299] Negotiation successful
0808 04:43:40.117334 (+ 205us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260808 04:43:40.118585 6533 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:43:40.102821 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:42631 (local address 127.20.240.194:49759)
0808 04:43:40.104076 (+ 1255us) negotiation.cc:107] Waiting for socket to connect
0808 04:43:40.104125 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0808 04:43:40.105043 (+ 918us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:43:40.105777 (+ 734us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:43:40.105789 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:43:40.106353 (+ 564us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:43:40.106962 (+ 609us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:43:40.106976 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:43:40.108275 (+ 1299us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:43:40.108278 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:43:40.109295 (+ 1017us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:43:40.109306 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:43:40.110153 (+ 847us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:43:40.110157 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:43:40.110339 (+ 182us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:43:40.111053 (+ 714us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:43:40.111089 (+ 36us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:43:40.112661 (+ 1572us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:43:40.115188 (+ 2527us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:43:40.115194 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:43:40.115208 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:43:40.115518 (+ 310us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:43:40.115882 (+ 364us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:43:40.115884 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:43:40.115886 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:43:40.116042 (+ 156us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:43:40.116511 (+ 469us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:43:40.116517 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:43:40.116855 (+ 338us) client_negotiation.cc:769] Sending connection context
0808 04:43:40.117057 (+ 202us) client_negotiation.cc:240] Negotiation successful
0808 04:43:40.117427 (+ 370us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1015,"thread_start_us":799,"threads_started":1}
I20260808 04:43:40.119859 6530 heartbeater.cc:347] Connected to a master server at 127.20.240.254:42631
I20260808 04:43:40.120134 6530 heartbeater.cc:464] Registering TS with master...
I20260808 04:43:40.120725 6530 heartbeater.cc:511] Master 127.20.240.254:42631 requested a full tablet report, sending...
I20260808 04:43:40.121968 6156 ts_manager.cc:194] Registered new tserver with Master: f9f60f08a7dc4fbda63770a3b26a861e (127.20.240.194:45369)
I20260808 04:43:40.122603 6156 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.240.194@KRBTEST.COM'} at 127.20.240.194:49759
W20260808 04:43:40.228106 6534 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:43:40.228422 6534 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:43:40.228480 6534 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:43:40.232997 6534 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:43:40.233081 6534 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:43:40.233223 6534 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.240.195
I20260808 04:43:40.239135 6534 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.240.212:44813
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164000593138-21443-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164000593138-21443-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.195.keytab
--principal=kudu/127.20.240.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.240.195:38511
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164000593138-21443-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.240.195
--webserver_port=36523
--tserver_master_addrs=127.20.240.254:42631
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6534
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.240.195
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164000593138-21443-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 04:05:18 UTC on ccycloud.quasar-drfdgt.root.comops.site
build id 4574101
I20260808 04:43:40.240370 6534 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:43:40.241542 6534 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:43:40.251969 6539 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:43:40.251969 6540 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:43:40.251986 6542 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:43:40.252358 6534 server_base.cc:1034] running on GCE node
I20260808 04:43:40.252810 6534 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:43:40.253587 6534 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:43:40.254781 6534 hybrid_clock.cc:648] HybridClock initialized: now 1786164220254764 us; error 30 us; skew 500 ppm
Aug 08 04:43:40 dist-test-slave-vxj2 krb5kdc[5498](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164220, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.240.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:43:40.257802 6534 init.cc:377] Logged in from keytab as kudu/127.20.240.195@KRBTEST.COM (short username kudu)
I20260808 04:43:40.258750 6534 webserver.cc:460] Webserver started at http://127.20.240.195:36523/ using document root <none> and password file <none>
I20260808 04:43:40.259343 6534 fs_manager.cc:359] Metadata directory not provided
I20260808 04:43:40.259428 6534 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:43:40.263490 6534 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260808 04:43:40.265784 6550 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:43:40.267096 6534 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 04:43:40.267256 6534 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164000593138-21443-0/minicluster-data/ts-2/data,/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164000593138-21443-0/minicluster-data/ts-2/wal
uuid: "d5d9247b9d6e4516ab91bbbdec1c2fb1"
format_stamp: "Formatted at 2026-08-08 04:43:18 on dist-test-slave-vxj2"
server_key: "494584af004e89751c8790b8dc9b386c"
server_key_iv: "c8cb85ce9fae9f0602225a06d2962c6f"
server_key_version: "encryptionkey@0"
I20260808 04:43:40.267858 6534 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164000593138-21443-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164000593138-21443-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164000593138-21443-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:43:40.284124 6534 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:43:40.287566 6534 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:43:40.287809 6534 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:43:40.288458 6534 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 04:43:40.289381 6534 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 04:43:40.289469 6534 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 04:43:40.289561 6534 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 04:43:40.289613 6534 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 04:43:40.299362 6534 rpc_server.cc:307] RPC server started. Bound to: 127.20.240.195:38511
I20260808 04:43:40.299379 6679 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.240.195:38511 every 8 connection(s)
I20260808 04:43:40.300483 6534 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164000593138-21443-0/minicluster-data/ts-2/data/info.pb
I20260808 04:43:40.301954 21443 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu as pid 6534
Aug 08 04:43:40 dist-test-slave-vxj2 krb5kdc[5498](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164220, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.240.195@KRBTEST.COM for kudu/127.20.240.254@KRBTEST.COM
I20260808 04:43:40.312642 6372 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:43:40.302777 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54406 (local address 127.20.240.254:42631)
0808 04:43:40.302964 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0808 04:43:40.302969 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 04:43:40.303394 (+ 425us) server_negotiation.cc:407] Connection header received
0808 04:43:40.303590 (+ 196us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:43:40.303594 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:43:40.303650 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:43:40.303750 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:43:40.304677 (+ 927us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:43:40.305580 (+ 903us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:43:40.306641 (+ 1061us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:43:40.306979 (+ 338us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:43:40.307094 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:43:40.308641 (+ 1547us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:43:40.308645 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:43:40.308648 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:43:40.308676 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:43:40.310516 (+ 1840us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:43:40.311201 (+ 685us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:43:40.311207 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:43:40.311211 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:43:40.311300 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:43:40.311636 (+ 336us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:43:40.311641 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:43:40.311643 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:43:40.311894 (+ 251us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:43:40.312064 (+ 170us) server_negotiation.cc:1035] Waiting for connection context
0808 04:43:40.312370 (+ 306us) server_negotiation.cc:299] Negotiation successful
0808 04:43:40.312482 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260808 04:43:40.317351 6684 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:43:40.302957 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.240.195:59147 (local address 127.20.240.254:42631)
0808 04:43:40.303157 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0808 04:43:40.303160 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 04:43:40.303965 (+ 805us) server_negotiation.cc:407] Connection header received
0808 04:43:40.305748 (+ 1783us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:43:40.305752 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:43:40.305814 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:43:40.305922 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:43:40.307301 (+ 1379us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:43:40.308054 (+ 753us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:43:40.309702 (+ 1648us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:43:40.310012 (+ 310us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:43:40.310114 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:43:40.313580 (+ 3466us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:43:40.313584 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:43:40.313586 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:43:40.313613 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:43:40.315188 (+ 1575us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:43:40.315734 (+ 546us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:43:40.315736 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:43:40.315737 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:43:40.315811 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:43:40.316195 (+ 384us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:43:40.316198 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:43:40.316199 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:43:40.316357 (+ 158us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:43:40.316431 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0808 04:43:40.317039 (+ 608us) server_negotiation.cc:299] Negotiation successful
0808 04:43:40.317141 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":151,"thread_start_us":73,"threads_started":1}
I20260808 04:43:40.318284 6685 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:43:40.303205 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:42631 (local address 127.20.240.195:59147)
0808 04:43:40.303803 (+ 598us) negotiation.cc:107] Waiting for socket to connect
0808 04:43:40.303870 (+ 67us) client_negotiation.cc:174] Beginning negotiation
0808 04:43:40.305463 (+ 1593us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:43:40.306062 (+ 599us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:43:40.306069 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:43:40.306441 (+ 372us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:43:40.307125 (+ 684us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:43:40.307146 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:43:40.308195 (+ 1049us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:43:40.308198 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:43:40.309561 (+ 1363us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:43:40.309578 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:43:40.310186 (+ 608us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:43:40.310191 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:43:40.310426 (+ 235us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:43:40.311079 (+ 653us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:43:40.311097 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:43:40.313397 (+ 2300us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:43:40.315321 (+ 1924us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:43:40.315326 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:43:40.315341 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:43:40.315628 (+ 287us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:43:40.315921 (+ 293us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:43:40.315923 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:43:40.315925 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:43:40.316085 (+ 160us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:43:40.316477 (+ 392us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:43:40.316482 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:43:40.316755 (+ 273us) client_negotiation.cc:769] Sending connection context
0808 04:43:40.316939 (+ 184us) client_negotiation.cc:240] Negotiation successful
0808 04:43:40.317388 (+ 449us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":353,"thread_start_us":155,"threads_started":1}
I20260808 04:43:40.319356 6681 heartbeater.cc:347] Connected to a master server at 127.20.240.254:42631
I20260808 04:43:40.319587 6681 heartbeater.cc:464] Registering TS with master...
I20260808 04:43:40.320060 6681 heartbeater.cc:511] Master 127.20.240.254:42631 requested a full tablet report, sending...
I20260808 04:43:40.321038 6156 ts_manager.cc:194] Registered new tserver with Master: d5d9247b9d6e4516ab91bbbdec1c2fb1 (127.20.240.195:38511)
I20260808 04:43:40.321627 6156 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.240.195@KRBTEST.COM'} at 127.20.240.195:59147
I20260808 04:43:40.327024 21443 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 04:43:40.331178 6684 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:43:40.327726 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54422 (local address 127.20.240.254:42631)
0808 04:43:40.327879 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0808 04:43:40.327884 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 04:43:40.328037 (+ 153us) server_negotiation.cc:407] Connection header received
0808 04:43:40.328184 (+ 147us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:43:40.328186 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:43:40.328291 (+ 105us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:43:40.328375 (+ 84us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 04:43:40.328583 (+ 208us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:43:40.329084 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:43:40.330125 (+ 1041us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:43:40.330352 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:43:40.330439 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:43:40.330701 (+ 262us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 04:43:40.330837 (+ 136us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_AUTHENTICATION_TOKEN: Not authorized: token expired
0808 04:43:40.331049 (+ 212us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:54422: token expired
Metrics: {"server-negotiator.queue_time_us":63}
W20260808 04:43:40.331236 6684 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:54422: token expired
W20260808 04:43:40.331707 6078 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.20.240.254:42631)
I20260808 04:43:40.338999 6684 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:43:40.332146 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54424 (local address 127.20.240.254:42631)
0808 04:43:40.332261 (+ 115us) server_negotiation.cc:206] Beginning negotiation
0808 04:43:40.332264 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 04:43:40.332293 (+ 29us) server_negotiation.cc:407] Connection header received
0808 04:43:40.332383 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:43:40.332385 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:43:40.332421 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:43:40.332486 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:43:40.333111 (+ 625us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:43:40.333644 (+ 533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:43:40.334407 (+ 763us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:43:40.334609 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:43:40.334678 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:43:40.336064 (+ 1386us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:43:40.336066 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:43:40.336068 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:43:40.336086 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:43:40.337586 (+ 1500us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:43:40.337973 (+ 387us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:43:40.337975 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:43:40.337977 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:43:40.338048 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:43:40.338274 (+ 226us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:43:40.338276 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:43:40.338277 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:43:40.338428 (+ 151us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:43:40.338537 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0808 04:43:40.338745 (+ 208us) server_negotiation.cc:299] Negotiation successful
0808 04:43:40.338837 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260808 04:43:40.341524 6156 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54424:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 04:43:40.344772 6156 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 04:43:40.352893 6294 tablet_service.cc:1467] Processing CreateTablet for tablet 93c519eef7294f839c78331838b51f8e (DEFAULT_TABLE table=test-table [id=8256b217a7794a65b43621315c9bed1c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 04:43:40.353636 6294 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 93c519eef7294f839c78331838b51f8e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:43:40.356866 6247 tablet_bootstrap.cc:492] T 93c519eef7294f839c78331838b51f8e P 17256af032074b1b9b1276bc078bf23f: Bootstrap starting.
I20260808 04:43:40.357970 6247 tablet_bootstrap.cc:654] T 93c519eef7294f839c78331838b51f8e P 17256af032074b1b9b1276bc078bf23f: Neither blocks nor log segments found. Creating new log.
I20260808 04:43:40.358091 6378 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:43:40.351871 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.194:45369 (local address 127.0.0.1:45786)
0808 04:43:40.352475 (+ 604us) negotiation.cc:107] Waiting for socket to connect
0808 04:43:40.352491 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 04:43:40.352573 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:43:40.353373 (+ 800us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:43:40.353376 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:43:40.353394 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 04:43:40.353499 (+ 105us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:43:40.353508 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:43:40.354946 (+ 1438us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:43:40.354950 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:43:40.356236 (+ 1286us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:43:40.356248 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:43:40.357529 (+ 1281us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:43:40.357532 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:43:40.357645 (+ 113us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:43:40.357732 (+ 87us) client_negotiation.cc:769] Sending connection context
0808 04:43:40.357785 (+ 53us) client_negotiation.cc:240] Negotiation successful
0808 04:43:40.357945 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":521,"mutex_wait_us":53}
I20260808 04:43:40.358238 6695 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:43:40.352334 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59570 (local address 127.20.240.195:38511)
0808 04:43:40.352828 (+ 494us) server_negotiation.cc:206] Beginning negotiation
0808 04:43:40.352841 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0808 04:43:40.352865 (+ 24us) server_negotiation.cc:407] Connection header received
0808 04:43:40.352959 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:43:40.352964 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:43:40.353200 (+ 236us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:43:40.353371 (+ 171us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 04:43:40.353845 (+ 474us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:43:40.355083 (+ 1238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:43:40.356303 (+ 1220us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:43:40.357050 (+ 747us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:43:40.357196 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:43:40.357366 (+ 170us) server_negotiation.cc:1035] Waiting for connection context
0808 04:43:40.357946 (+ 580us) server_negotiation.cc:299] Negotiation successful
0808 04:43:40.358078 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":394,"thread_start_us":102,"threads_started":1}
I20260808 04:43:40.358520 6693 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:43:40.352149 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.195:38511 (local address 127.0.0.1:59570)
0808 04:43:40.352563 (+ 414us) negotiation.cc:107] Waiting for socket to connect
0808 04:43:40.352578 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 04:43:40.352666 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:43:40.353580 (+ 914us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:43:40.353584 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:43:40.353606 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 04:43:40.353702 (+ 96us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:43:40.353709 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:43:40.355299 (+ 1590us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:43:40.355306 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:43:40.356168 (+ 862us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:43:40.356178 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:43:40.357442 (+ 1264us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:43:40.357446 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:43:40.357736 (+ 290us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:43:40.357762 (+ 26us) client_negotiation.cc:769] Sending connection context
0808 04:43:40.357839 (+ 77us) client_negotiation.cc:240] Negotiation successful
0808 04:43:40.358399 (+ 560us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":346,"mutex_wait_us":69,"thread_start_us":113,"threads_started":1}
I20260808 04:43:40.359015 6692 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:43:40.352024 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45786 (local address 127.20.240.194:45369)
0808 04:43:40.352828 (+ 804us) server_negotiation.cc:206] Beginning negotiation
0808 04:43:40.352841 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0808 04:43:40.352865 (+ 24us) server_negotiation.cc:407] Connection header received
0808 04:43:40.352947 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:43:40.352952 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:43:40.353206 (+ 254us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:43:40.353371 (+ 165us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 04:43:40.353626 (+ 255us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:43:40.354827 (+ 1201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:43:40.356392 (+ 1565us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:43:40.357355 (+ 963us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:43:40.357977 (+ 622us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:43:40.358530 (+ 553us) server_negotiation.cc:1035] Waiting for connection context
0808 04:43:40.358749 (+ 219us) server_negotiation.cc:299] Negotiation successful
0808 04:43:40.358872 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":701,"thread_start_us":145,"threads_started":1}
I20260808 04:43:40.359622 6247 tablet_bootstrap.cc:492] T 93c519eef7294f839c78331838b51f8e P 17256af032074b1b9b1276bc078bf23f: No bootstrap required, opened a new log
I20260808 04:43:40.359723 6247 ts_tablet_manager.cc:1397] T 93c519eef7294f839c78331838b51f8e P 17256af032074b1b9b1276bc078bf23f: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260808 04:43:40.360188 6247 raft_consensus.cc:348] T 93c519eef7294f839c78331838b51f8e P 17256af032074b1b9b1276bc078bf23f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9f60f08a7dc4fbda63770a3b26a861e" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 45369 } } peers { permanent_uuid: "d5d9247b9d6e4516ab91bbbdec1c2fb1" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 38511 } } peers { permanent_uuid: "17256af032074b1b9b1276bc078bf23f" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 33027 } }
I20260808 04:43:40.360323 6247 raft_consensus.cc:374] T 93c519eef7294f839c78331838b51f8e P 17256af032074b1b9b1276bc078bf23f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:43:40.360363 6247 raft_consensus.cc:729] T 93c519eef7294f839c78331838b51f8e P 17256af032074b1b9b1276bc078bf23f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17256af032074b1b9b1276bc078bf23f, State: Initialized, Role: FOLLOWER
I20260808 04:43:40.360531 6247 consensus_queue.cc:260] T 93c519eef7294f839c78331838b51f8e P 17256af032074b1b9b1276bc078bf23f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9f60f08a7dc4fbda63770a3b26a861e" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 45369 } } peers { permanent_uuid: "d5d9247b9d6e4516ab91bbbdec1c2fb1" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 38511 } } peers { permanent_uuid: "17256af032074b1b9b1276bc078bf23f" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 33027 } }
I20260808 04:43:40.360797 6247 ts_tablet_manager.cc:1428] T 93c519eef7294f839c78331838b51f8e P 17256af032074b1b9b1276bc078bf23f: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260808 04:43:40.361891 6452 tablet_service.cc:1467] Processing CreateTablet for tablet 93c519eef7294f839c78331838b51f8e (DEFAULT_TABLE table=test-table [id=8256b217a7794a65b43621315c9bed1c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 04:43:40.362040 6606 tablet_service.cc:1467] Processing CreateTablet for tablet 93c519eef7294f839c78331838b51f8e (DEFAULT_TABLE table=test-table [id=8256b217a7794a65b43621315c9bed1c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 04:43:40.362960 6452 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 93c519eef7294f839c78331838b51f8e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:43:40.363122 6606 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 93c519eef7294f839c78331838b51f8e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:43:40.370414 6697 tablet_bootstrap.cc:492] T 93c519eef7294f839c78331838b51f8e P f9f60f08a7dc4fbda63770a3b26a861e: Bootstrap starting.
I20260808 04:43:40.370404 6698 tablet_bootstrap.cc:492] T 93c519eef7294f839c78331838b51f8e P d5d9247b9d6e4516ab91bbbdec1c2fb1: Bootstrap starting.
I20260808 04:43:40.372874 6698 tablet_bootstrap.cc:654] T 93c519eef7294f839c78331838b51f8e P d5d9247b9d6e4516ab91bbbdec1c2fb1: Neither blocks nor log segments found. Creating new log.
I20260808 04:43:40.373384 6697 tablet_bootstrap.cc:654] T 93c519eef7294f839c78331838b51f8e P f9f60f08a7dc4fbda63770a3b26a861e: Neither blocks nor log segments found. Creating new log.
I20260808 04:43:40.374260 6697 log.cc:824] T 93c519eef7294f839c78331838b51f8e P f9f60f08a7dc4fbda63770a3b26a861e: Log is configured to *not* fsync() on all Append() calls
I20260808 04:43:40.374264 6698 log.cc:824] T 93c519eef7294f839c78331838b51f8e P d5d9247b9d6e4516ab91bbbdec1c2fb1: Log is configured to *not* fsync() on all Append() calls
I20260808 04:43:40.376258 6697 tablet_bootstrap.cc:492] T 93c519eef7294f839c78331838b51f8e P f9f60f08a7dc4fbda63770a3b26a861e: No bootstrap required, opened a new log
I20260808 04:43:40.376276 6698 tablet_bootstrap.cc:492] T 93c519eef7294f839c78331838b51f8e P d5d9247b9d6e4516ab91bbbdec1c2fb1: No bootstrap required, opened a new log
I20260808 04:43:40.376484 6697 ts_tablet_manager.cc:1397] T 93c519eef7294f839c78331838b51f8e P f9f60f08a7dc4fbda63770a3b26a861e: Time spent bootstrapping tablet: real 0.006s user 0.001s sys 0.004s
I20260808 04:43:40.376497 6698 ts_tablet_manager.cc:1397] T 93c519eef7294f839c78331838b51f8e P d5d9247b9d6e4516ab91bbbdec1c2fb1: Time spent bootstrapping tablet: real 0.006s user 0.001s sys 0.004s
I20260808 04:43:40.379527 6698 raft_consensus.cc:348] T 93c519eef7294f839c78331838b51f8e P d5d9247b9d6e4516ab91bbbdec1c2fb1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9f60f08a7dc4fbda63770a3b26a861e" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 45369 } } peers { permanent_uuid: "d5d9247b9d6e4516ab91bbbdec1c2fb1" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 38511 } } peers { permanent_uuid: "17256af032074b1b9b1276bc078bf23f" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 33027 } }
I20260808 04:43:40.379518 6697 raft_consensus.cc:348] T 93c519eef7294f839c78331838b51f8e P f9f60f08a7dc4fbda63770a3b26a861e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9f60f08a7dc4fbda63770a3b26a861e" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 45369 } } peers { permanent_uuid: "d5d9247b9d6e4516ab91bbbdec1c2fb1" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 38511 } } peers { permanent_uuid: "17256af032074b1b9b1276bc078bf23f" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 33027 } }
I20260808 04:43:40.379823 6698 raft_consensus.cc:374] T 93c519eef7294f839c78331838b51f8e P d5d9247b9d6e4516ab91bbbdec1c2fb1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:43:40.379817 6697 raft_consensus.cc:374] T 93c519eef7294f839c78331838b51f8e P f9f60f08a7dc4fbda63770a3b26a861e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:43:40.379880 6697 raft_consensus.cc:729] T 93c519eef7294f839c78331838b51f8e P f9f60f08a7dc4fbda63770a3b26a861e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f9f60f08a7dc4fbda63770a3b26a861e, State: Initialized, Role: FOLLOWER
I20260808 04:43:40.379880 6698 raft_consensus.cc:729] T 93c519eef7294f839c78331838b51f8e P d5d9247b9d6e4516ab91bbbdec1c2fb1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d5d9247b9d6e4516ab91bbbdec1c2fb1, State: Initialized, Role: FOLLOWER
I20260808 04:43:40.380360 6697 consensus_queue.cc:260] T 93c519eef7294f839c78331838b51f8e P f9f60f08a7dc4fbda63770a3b26a861e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9f60f08a7dc4fbda63770a3b26a861e" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 45369 } } peers { permanent_uuid: "d5d9247b9d6e4516ab91bbbdec1c2fb1" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 38511 } } peers { permanent_uuid: "17256af032074b1b9b1276bc078bf23f" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 33027 } }
I20260808 04:43:40.380360 6698 consensus_queue.cc:260] T 93c519eef7294f839c78331838b51f8e P d5d9247b9d6e4516ab91bbbdec1c2fb1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9f60f08a7dc4fbda63770a3b26a861e" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 45369 } } peers { permanent_uuid: "d5d9247b9d6e4516ab91bbbdec1c2fb1" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 38511 } } peers { permanent_uuid: "17256af032074b1b9b1276bc078bf23f" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 33027 } }
I20260808 04:43:40.381110 6681 heartbeater.cc:503] Master 127.20.240.254:42631 was elected leader, sending a full tablet report...
I20260808 04:43:40.381433 6698 ts_tablet_manager.cc:1428] T 93c519eef7294f839c78331838b51f8e P d5d9247b9d6e4516ab91bbbdec1c2fb1: Time spent starting tablet: real 0.005s user 0.005s sys 0.001s
I20260808 04:43:40.381457 6697 ts_tablet_manager.cc:1428] T 93c519eef7294f839c78331838b51f8e P f9f60f08a7dc4fbda63770a3b26a861e: Time spent starting tablet: real 0.005s user 0.005s sys 0.001s
I20260808 04:43:40.381771 6530 heartbeater.cc:503] Master 127.20.240.254:42631 was elected leader, sending a full tablet report...
W20260808 04:43:40.385221 6371 tablet.cc:2369] T 93c519eef7294f839c78331838b51f8e P 17256af032074b1b9b1276bc078bf23f: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 04:43:40.551632 6682 tablet.cc:2369] T 93c519eef7294f839c78331838b51f8e P d5d9247b9d6e4516ab91bbbdec1c2fb1: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 04:43:40.579312 6701 raft_consensus.cc:482] T 93c519eef7294f839c78331838b51f8e P f9f60f08a7dc4fbda63770a3b26a861e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 04:43:40.579595 6701 raft_consensus.cc:504] T 93c519eef7294f839c78331838b51f8e P f9f60f08a7dc4fbda63770a3b26a861e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9f60f08a7dc4fbda63770a3b26a861e" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 45369 } } peers { permanent_uuid: "d5d9247b9d6e4516ab91bbbdec1c2fb1" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 38511 } } peers { permanent_uuid: "17256af032074b1b9b1276bc078bf23f" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 33027 } }
I20260808 04:43:40.580912 6701 leader_election.cc:288] T 93c519eef7294f839c78331838b51f8e P f9f60f08a7dc4fbda63770a3b26a861e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d5d9247b9d6e4516ab91bbbdec1c2fb1 (127.20.240.195:38511), 17256af032074b1b9b1276bc078bf23f (127.20.240.193:33027)
I20260808 04:43:40.584889 6533 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:43:40.581135 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.195:38511 (local address 127.20.240.194:51041)
0808 04:43:40.581318 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0808 04:43:40.581339 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0808 04:43:40.581440 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:43:40.581747 (+ 307us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:43:40.581750 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:43:40.581770 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 04:43:40.581898 (+ 128us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:43:40.581905 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:43:40.582787 (+ 882us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:43:40.582790 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:43:40.583680 (+ 890us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:43:40.583690 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:43:40.584432 (+ 742us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:43:40.584436 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:43:40.584559 (+ 123us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:43:40.584585 (+ 26us) client_negotiation.cc:769] Sending connection context
0808 04:43:40.584669 (+ 84us) client_negotiation.cc:240] Negotiation successful
0808 04:43:40.584748 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":81}
I20260808 04:43:40.584890 6695 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:43:40.581299 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.240.194:51041 (local address 127.20.240.195:38511)
0808 04:43:40.581469 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0808 04:43:40.581474 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 04:43:40.581494 (+ 20us) server_negotiation.cc:407] Connection header received
0808 04:43:40.581558 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:43:40.581561 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:43:40.581611 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:43:40.581702 (+ 91us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 04:43:40.582042 (+ 340us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:43:40.582662 (+ 620us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:43:40.583816 (+ 1154us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:43:40.584318 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:43:40.584418 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:43:40.584460 (+ 42us) server_negotiation.cc:1035] Waiting for connection context
0808 04:43:40.584688 (+ 228us) server_negotiation.cc:299] Negotiation successful
0808 04:43:40.584743 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260808 04:43:40.585314 6703 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:43:40.581265 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.193:33027 (local address 127.20.240.194:49313)
0808 04:43:40.581650 (+ 385us) negotiation.cc:107] Waiting for socket to connect
0808 04:43:40.581666 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 04:43:40.581750 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:43:40.582061 (+ 311us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:43:40.582063 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:43:40.582082 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 04:43:40.582199 (+ 117us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:43:40.582205 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:43:40.583092 (+ 887us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:43:40.583095 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:43:40.584000 (+ 905us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:43:40.584011 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:43:40.584825 (+ 814us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:43:40.584829 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:43:40.584947 (+ 118us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:43:40.584978 (+ 31us) client_negotiation.cc:769] Sending connection context
0808 04:43:40.585078 (+ 100us) client_negotiation.cc:240] Negotiation successful
0808 04:43:40.585179 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":317,"thread_start_us":93,"threads_started":1}
I20260808 04:43:40.585364 6704 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:43:40.581503 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.240.194:49313 (local address 127.20.240.193:33027)
0808 04:43:40.581784 (+ 281us) server_negotiation.cc:206] Beginning negotiation
0808 04:43:40.581789 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 04:43:40.581803 (+ 14us) server_negotiation.cc:407] Connection header received
0808 04:43:40.581856 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:43:40.581860 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:43:40.581925 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:43:40.582045 (+ 120us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 04:43:40.582359 (+ 314us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:43:40.582973 (+ 614us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:43:40.584135 (+ 1162us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:43:40.584712 (+ 577us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:43:40.584820 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:43:40.585001 (+ 181us) server_negotiation.cc:1035] Waiting for connection context
0808 04:43:40.585131 (+ 130us) server_negotiation.cc:299] Negotiation successful
0808 04:43:40.585236 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":202,"thread_start_us":117,"threads_started":1}
I20260808 04:43:40.585659 6628 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93c519eef7294f839c78331838b51f8e" candidate_uuid: "f9f60f08a7dc4fbda63770a3b26a861e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5d9247b9d6e4516ab91bbbdec1c2fb1" is_pre_election: true
I20260808 04:43:40.585920 6317 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93c519eef7294f839c78331838b51f8e" candidate_uuid: "f9f60f08a7dc4fbda63770a3b26a861e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17256af032074b1b9b1276bc078bf23f" is_pre_election: true
I20260808 04:43:40.586016 6628 raft_consensus.cc:2454] T 93c519eef7294f839c78331838b51f8e P d5d9247b9d6e4516ab91bbbdec1c2fb1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9f60f08a7dc4fbda63770a3b26a861e in term 0.
I20260808 04:43:40.586205 6317 raft_consensus.cc:2454] T 93c519eef7294f839c78331838b51f8e P 17256af032074b1b9b1276bc078bf23f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9f60f08a7dc4fbda63770a3b26a861e in term 0.
I20260808 04:43:40.586547 6402 leader_election.cc:302] T 93c519eef7294f839c78331838b51f8e P f9f60f08a7dc4fbda63770a3b26a861e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d5d9247b9d6e4516ab91bbbdec1c2fb1, f9f60f08a7dc4fbda63770a3b26a861e; no voters:
I20260808 04:43:40.586838 6701 raft_consensus.cc:2781] T 93c519eef7294f839c78331838b51f8e P f9f60f08a7dc4fbda63770a3b26a861e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 04:43:40.586925 6701 raft_consensus.cc:482] T 93c519eef7294f839c78331838b51f8e P f9f60f08a7dc4fbda63770a3b26a861e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 04:43:40.586972 6701 raft_consensus.cc:3037] T 93c519eef7294f839c78331838b51f8e P f9f60f08a7dc4fbda63770a3b26a861e [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:43:40.588060 6701 raft_consensus.cc:504] T 93c519eef7294f839c78331838b51f8e P f9f60f08a7dc4fbda63770a3b26a861e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9f60f08a7dc4fbda63770a3b26a861e" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 45369 } } peers { permanent_uuid: "d5d9247b9d6e4516ab91bbbdec1c2fb1" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 38511 } } peers { permanent_uuid: "17256af032074b1b9b1276bc078bf23f" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 33027 } }
I20260808 04:43:40.588423 6701 leader_election.cc:288] T 93c519eef7294f839c78331838b51f8e P f9f60f08a7dc4fbda63770a3b26a861e [CANDIDATE]: Term 1 election: Requested vote from peers d5d9247b9d6e4516ab91bbbdec1c2fb1 (127.20.240.195:38511), 17256af032074b1b9b1276bc078bf23f (127.20.240.193:33027)
I20260808 04:43:40.588788 6628 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93c519eef7294f839c78331838b51f8e" candidate_uuid: "f9f60f08a7dc4fbda63770a3b26a861e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5d9247b9d6e4516ab91bbbdec1c2fb1"
I20260808 04:43:40.588903 6317 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93c519eef7294f839c78331838b51f8e" candidate_uuid: "f9f60f08a7dc4fbda63770a3b26a861e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17256af032074b1b9b1276bc078bf23f"
I20260808 04:43:40.588914 6628 raft_consensus.cc:3037] T 93c519eef7294f839c78331838b51f8e P d5d9247b9d6e4516ab91bbbdec1c2fb1 [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:43:40.589075 6317 raft_consensus.cc:3037] T 93c519eef7294f839c78331838b51f8e P 17256af032074b1b9b1276bc078bf23f [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:43:40.590186 6628 raft_consensus.cc:2454] T 93c519eef7294f839c78331838b51f8e P d5d9247b9d6e4516ab91bbbdec1c2fb1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9f60f08a7dc4fbda63770a3b26a861e in term 1.
I20260808 04:43:40.590291 6317 raft_consensus.cc:2454] T 93c519eef7294f839c78331838b51f8e P 17256af032074b1b9b1276bc078bf23f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9f60f08a7dc4fbda63770a3b26a861e in term 1.
I20260808 04:43:40.590509 6402 leader_election.cc:302] T 93c519eef7294f839c78331838b51f8e P f9f60f08a7dc4fbda63770a3b26a861e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d5d9247b9d6e4516ab91bbbdec1c2fb1, f9f60f08a7dc4fbda63770a3b26a861e; no voters:
I20260808 04:43:40.590720 6701 raft_consensus.cc:2781] T 93c519eef7294f839c78331838b51f8e P f9f60f08a7dc4fbda63770a3b26a861e [term 1 FOLLOWER]: Leader election won for term 1
I20260808 04:43:40.591059 6701 raft_consensus.cc:686] T 93c519eef7294f839c78331838b51f8e P f9f60f08a7dc4fbda63770a3b26a861e [term 1 LEADER]: Becoming Leader. State: Replica: f9f60f08a7dc4fbda63770a3b26a861e, State: Running, Role: LEADER
I20260808 04:43:40.591472 6701 consensus_queue.cc:237] T 93c519eef7294f839c78331838b51f8e P f9f60f08a7dc4fbda63770a3b26a861e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9f60f08a7dc4fbda63770a3b26a861e" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 45369 } } peers { permanent_uuid: "d5d9247b9d6e4516ab91bbbdec1c2fb1" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 38511 } } peers { permanent_uuid: "17256af032074b1b9b1276bc078bf23f" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 33027 } }
I20260808 04:43:40.594951 6155 catalog_manager.cc:5495] T 93c519eef7294f839c78331838b51f8e P f9f60f08a7dc4fbda63770a3b26a861e reported cstate change: term changed from 0 to 1, leader changed from <none> to f9f60f08a7dc4fbda63770a3b26a861e (127.20.240.194). New cstate: current_term: 1 leader_uuid: "f9f60f08a7dc4fbda63770a3b26a861e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9f60f08a7dc4fbda63770a3b26a861e" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 45369 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d5d9247b9d6e4516ab91bbbdec1c2fb1" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 38511 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17256af032074b1b9b1276bc078bf23f" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 33027 } health_report { overall_health: UNKNOWN } } }
W20260808 04:43:40.601325 6532 tablet.cc:2369] T 93c519eef7294f839c78331838b51f8e P f9f60f08a7dc4fbda63770a3b26a861e: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 04:43:40.657763 6692 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:43:40.653795 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45800 (local address 127.20.240.194:45369)
0808 04:43:40.653970 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0808 04:43:40.653975 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 04:43:40.653994 (+ 19us) server_negotiation.cc:407] Connection header received
0808 04:43:40.654107 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:43:40.654111 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:43:40.654180 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:43:40.654310 (+ 130us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 04:43:40.654531 (+ 221us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:43:40.655288 (+ 757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:43:40.656122 (+ 834us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:43:40.656469 (+ 347us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:43:40.656564 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:43:40.656834 (+ 270us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 04:43:40.657355 (+ 521us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 04:43:40.657465 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0808 04:43:40.657533 (+ 68us) server_negotiation.cc:299] Negotiation successful
0808 04:43:40.657596 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260808 04:43:40.664222 6317 raft_consensus.cc:1261] T 93c519eef7294f839c78331838b51f8e P 17256af032074b1b9b1276bc078bf23f [term 1 FOLLOWER]: Refusing update from remote peer f9f60f08a7dc4fbda63770a3b26a861e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 04:43:40.664225 6628 raft_consensus.cc:1261] T 93c519eef7294f839c78331838b51f8e P d5d9247b9d6e4516ab91bbbdec1c2fb1 [term 1 FOLLOWER]: Refusing update from remote peer f9f60f08a7dc4fbda63770a3b26a861e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 04:43:40.664983 6701 consensus_queue.cc:1035] T 93c519eef7294f839c78331838b51f8e P f9f60f08a7dc4fbda63770a3b26a861e [LEADER]: Connected to new peer: Peer: permanent_uuid: "17256af032074b1b9b1276bc078bf23f" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 33027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 04:43:40.665220 6705 consensus_queue.cc:1035] T 93c519eef7294f839c78331838b51f8e P f9f60f08a7dc4fbda63770a3b26a861e [LEADER]: Connected to new peer: Peer: permanent_uuid: "d5d9247b9d6e4516ab91bbbdec1c2fb1" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 38511 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 04:43:40.672286 6708 mvcc.cc:205] Tried to move back new op lower bound from 7316128647832342528 to 7316128647545974784. Current Snapshot: MvccSnapshot[applied={T|T < 7316128647832342528}]
I20260808 04:43:40.673501 6709 mvcc.cc:205] Tried to move back new op lower bound from 7316128647832342528 to 7316128647545974784. Current Snapshot: MvccSnapshot[applied={T|T < 7316128647832342528}]
I20260808 04:43:40.674379 6711 mvcc.cc:205] Tried to move back new op lower bound from 7316128647832342528 to 7316128647545974784. Current Snapshot: MvccSnapshot[applied={T|T < 7316128647832342528}]
I20260808 04:43:40.681996 6153 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54424:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 04:43:40.682170 6153 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54424:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 04:43:40.684844 6153 catalog_manager.cc:5782] T 00000000000000000000000000000000 P b44539d028104d79a7fd51cfc6e31178: Sending DeleteTablet for 3 replicas of tablet 93c519eef7294f839c78331838b51f8e
I20260808 04:43:40.685763 6452 tablet_service.cc:1514] Processing DeleteTablet for tablet 93c519eef7294f839c78331838b51f8e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 04:43:40 UTC) from {username='kudu', principal='kudu/127.20.240.254@KRBTEST.COM'} at 127.0.0.1:45786
I20260808 04:43:40.685914 6294 tablet_service.cc:1514] Processing DeleteTablet for tablet 93c519eef7294f839c78331838b51f8e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 04:43:40 UTC) from {username='kudu', principal='kudu/127.20.240.254@KRBTEST.COM'} at 127.0.0.1:40802
I20260808 04:43:40.685985 6606 tablet_service.cc:1514] Processing DeleteTablet for tablet 93c519eef7294f839c78331838b51f8e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 04:43:40 UTC) from {username='kudu', principal='kudu/127.20.240.254@KRBTEST.COM'} at 127.0.0.1:59570
I20260808 04:43:40.686479 6719 tablet_replica.cc:330] T 93c519eef7294f839c78331838b51f8e P d5d9247b9d6e4516ab91bbbdec1c2fb1: stopping tablet replica
I20260808 04:43:40.686612 21443 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu with pid 6200
I20260808 04:43:40.686837 6719 raft_consensus.cc:2229] T 93c519eef7294f839c78331838b51f8e P d5d9247b9d6e4516ab91bbbdec1c2fb1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 04:43:40.687157 6719 raft_consensus.cc:2258] T 93c519eef7294f839c78331838b51f8e P d5d9247b9d6e4516ab91bbbdec1c2fb1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 04:43:40.688971 6719 ts_tablet_manager.cc:1905] T 93c519eef7294f839c78331838b51f8e P d5d9247b9d6e4516ab91bbbdec1c2fb1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 04:43:40.686760 6718 tablet_replica.cc:330] T 93c519eef7294f839c78331838b51f8e P f9f60f08a7dc4fbda63770a3b26a861e: stopping tablet replica
I20260808 04:43:40.690955 6718 raft_consensus.cc:2229] T 93c519eef7294f839c78331838b51f8e P f9f60f08a7dc4fbda63770a3b26a861e [term 1 LEADER]: Raft consensus shutting down.
I20260808 04:43:40.691522 6718 raft_consensus.cc:2258] T 93c519eef7294f839c78331838b51f8e P f9f60f08a7dc4fbda63770a3b26a861e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 04:43:40.692649 6719 ts_tablet_manager.cc:1918] T 93c519eef7294f839c78331838b51f8e P d5d9247b9d6e4516ab91bbbdec1c2fb1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 04:43:40.692797 6719 log.cc:1196] T 93c519eef7294f839c78331838b51f8e P d5d9247b9d6e4516ab91bbbdec1c2fb1: Deleting WAL directory at /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164000593138-21443-0/minicluster-data/ts-2/wal/wals/93c519eef7294f839c78331838b51f8e
I20260808 04:43:40.693318 6719 ts_tablet_manager.cc:1939] T 93c519eef7294f839c78331838b51f8e P d5d9247b9d6e4516ab91bbbdec1c2fb1: Deleting consensus metadata
I20260808 04:43:40.694024 6718 ts_tablet_manager.cc:1905] T 93c519eef7294f839c78331838b51f8e P f9f60f08a7dc4fbda63770a3b26a861e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 04:43:40.695052 6139 catalog_manager.cc:4841] TS d5d9247b9d6e4516ab91bbbdec1c2fb1 (127.20.240.195:38511): tablet 93c519eef7294f839c78331838b51f8e (table test-table [id=8256b217a7794a65b43621315c9bed1c]) successfully deleted
I20260808 04:43:40.697412 6718 ts_tablet_manager.cc:1918] T 93c519eef7294f839c78331838b51f8e P f9f60f08a7dc4fbda63770a3b26a861e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 04:43:40.697561 6718 log.cc:1196] T 93c519eef7294f839c78331838b51f8e P f9f60f08a7dc4fbda63770a3b26a861e: Deleting WAL directory at /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164000593138-21443-0/minicluster-data/ts-1/wal/wals/93c519eef7294f839c78331838b51f8e
I20260808 04:43:40.697948 6718 ts_tablet_manager.cc:1939] T 93c519eef7294f839c78331838b51f8e P f9f60f08a7dc4fbda63770a3b26a861e: Deleting consensus metadata
I20260808 04:43:40.699301 6138 catalog_manager.cc:4841] TS f9f60f08a7dc4fbda63770a3b26a861e (127.20.240.194:45369): tablet 93c519eef7294f839c78331838b51f8e (table test-table [id=8256b217a7794a65b43621315c9bed1c]) successfully deleted
W20260808 04:43:40.702281 6138 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.20.240.193:33027 (error 108)
I20260808 04:43:40.702905 21443 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu with pid 6374
I20260808 04:43:40.704267 6693 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:43:40.703185 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.193:33027 (local address 127.0.0.1:40816)
0808 04:43:40.704064 (+ 879us) negotiation.cc:107] Waiting for socket to connect
0808 04:43:40.704151 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.240.193:33027: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":768}
W20260808 04:43:40.704571 6138 catalog_manager.cc:4584] TS 17256af032074b1b9b1276bc078bf23f (127.20.240.193:33027): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 93c519eef7294f839c78331838b51f8e: Network error: Client connection negotiation failed: client connection to 127.20.240.193:33027: connect: Connection refused (error 111)
I20260808 04:43:40.710044 21443 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu with pid 6534
I20260808 04:43:40.717473 21443 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu with pid 6120
I20260808 04:44:00.726647 21443 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
/tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164000593138-21443-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164000593138-21443-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164000593138-21443-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164000593138-21443-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.240.254:42631
--webserver_interface=127.20.240.254
--webserver_port=41973
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.254.keytab
--principal=kudu/127.20.240.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.240.212:44813
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.240.254:42631
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164000593138-21443-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164000593138-21443-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164000593138-21443-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 04:44:00.845695 6721 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:44:00.846014 6721 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:44:00.846060 6721 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:44:00.850343 6721 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260808 04:44:00.850422 6721 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260808 04:44:00.850440 6721 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260808 04:44:00.850453 6721 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 04:44:00.850472 6721 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:44:00.850492 6721 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:44:00.850509 6721 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 04:44:00.850525 6721 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 04:44:00.856225 6721 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.240.212:44813
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164000593138-21443-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164000593138-21443-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.20.240.254:42631
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.254.keytab
--principal=kudu/127.20.240.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.240.254:42631
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164000593138-21443-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.240.254
--webserver_port=41973
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6721
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164000593138-21443-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 04:05:18 UTC on ccycloud.quasar-drfdgt.root.comops.site
build id 4574101
I20260808 04:44:00.857461 6721 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:44:00.858500 6721 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:44:00.868250 6727 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:44:00.868157 6729 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:44:00.868455 6726 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:44:00.868275 6721 server_base.cc:1034] running on GCE node
I20260808 04:44:00.869100 6721 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:44:00.870412 6721 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:44:00.871618 6721 hybrid_clock.cc:648] HybridClock initialized: now 1786164240871603 us; error 35 us; skew 500 ppm
Aug 08 04:44:00 dist-test-slave-vxj2 krb5kdc[5498](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164240, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.240.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:44:00.874763 6721 init.cc:377] Logged in from keytab as kudu/127.20.240.254@KRBTEST.COM (short username kudu)
I20260808 04:44:00.875754 6721 webserver.cc:460] Webserver started at http://127.20.240.254:41973/ using document root <none> and password file <none>
I20260808 04:44:00.876382 6721 fs_manager.cc:359] Metadata directory not provided
I20260808 04:44:00.876485 6721 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:44:00.880620 6721 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.000s
I20260808 04:44:00.883199 6737 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:44:00.884699 6721 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260808 04:44:00.884826 6721 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164000593138-21443-0/minicluster-data/master-0/data,/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164000593138-21443-0/minicluster-data/master-0/wal
uuid: "b44539d028104d79a7fd51cfc6e31178"
format_stamp: "Formatted at 2026-08-08 04:43:18 on dist-test-slave-vxj2"
server_key: "017726d87f8b2218865cb60adba7ff33"
server_key_iv: "26879a73ee0a858f7d901de7a7c616c5"
server_key_version: "encryptionkey@0"
I20260808 04:44:00.885506 6721 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164000593138-21443-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164000593138-21443-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164000593138-21443-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:44:00.912521 6721 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:44:00.916247 6721 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:44:00.916448 6721 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:44:00.924506 6721 rpc_server.cc:307] RPC server started. Bound to: 127.20.240.254:42631
I20260808 04:44:00.924898 6799 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.240.254:42631 every 8 connection(s)
I20260808 04:44:00.925804 6721 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164000593138-21443-0/minicluster-data/master-0/data/info.pb
I20260808 04:44:00.930589 6800 sys_catalog.cc:263] Verifying existing consensus state
I20260808 04:44:00.932446 6800 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b44539d028104d79a7fd51cfc6e31178: Bootstrap starting.
I20260808 04:44:00.934929 21443 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu as pid 6721
I20260808 04:44:00.935477 21443 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
/tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164000593138-21443-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164000593138-21443-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164000593138-21443-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164000593138-21443-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.240.193:33027
--local_ip_for_outbound_sockets=127.20.240.193
--tserver_master_addrs=127.20.240.254:42631
--webserver_port=43429
--webserver_interface=127.20.240.193
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.193.keytab
--principal=kudu/127.20.240.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.240.212:44813
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164000593138-21443-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164000593138-21443-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164000593138-21443-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 04:44:00.956786 6800 log.cc:824] T 00000000000000000000000000000000 P b44539d028104d79a7fd51cfc6e31178: Log is configured to *not* fsync() on all Append() calls
I20260808 04:44:00.972355 6800 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b44539d028104d79a7fd51cfc6e31178: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=8 ignored=0} mutations{seen=8 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 04:44:00.972894 6800 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b44539d028104d79a7fd51cfc6e31178: Bootstrap complete.
I20260808 04:44:00.978972 6800 raft_consensus.cc:348] T 00000000000000000000000000000000 P b44539d028104d79a7fd51cfc6e31178 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b44539d028104d79a7fd51cfc6e31178" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 42631 } }
I20260808 04:44:00.979565 6800 raft_consensus.cc:729] T 00000000000000000000000000000000 P b44539d028104d79a7fd51cfc6e31178 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: b44539d028104d79a7fd51cfc6e31178, State: Initialized, Role: FOLLOWER
I20260808 04:44:00.980209 6800 consensus_queue.cc:260] T 00000000000000000000000000000000 P b44539d028104d79a7fd51cfc6e31178 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b44539d028104d79a7fd51cfc6e31178" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 42631 } }
I20260808 04:44:00.980388 6800 raft_consensus.cc:388] T 00000000000000000000000000000000 P b44539d028104d79a7fd51cfc6e31178 [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 04:44:00.980477 6800 raft_consensus.cc:482] T 00000000000000000000000000000000 P b44539d028104d79a7fd51cfc6e31178 [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 04:44:00.980585 6800 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b44539d028104d79a7fd51cfc6e31178 [term 2 FOLLOWER]: Advancing to term 3
I20260808 04:44:00.983915 6800 raft_consensus.cc:504] T 00000000000000000000000000000000 P b44539d028104d79a7fd51cfc6e31178 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b44539d028104d79a7fd51cfc6e31178" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 42631 } }
I20260808 04:44:00.984717 6800 leader_election.cc:302] T 00000000000000000000000000000000 P b44539d028104d79a7fd51cfc6e31178 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b44539d028104d79a7fd51cfc6e31178; no voters:
I20260808 04:44:00.985334 6800 leader_election.cc:288] T 00000000000000000000000000000000 P b44539d028104d79a7fd51cfc6e31178 [CANDIDATE]: Term 3 election: Requested vote from peers
I20260808 04:44:00.985520 6804 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b44539d028104d79a7fd51cfc6e31178 [term 3 FOLLOWER]: Leader election won for term 3
I20260808 04:44:00.985847 6804 raft_consensus.cc:686] T 00000000000000000000000000000000 P b44539d028104d79a7fd51cfc6e31178 [term 3 LEADER]: Becoming Leader. State: Replica: b44539d028104d79a7fd51cfc6e31178, State: Running, Role: LEADER
I20260808 04:44:00.986289 6804 consensus_queue.cc:237] T 00000000000000000000000000000000 P b44539d028104d79a7fd51cfc6e31178 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b44539d028104d79a7fd51cfc6e31178" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 42631 } }
I20260808 04:44:00.986922 6800 sys_catalog.cc:564] T 00000000000000000000000000000000 P b44539d028104d79a7fd51cfc6e31178 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 04:44:00.987952 6807 sys_catalog.cc:455] T 00000000000000000000000000000000 P b44539d028104d79a7fd51cfc6e31178 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b44539d028104d79a7fd51cfc6e31178. Latest consensus state: current_term: 3 leader_uuid: "b44539d028104d79a7fd51cfc6e31178" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b44539d028104d79a7fd51cfc6e31178" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 42631 } } }
I20260808 04:44:00.988098 6807 sys_catalog.cc:458] T 00000000000000000000000000000000 P b44539d028104d79a7fd51cfc6e31178 [sys.catalog]: This master's current role is: LEADER
I20260808 04:44:00.988955 6814 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 04:44:00.988899 6806 sys_catalog.cc:455] T 00000000000000000000000000000000 P b44539d028104d79a7fd51cfc6e31178 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "b44539d028104d79a7fd51cfc6e31178" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b44539d028104d79a7fd51cfc6e31178" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 42631 } } }
I20260808 04:44:00.989387 6806 sys_catalog.cc:458] T 00000000000000000000000000000000 P b44539d028104d79a7fd51cfc6e31178 [sys.catalog]: This master's current role is: LEADER
I20260808 04:44:00.994202 6814 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 04:44:00.994808 6814 catalog_manager.cc:1259] Loaded cluster ID: 6430311a072e44229a99fe0e5e0650fd
I20260808 04:44:00.994905 6814 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 04:44:00.996784 6814 catalog_manager.cc:1504] Loading token signing keys...
I20260808 04:44:00.997581 6814 catalog_manager.cc:5879] T 00000000000000000000000000000000 P b44539d028104d79a7fd51cfc6e31178: Loaded TSK: 0
I20260808 04:44:00.997681 6814 catalog_manager.cc:5879] T 00000000000000000000000000000000 P b44539d028104d79a7fd51cfc6e31178: Loaded TSK: 1
F20260808 04:44:00.998351 6814 token_signing_key.cc:66] Check failed: _s.ok() Bad status: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7f1d7bc5d9ad google::LogMessage::Fail() at ??:0
@ 0x7f1d7bc6088a google::LogMessage::SendToLog() at ??:0
@ 0x7f1d7bc5d4de google::LogMessage::Flush() at ??:0
@ 0x7f1d7bc5ea19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7f1d7e92118d kudu::security::TokenSigningPrivateKey::TokenSigningPrivateKey() at ??:0
@ 0x7f1d7e919f0d kudu::security::TokenSigner::ImportKeys() at ??:0
@ 0x7f1d865c27bb kudu::master::CatalogManager::LoadTskEntries() at ??:0
@ 0x7f1d8659c99c kudu::master::CatalogManager::InitTokenSigner() at ??:0
@ 0x7f1d8659d178 _ZZN4kudu6master14CatalogManager24PrepareForLeadershipTaskEvENKUlvE3_clEv at ??:0
@ 0x7f1d865dedf8 _ZNSt17_Function_handlerIFN4kudu6StatusEvEZNS0_6master14CatalogManager24PrepareForLeadershipTaskEvEUlvE3_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x7f1d865fd82b std::function<>::operator()() at ??:0
@ 0x7f1d8659cb4f _ZZN4kudu6master14CatalogManager24PrepareForLeadershipTaskEvENKUlSt8functionIFNS_6StatusEvEERKNS_9consensus13RaftConsensusElPKcE_clES5_S9_lSB_ at ??:0
@ 0x7f1d8659df3e kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7f1d8659a579 _ZZN4kudu6master14CatalogManager17ElectedAsLeaderCbEvENKUlvE_clEv at ??:0
@ 0x7f1d865de640 _ZNSt17_Function_handlerIFvvEZN4kudu6master14CatalogManager17ElectedAsLeaderCbEvEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x61d838 std::function<>::operator()() at ??:0
@ 0x7f1d7deaf3d7 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7f1d7deafc83 _ZZN4kudu10ThreadPool12CreateThreadEvENKUlvE_clEv at ??:0
@ 0x7f1d7deb13f2 _ZNSt17_Function_handlerIFvvEZN4kudu10ThreadPool12CreateThreadEvEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x61d838 std::function<>::operator()() at ??:0
@ 0x7f1d7dea0512 kudu::Thread::SuperviseThread() at ??:0
@ 0x7f1d7f4e46db start_thread at ??:0
@ 0x7f1d7a75b61f clone at ??:0
W20260808 04:44:01.111572 6802 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:44:01.112006 6802 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:44:01.112078 6802 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:44:01.118458 6802 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:44:01.118570 6802 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:44:01.118669 6802 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.240.193
I20260808 04:44:01.128350 6802 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.240.212:44813
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164000593138-21443-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164000593138-21443-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.193.keytab
--principal=kudu/127.20.240.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.240.193:33027
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164000593138-21443-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.240.193
--webserver_port=43429
--tserver_master_addrs=127.20.240.254:42631
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6802
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.240.193
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164000593138-21443-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 04:05:18 UTC on ccycloud.quasar-drfdgt.root.comops.site
build id 4574101
I20260808 04:44:01.130106 6802 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:44:01.131666 6802 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:44:01.145208 6855 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:44:01.145174 6856 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:44:01.145208 6858 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:44:01.145766 6802 server_base.cc:1034] running on GCE node
I20260808 04:44:01.146271 6802 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:44:01.147034 6802 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:44:01.148293 6802 hybrid_clock.cc:648] HybridClock initialized: now 1786164241148214 us; error 69 us; skew 500 ppm
Aug 08 04:44:01 dist-test-slave-vxj2 krb5kdc[5498](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164241, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.240.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:44:01.151475 6802 init.cc:377] Logged in from keytab as kudu/127.20.240.193@KRBTEST.COM (short username kudu)
I20260808 04:44:01.152501 6802 webserver.cc:460] Webserver started at http://127.20.240.193:43429/ using document root <none> and password file <none>
I20260808 04:44:01.153216 6802 fs_manager.cc:359] Metadata directory not provided
I20260808 04:44:01.153301 6802 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:44:01.158166 6802 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260808 04:44:01.160991 6865 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:44:01.162633 6802 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 04:44:01.162802 6802 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164000593138-21443-0/minicluster-data/ts-0/data,/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164000593138-21443-0/minicluster-data/ts-0/wal
uuid: "17256af032074b1b9b1276bc078bf23f"
format_stamp: "Formatted at 2026-08-08 04:43:18 on dist-test-slave-vxj2"
server_key: "1cd64b0a3773d4a699c528abe9253bbc"
server_key_iv: "4ac8f7095cd4f35373bf8799f6fe804f"
server_key_version: "encryptionkey@0"
I20260808 04:44:01.163448 6802 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164000593138-21443-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164000593138-21443-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164000593138-21443-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:44:01.175987 6802 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:44:01.179612 6802 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:44:01.179847 6802 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:44:01.180523 6802 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 04:44:01.181820 6873 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260808 04:44:01.188161 6802 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260808 04:44:01.188297 6802 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.007s user 0.000s sys 0.001s
I20260808 04:44:01.188392 6802 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260808 04:44:01.190527 6802 ts_tablet_manager.cc:610] Registered 1 tablets
I20260808 04:44:01.190630 6802 ts_tablet_manager.cc:589] Time spent register tablets: real 0.002s user 0.000s sys 0.001s
I20260808 04:44:01.190961 6873 tablet_bootstrap.cc:492] T 93c519eef7294f839c78331838b51f8e P 17256af032074b1b9b1276bc078bf23f: Bootstrap starting.
I20260808 04:44:01.201720 6802 rpc_server.cc:307] RPC server started. Bound to: 127.20.240.193:33027
I20260808 04:44:01.201994 6999 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.240.193:33027 every 8 connection(s)
I20260808 04:44:01.202833 6802 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164000593138-21443-0/minicluster-data/ts-0/data/info.pb
I20260808 04:44:01.204945 21443 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu as pid 6802
I20260808 04:44:01.205518 21443 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
/tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164000593138-21443-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164000593138-21443-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164000593138-21443-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164000593138-21443-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.240.194:45369
--local_ip_for_outbound_sockets=127.20.240.194
--tserver_master_addrs=127.20.240.254:42631
--webserver_port=40943
--webserver_interface=127.20.240.194
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.194.keytab
--principal=kudu/127.20.240.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.240.212:44813
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164000593138-21443-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164000593138-21443-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164000593138-21443-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 04:44:01.213723 6873 log.cc:824] T 93c519eef7294f839c78331838b51f8e P 17256af032074b1b9b1276bc078bf23f: Log is configured to *not* fsync() on all Append() calls
I20260808 04:44:01.225244 6873 tablet_bootstrap.cc:492] T 93c519eef7294f839c78331838b51f8e P 17256af032074b1b9b1276bc078bf23f: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 04:44:01.225778 6873 tablet_bootstrap.cc:492] T 93c519eef7294f839c78331838b51f8e P 17256af032074b1b9b1276bc078bf23f: Bootstrap complete.
I20260808 04:44:01.227325 6873 ts_tablet_manager.cc:1397] T 93c519eef7294f839c78331838b51f8e P 17256af032074b1b9b1276bc078bf23f: Time spent bootstrapping tablet: real 0.037s user 0.030s sys 0.004s
I20260808 04:44:01.231002 6873 raft_consensus.cc:348] T 93c519eef7294f839c78331838b51f8e P 17256af032074b1b9b1276bc078bf23f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9f60f08a7dc4fbda63770a3b26a861e" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 45369 } } peers { permanent_uuid: "d5d9247b9d6e4516ab91bbbdec1c2fb1" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 38511 } } peers { permanent_uuid: "17256af032074b1b9b1276bc078bf23f" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 33027 } }
I20260808 04:44:01.231617 6873 raft_consensus.cc:729] T 93c519eef7294f839c78331838b51f8e P 17256af032074b1b9b1276bc078bf23f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17256af032074b1b9b1276bc078bf23f, State: Initialized, Role: FOLLOWER
I20260808 04:44:01.232188 6873 consensus_queue.cc:260] T 93c519eef7294f839c78331838b51f8e P 17256af032074b1b9b1276bc078bf23f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9f60f08a7dc4fbda63770a3b26a861e" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 45369 } } peers { permanent_uuid: "d5d9247b9d6e4516ab91bbbdec1c2fb1" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 38511 } } peers { permanent_uuid: "17256af032074b1b9b1276bc078bf23f" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 33027 } }
I20260808 04:44:01.233561 6873 ts_tablet_manager.cc:1428] T 93c519eef7294f839c78331838b51f8e P 17256af032074b1b9b1276bc078bf23f: Time spent starting tablet: real 0.006s user 0.008s sys 0.000s
W20260808 04:44:01.275069 7002 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 04:44:01.205105 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:42631 (local address 127.20.240.193:59857)
0808 04:44:01.206076 (+ 971us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:01.206158 (+ 82us) client_negotiation.cc:174] Beginning negotiation
0808 04:44:01.207350 (+ 1192us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:44:01.274195 (+ 66845us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.240.254:42631: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":408,"thread_start_us":182,"threads_started":1}
W20260808 04:44:01.275741 7000 heartbeater.cc:644] Failed to heartbeat to 127.20.240.254:42631 (0 consecutive failures): Network error: Failed to ping master at 127.20.240.254:42631: Client connection negotiation failed: client connection to 127.20.240.254:42631: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260808 04:44:01.276584 7002 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:01.276305 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:42631 (local address 127.20.240.193:35211)
0808 04:44:01.276447 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:01.276521 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.240.254:42631: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":59}
I20260808 04:44:01.277278 7002 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:01.277008 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:42631 (local address 127.20.240.193:55391)
0808 04:44:01.277129 (+ 121us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:01.277225 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.240.254:42631: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
W20260808 04:44:01.277442 7000 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260808 04:44:01.335202 7003 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:44:01.335582 7003 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:44:01.335666 7003 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:44:01.340016 7003 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:44:01.340153 7003 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:44:01.340273 7003 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.240.194
I20260808 04:44:01.346823 7003 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.240.212:44813
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164000593138-21443-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164000593138-21443-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.194.keytab
--principal=kudu/127.20.240.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.240.194:45369
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164000593138-21443-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.240.194
--webserver_port=40943
--tserver_master_addrs=127.20.240.254:42631
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7003
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.240.194
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164000593138-21443-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 04:05:18 UTC on ccycloud.quasar-drfdgt.root.comops.site
build id 4574101
I20260808 04:44:01.348048 7003 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:44:01.349327 7003 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:44:01.361439 7015 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:44:01.361439 7013 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:44:01.361423 7011 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:44:01.362102 7003 server_base.cc:1034] running on GCE node
I20260808 04:44:01.362563 7003 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:44:01.363312 7003 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:44:01.364629 7003 hybrid_clock.cc:648] HybridClock initialized: now 1786164241364592 us; error 52 us; skew 500 ppm
Aug 08 04:44:01 dist-test-slave-vxj2 krb5kdc[5498](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164241, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.240.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:44:01.368798 7003 init.cc:377] Logged in from keytab as kudu/127.20.240.194@KRBTEST.COM (short username kudu)
I20260808 04:44:01.369990 7003 webserver.cc:460] Webserver started at http://127.20.240.194:40943/ using document root <none> and password file <none>
I20260808 04:44:01.370646 7003 fs_manager.cc:359] Metadata directory not provided
I20260808 04:44:01.370762 7003 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:44:01.375506 7003 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.005s sys 0.000s
I20260808 04:44:01.378042 7024 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:44:01.379673 7003 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 04:44:01.379856 7003 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164000593138-21443-0/minicluster-data/ts-1/data,/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164000593138-21443-0/minicluster-data/ts-1/wal
uuid: "f9f60f08a7dc4fbda63770a3b26a861e"
format_stamp: "Formatted at 2026-08-08 04:43:18 on dist-test-slave-vxj2"
server_key: "3e7999911ff6797d78b5e8fd1673438e"
server_key_iv: "97b7ec248c2a07b63d6196f5d324536e"
server_key_version: "encryptionkey@0"
I20260808 04:44:01.380776 7003 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164000593138-21443-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164000593138-21443-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164000593138-21443-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:44:01.399926 7003 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:44:01.403448 7003 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:44:01.403692 7003 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:44:01.404356 7003 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 04:44:01.405380 7003 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 04:44:01.405470 7003 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 04:44:01.405565 7003 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 04:44:01.405616 7003 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 04:44:01.415959 7003 rpc_server.cc:307] RPC server started. Bound to: 127.20.240.194:45369
I20260808 04:44:01.415987 7153 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.240.194:45369 every 8 connection(s)
I20260808 04:44:01.417099 7003 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164000593138-21443-0/minicluster-data/ts-1/data/info.pb
I20260808 04:44:01.421938 7156 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:01.419754 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:42631 (local address 127.20.240.194:60199)
0808 04:44:01.420803 (+ 1049us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:01.420958 (+ 155us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.240.254:42631: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":821,"thread_start_us":583,"threads_started":1}
W20260808 04:44:01.422575 7154 heartbeater.cc:644] Failed to heartbeat to 127.20.240.254:42631 (0 consecutive failures): Network error: Failed to ping master at 127.20.240.254:42631: Client connection negotiation failed: client connection to 127.20.240.254:42631: connect: Connection refused (error 111)
I20260808 04:44:01.423368 7156 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:01.423075 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:42631 (local address 127.20.240.194:33129)
0808 04:44:01.423240 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:01.423304 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.240.254:42631: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":66}
I20260808 04:44:01.424230 7156 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:01.423993 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:42631 (local address 127.20.240.194:51737)
0808 04:44:01.424128 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:01.424176 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.240.254:42631: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":64}
W20260808 04:44:01.424610 7154 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260808 04:44:01.425410 21443 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu as pid 7003
I20260808 04:44:01.425957 21443 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
/tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164000593138-21443-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164000593138-21443-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164000593138-21443-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164000593138-21443-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.240.195:38511
--local_ip_for_outbound_sockets=127.20.240.195
--tserver_master_addrs=127.20.240.254:42631
--webserver_port=36523
--webserver_interface=127.20.240.195
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.195.keytab
--principal=kudu/127.20.240.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.240.212:44813
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164000593138-21443-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164000593138-21443-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164000593138-21443-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 04:44:01.545782 7157 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:44:01.546105 7157 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:44:01.546157 7157 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:44:01.550853 7157 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:44:01.550935 7157 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:44:01.551007 7157 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.240.195
I20260808 04:44:01.557358 7157 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.240.212:44813
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164000593138-21443-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164000593138-21443-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.195.keytab
--principal=kudu/127.20.240.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.240.195:38511
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164000593138-21443-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.240.195
--webserver_port=36523
--tserver_master_addrs=127.20.240.254:42631
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7157
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.240.195
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164000593138-21443-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 04:05:18 UTC on ccycloud.quasar-drfdgt.root.comops.site
build id 4574101
I20260808 04:44:01.558512 7157 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:44:01.559556 7157 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:44:01.571604 7166 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:44:01.571606 7165 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:44:01.571796 7157 server_base.cc:1034] running on GCE node
W20260808 04:44:01.571604 7169 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:44:01.572448 7157 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:44:01.573283 7157 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:44:01.574533 7157 hybrid_clock.cc:648] HybridClock initialized: now 1786164241574511 us; error 31 us; skew 500 ppm
Aug 08 04:44:01 dist-test-slave-vxj2 krb5kdc[5498](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164241, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.240.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:44:01.577639 7157 init.cc:377] Logged in from keytab as kudu/127.20.240.195@KRBTEST.COM (short username kudu)
I20260808 04:44:01.578613 7157 webserver.cc:460] Webserver started at http://127.20.240.195:36523/ using document root <none> and password file <none>
I20260808 04:44:01.579192 7157 fs_manager.cc:359] Metadata directory not provided
I20260808 04:44:01.579259 7157 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:44:01.583930 7157 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260808 04:44:01.587417 7176 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:44:01.589318 7157 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260808 04:44:01.589469 7157 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164000593138-21443-0/minicluster-data/ts-2/data,/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164000593138-21443-0/minicluster-data/ts-2/wal
uuid: "d5d9247b9d6e4516ab91bbbdec1c2fb1"
format_stamp: "Formatted at 2026-08-08 04:43:18 on dist-test-slave-vxj2"
server_key: "494584af004e89751c8790b8dc9b386c"
server_key_iv: "c8cb85ce9fae9f0602225a06d2962c6f"
server_key_version: "encryptionkey@0"
I20260808 04:44:01.590126 7157 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164000593138-21443-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164000593138-21443-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164000593138-21443-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:44:01.618803 7157 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:44:01.622473 7157 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:44:01.622655 7157 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:44:01.623265 7157 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 04:44:01.624136 7157 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 04:44:01.624198 7157 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 04:44:01.624243 7157 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 04:44:01.624259 7157 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 04:44:01.635152 7157 rpc_server.cc:307] RPC server started. Bound to: 127.20.240.195:38511
I20260808 04:44:01.635175 7311 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.240.195:38511 every 8 connection(s)
I20260808 04:44:01.636384 7157 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164000593138-21443-0/minicluster-data/ts-2/data/info.pb
I20260808 04:44:01.640936 7316 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:01.638856 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:42631 (local address 127.20.240.195:48433)
0808 04:44:01.639454 (+ 598us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:01.639588 (+ 134us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.240.254:42631: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":338,"thread_start_us":135,"threads_started":1}
W20260808 04:44:01.641485 7313 heartbeater.cc:644] Failed to heartbeat to 127.20.240.254:42631 (0 consecutive failures): Network error: Failed to ping master at 127.20.240.254:42631: Client connection negotiation failed: client connection to 127.20.240.254:42631: connect: Connection refused (error 111)
I20260808 04:44:01.642248 7316 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:01.641957 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:42631 (local address 127.20.240.195:58527)
0808 04:44:01.642102 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:01.642167 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.240.254:42631: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
I20260808 04:44:01.643025 7316 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:01.642753 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:42631 (local address 127.20.240.195:56727)
0808 04:44:01.642911 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:01.642965 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.240.254:42631: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":93}
W20260808 04:44:01.643227 7313 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260808 04:44:01.644446 21443 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu as pid 7157
I20260808 04:44:02.278618 7319 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:02.278143 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:42631 (local address 127.20.240.193:36099)
0808 04:44:02.278434 (+ 291us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:02.278498 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.240.254:42631: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":195,"thread_start_us":79,"threads_started":1}
I20260808 04:44:02.425833 7320 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:02.425375 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:42631 (local address 127.20.240.194:50067)
0808 04:44:02.425648 (+ 273us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:02.425713 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.240.254:42631: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":194,"thread_start_us":91,"threads_started":1}
I20260808 04:44:02.644428 7321 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:02.643963 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:42631 (local address 127.20.240.195:52313)
0808 04:44:02.644246 (+ 283us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:02.644312 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.240.254:42631: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":198,"thread_start_us":78,"threads_started":1}
I20260808 04:44:02.891887 7322 raft_consensus.cc:482] T 93c519eef7294f839c78331838b51f8e P 17256af032074b1b9b1276bc078bf23f [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 04:44:02.892169 7322 raft_consensus.cc:504] T 93c519eef7294f839c78331838b51f8e P 17256af032074b1b9b1276bc078bf23f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9f60f08a7dc4fbda63770a3b26a861e" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 45369 } } peers { permanent_uuid: "d5d9247b9d6e4516ab91bbbdec1c2fb1" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 38511 } } peers { permanent_uuid: "17256af032074b1b9b1276bc078bf23f" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 33027 } }
I20260808 04:44:02.893461 7322 leader_election.cc:288] T 93c519eef7294f839c78331838b51f8e P 17256af032074b1b9b1276bc078bf23f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f9f60f08a7dc4fbda63770a3b26a861e (127.20.240.194:45369), d5d9247b9d6e4516ab91bbbdec1c2fb1 (127.20.240.195:38511)
Aug 08 04:44:02 dist-test-slave-vxj2 krb5kdc[5498](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164241, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.240.193@KRBTEST.COM for kudu/127.20.240.194@KRBTEST.COM
Aug 08 04:44:02 dist-test-slave-vxj2 krb5kdc[5498](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164241, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.240.193@KRBTEST.COM for kudu/127.20.240.195@KRBTEST.COM
I20260808 04:44:02.912963 7327 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:02.893911 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.240.193:48755 (local address 127.20.240.195:38511)
0808 04:44:02.894434 (+ 523us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:02.894454 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:02.894496 (+ 42us) server_negotiation.cc:407] Connection header received
0808 04:44:02.895487 (+ 991us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:02.895493 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:02.895956 (+ 463us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:02.896299 (+ 343us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:44:02.898543 (+ 2244us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:02.900152 (+ 1609us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:02.902475 (+ 2323us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:02.903331 (+ 856us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:02.903521 (+ 190us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:02.907862 (+ 4341us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:44:02.907868 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:44:02.907880 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:44:02.907913 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:44:02.910128 (+ 2215us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:44:02.910758 (+ 630us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:44:02.910764 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:44:02.910768 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:44:02.910959 (+ 191us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:44:02.911327 (+ 368us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:44:02.911330 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:44:02.911331 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:44:02.911725 (+ 394us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:44:02.911871 (+ 146us) server_negotiation.cc:1035] Waiting for connection context
0808 04:44:02.912498 (+ 627us) server_negotiation.cc:299] Negotiation successful
0808 04:44:02.912787 (+ 289us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":355,"thread_start_us":122,"threads_started":1}
I20260808 04:44:02.912955 7326 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:02.893752 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.194:45369 (local address 127.20.240.193:48405)
0808 04:44:02.894198 (+ 446us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:02.894511 (+ 313us) client_negotiation.cc:174] Beginning negotiation
0808 04:44:02.894626 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:44:02.896465 (+ 1839us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:44:02.896473 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:44:02.897310 (+ 837us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:44:02.898297 (+ 987us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:44:02.898325 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:44:02.900385 (+ 2060us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:44:02.900390 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:44:02.902290 (+ 1900us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:44:02.902301 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:44:02.903496 (+ 1195us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:44:02.903501 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:44:02.903814 (+ 313us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:02.904728 (+ 914us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:44:02.904803 (+ 75us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:44:02.907198 (+ 2395us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:44:02.909985 (+ 2787us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:44:02.909996 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:44:02.910012 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:44:02.910402 (+ 390us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:44:02.910883 (+ 481us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:44:02.910887 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:44:02.910889 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:44:02.911125 (+ 236us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:44:02.911852 (+ 727us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:44:02.911859 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:44:02.912141 (+ 282us) client_negotiation.cc:769] Sending connection context
0808 04:44:02.912330 (+ 189us) client_negotiation.cc:240] Negotiation successful
0808 04:44:02.912735 (+ 405us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":381,"mutex_wait_us":514,"spinlock_wait_cycles":45824,"thread_start_us":62,"threads_started":1}
I20260808 04:44:02.913009 7328 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:02.894070 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.240.193:48405 (local address 127.20.240.194:45369)
0808 04:44:02.894419 (+ 349us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:02.894448 (+ 29us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:02.894612 (+ 164us) server_negotiation.cc:407] Connection header received
0808 04:44:02.895482 (+ 870us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:02.895491 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:02.895956 (+ 465us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:02.896299 (+ 343us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:44:02.898543 (+ 2244us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:02.900152 (+ 1609us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:02.902475 (+ 2323us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:02.903313 (+ 838us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:02.903521 (+ 208us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:02.907570 (+ 4049us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:44:02.907578 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:44:02.907598 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:44:02.907638 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:44:02.909793 (+ 2155us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:44:02.910578 (+ 785us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:44:02.910586 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:44:02.910591 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:44:02.910764 (+ 173us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:44:02.911261 (+ 497us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:44:02.911266 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:44:02.911269 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:44:02.911726 (+ 457us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:44:02.911871 (+ 145us) server_negotiation.cc:1035] Waiting for connection context
0808 04:44:02.912502 (+ 631us) server_negotiation.cc:299] Negotiation successful
0808 04:44:02.912805 (+ 303us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":210,"thread_start_us":55,"threads_started":1}
I20260808 04:44:02.913091 7324 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:02.893752 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.195:38511 (local address 127.20.240.193:48755)
0808 04:44:02.894104 (+ 352us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:02.894123 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0808 04:44:02.894236 (+ 113us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:44:02.896465 (+ 2229us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:44:02.896473 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:44:02.897310 (+ 837us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:44:02.898297 (+ 987us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:44:02.898325 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:44:02.900385 (+ 2060us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:44:02.900390 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:44:02.902287 (+ 1897us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:44:02.902301 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:44:02.903514 (+ 1213us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:44:02.903518 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:44:02.903809 (+ 291us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:02.904728 (+ 919us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:44:02.904753 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:44:02.907624 (+ 2871us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:44:02.910297 (+ 2673us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:44:02.910300 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:44:02.910301 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:44:02.910597 (+ 296us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:44:02.911097 (+ 500us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:44:02.911100 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:44:02.911101 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:44:02.911214 (+ 113us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:44:02.911857 (+ 643us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:44:02.911860 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:44:02.912137 (+ 277us) client_negotiation.cc:769] Sending connection context
0808 04:44:02.912330 (+ 193us) client_negotiation.cc:240] Negotiation successful
0808 04:44:02.912826 (+ 496us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":244,"mutex_wait_us":581,"spinlock_wait_cycles":21504,"thread_start_us":73,"threads_started":1}
W20260808 04:44:02.915747 6868 leader_election.cc:341] T 93c519eef7294f839c78331838b51f8e P 17256af032074b1b9b1276bc078bf23f [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer f9f60f08a7dc4fbda63770a3b26a861e (127.20.240.194:45369): Not found: Tablet not found: 93c519eef7294f839c78331838b51f8e
W20260808 04:44:02.916029 6869 leader_election.cc:341] T 93c519eef7294f839c78331838b51f8e P 17256af032074b1b9b1276bc078bf23f [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer d5d9247b9d6e4516ab91bbbdec1c2fb1 (127.20.240.195:38511): Not found: Tablet not found: 93c519eef7294f839c78331838b51f8e
I20260808 04:44:02.916117 6869 leader_election.cc:302] T 93c519eef7294f839c78331838b51f8e P 17256af032074b1b9b1276bc078bf23f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17256af032074b1b9b1276bc078bf23f; no voters: d5d9247b9d6e4516ab91bbbdec1c2fb1, f9f60f08a7dc4fbda63770a3b26a861e
I20260808 04:44:02.916435 7322 raft_consensus.cc:2726] T 93c519eef7294f839c78331838b51f8e P 17256af032074b1b9b1276bc078bf23f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 04:44:03.279793 7324 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:03.279487 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:42631 (local address 127.20.240.193:49451)
0808 04:44:03.279634 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:03.279708 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.240.254:42631: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":58}
I20260808 04:44:03.427409 7329 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:03.426746 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:42631 (local address 127.20.240.194:49991)
0808 04:44:03.427133 (+ 387us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:03.427212 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.240.254:42631: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":290,"thread_start_us":94,"threads_started":1}
I20260808 04:44:03.645962 7330 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:03.645472 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:42631 (local address 127.20.240.195:38325)
0808 04:44:03.645790 (+ 318us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:03.645858 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.240.254:42631: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":226,"thread_start_us":94,"threads_started":1}
I20260808 04:44:04.281123 7332 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:04.280676 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:42631 (local address 127.20.240.193:51473)
0808 04:44:04.280959 (+ 283us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:04.281024 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.240.254:42631: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":202,"thread_start_us":80,"threads_started":1}
I20260808 04:44:04.428644 7333 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:04.428159 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:42631 (local address 127.20.240.194:52049)
0808 04:44:04.428450 (+ 291us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:04.428518 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.240.254:42631: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":199,"thread_start_us":75,"threads_started":1}
I20260808 04:44:04.647401 7335 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:04.646888 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:42631 (local address 127.20.240.195:33689)
0808 04:44:04.647223 (+ 335us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:04.647296 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.240.254:42631: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":252,"thread_start_us":117,"threads_started":1}
I20260808 04:44:05.032672 7336 raft_consensus.cc:482] T 93c519eef7294f839c78331838b51f8e P 17256af032074b1b9b1276bc078bf23f [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 04:44:05.032815 7336 raft_consensus.cc:504] T 93c519eef7294f839c78331838b51f8e P 17256af032074b1b9b1276bc078bf23f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9f60f08a7dc4fbda63770a3b26a861e" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 45369 } } peers { permanent_uuid: "d5d9247b9d6e4516ab91bbbdec1c2fb1" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 38511 } } peers { permanent_uuid: "17256af032074b1b9b1276bc078bf23f" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 33027 } }
I20260808 04:44:05.033378 7336 leader_election.cc:288] T 93c519eef7294f839c78331838b51f8e P 17256af032074b1b9b1276bc078bf23f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f9f60f08a7dc4fbda63770a3b26a861e (127.20.240.194:45369), d5d9247b9d6e4516ab91bbbdec1c2fb1 (127.20.240.195:38511)
W20260808 04:44:05.034459 6869 leader_election.cc:341] T 93c519eef7294f839c78331838b51f8e P 17256af032074b1b9b1276bc078bf23f [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer d5d9247b9d6e4516ab91bbbdec1c2fb1 (127.20.240.195:38511): Not found: Tablet not found: 93c519eef7294f839c78331838b51f8e
W20260808 04:44:05.034610 6868 leader_election.cc:341] T 93c519eef7294f839c78331838b51f8e P 17256af032074b1b9b1276bc078bf23f [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer f9f60f08a7dc4fbda63770a3b26a861e (127.20.240.194:45369): Not found: Tablet not found: 93c519eef7294f839c78331838b51f8e
I20260808 04:44:05.034714 6868 leader_election.cc:302] T 93c519eef7294f839c78331838b51f8e P 17256af032074b1b9b1276bc078bf23f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17256af032074b1b9b1276bc078bf23f; no voters: d5d9247b9d6e4516ab91bbbdec1c2fb1, f9f60f08a7dc4fbda63770a3b26a861e
I20260808 04:44:05.034896 7336 raft_consensus.cc:2726] T 93c519eef7294f839c78331838b51f8e P 17256af032074b1b9b1276bc078bf23f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 04:44:05.282526 7337 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:05.282051 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:42631 (local address 127.20.240.193:38599)
0808 04:44:05.282352 (+ 301us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:05.282415 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.240.254:42631: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":217,"thread_start_us":88,"threads_started":1}
I20260808 04:44:05.430169 7339 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:05.429695 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:42631 (local address 127.20.240.194:54419)
0808 04:44:05.429998 (+ 303us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:05.430069 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.240.254:42631: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":222,"thread_start_us":105,"threads_started":1}
I20260808 04:44:05.648823 7340 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:05.648317 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:42631 (local address 127.20.240.195:53041)
0808 04:44:05.648614 (+ 297us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:05.648682 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.240.254:42631: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":214,"thread_start_us":98,"threads_started":1}
I20260808 04:44:06.283918 7341 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:06.283464 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:42631 (local address 127.20.240.193:39893)
0808 04:44:06.283760 (+ 296us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:06.283820 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.240.254:42631: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":220,"thread_start_us":77,"threads_started":1}
I20260808 04:44:06.431613 7342 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:06.431137 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:42631 (local address 127.20.240.194:35817)
0808 04:44:06.431431 (+ 294us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:06.431509 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.240.254:42631: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":201,"thread_start_us":84,"threads_started":1}
I20260808 04:44:06.650210 7343 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:06.649733 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:42631 (local address 127.20.240.195:50135)
0808 04:44:06.650043 (+ 310us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:06.650105 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.240.254:42631: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":223,"thread_start_us":86,"threads_started":1}
I20260808 04:44:07.219405 7344 raft_consensus.cc:482] T 93c519eef7294f839c78331838b51f8e P 17256af032074b1b9b1276bc078bf23f [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 04:44:07.219559 7344 raft_consensus.cc:504] T 93c519eef7294f839c78331838b51f8e P 17256af032074b1b9b1276bc078bf23f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9f60f08a7dc4fbda63770a3b26a861e" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 45369 } } peers { permanent_uuid: "d5d9247b9d6e4516ab91bbbdec1c2fb1" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 38511 } } peers { permanent_uuid: "17256af032074b1b9b1276bc078bf23f" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 33027 } }
I20260808 04:44:07.220193 7344 leader_election.cc:288] T 93c519eef7294f839c78331838b51f8e P 17256af032074b1b9b1276bc078bf23f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f9f60f08a7dc4fbda63770a3b26a861e (127.20.240.194:45369), d5d9247b9d6e4516ab91bbbdec1c2fb1 (127.20.240.195:38511)
W20260808 04:44:07.221082 6869 leader_election.cc:341] T 93c519eef7294f839c78331838b51f8e P 17256af032074b1b9b1276bc078bf23f [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer d5d9247b9d6e4516ab91bbbdec1c2fb1 (127.20.240.195:38511): Not found: Tablet not found: 93c519eef7294f839c78331838b51f8e
W20260808 04:44:07.221232 6868 leader_election.cc:341] T 93c519eef7294f839c78331838b51f8e P 17256af032074b1b9b1276bc078bf23f [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer f9f60f08a7dc4fbda63770a3b26a861e (127.20.240.194:45369): Not found: Tablet not found: 93c519eef7294f839c78331838b51f8e
I20260808 04:44:07.221342 6868 leader_election.cc:302] T 93c519eef7294f839c78331838b51f8e P 17256af032074b1b9b1276bc078bf23f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17256af032074b1b9b1276bc078bf23f; no voters: d5d9247b9d6e4516ab91bbbdec1c2fb1, f9f60f08a7dc4fbda63770a3b26a861e
I20260808 04:44:07.221540 7344 raft_consensus.cc:2726] T 93c519eef7294f839c78331838b51f8e P 17256af032074b1b9b1276bc078bf23f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 04:44:07.285318 7346 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:07.284804 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:42631 (local address 127.20.240.193:44223)
0808 04:44:07.285070 (+ 266us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:07.285128 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.240.254:42631: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":194,"thread_start_us":92,"threads_started":1}
I20260808 04:44:07.433131 7347 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:07.432600 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:42631 (local address 127.20.240.194:60617)
0808 04:44:07.432919 (+ 319us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:07.433026 (+ 107us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.240.254:42631: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":230,"thread_start_us":85,"threads_started":1}
I20260808 04:44:07.651542 7348 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:07.651072 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:42631 (local address 127.20.240.195:41593)
0808 04:44:07.651364 (+ 292us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:07.651432 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.240.254:42631: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":204,"thread_start_us":83,"threads_started":1}
I20260808 04:44:08.286639 7349 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:08.286213 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:42631 (local address 127.20.240.193:59349)
0808 04:44:08.286482 (+ 269us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:08.286541 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.240.254:42631: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":174,"thread_start_us":79,"threads_started":1}
I20260808 04:44:08.434566 7350 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:08.434039 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:42631 (local address 127.20.240.194:46183)
0808 04:44:08.434398 (+ 359us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:08.434465 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.240.254:42631: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":273,"thread_start_us":83,"threads_started":1}
I20260808 04:44:08.652948 7351 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:08.652446 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:42631 (local address 127.20.240.195:39283)
0808 04:44:08.652771 (+ 325us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:08.652848 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.240.254:42631: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":245,"thread_start_us":76,"threads_started":1}
I20260808 04:44:09.288079 7352 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:09.287525 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:42631 (local address 127.20.240.193:49929)
0808 04:44:09.287893 (+ 368us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:09.287966 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.240.254:42631: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":279,"thread_start_us":85,"threads_started":1}
I20260808 04:44:09.436053 7353 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:09.435531 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:42631 (local address 127.20.240.194:57683)
0808 04:44:09.435868 (+ 337us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:09.435952 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.240.254:42631: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":241,"thread_start_us":148,"threads_started":1}
I20260808 04:44:09.654479 7354 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:09.653909 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:42631 (local address 127.20.240.195:55517)
0808 04:44:09.654273 (+ 364us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:09.654373 (+ 100us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.240.254:42631: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":272,"thread_start_us":107,"threads_started":1}
I20260808 04:44:10.289813 7355 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:10.289024 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:42631 (local address 127.20.240.193:55165)
0808 04:44:10.289567 (+ 543us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:10.289645 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.240.254:42631: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":452,"thread_start_us":327,"threads_started":1}
I20260808 04:44:10.437672 7356 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:10.437037 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:42631 (local address 127.20.240.194:49315)
0808 04:44:10.437477 (+ 440us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:10.437558 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.240.254:42631: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":343,"thread_start_us":156,"threads_started":1}
I20260808 04:44:10.655905 7357 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:10.655388 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:42631 (local address 127.20.240.195:59237)
0808 04:44:10.655684 (+ 296us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:10.655759 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.240.254:42631: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":212,"thread_start_us":90,"threads_started":1}
I20260808 04:44:10.835995 7358 raft_consensus.cc:482] T 93c519eef7294f839c78331838b51f8e P 17256af032074b1b9b1276bc078bf23f [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 04:44:10.836144 7358 raft_consensus.cc:504] T 93c519eef7294f839c78331838b51f8e P 17256af032074b1b9b1276bc078bf23f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9f60f08a7dc4fbda63770a3b26a861e" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 45369 } } peers { permanent_uuid: "d5d9247b9d6e4516ab91bbbdec1c2fb1" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 38511 } } peers { permanent_uuid: "17256af032074b1b9b1276bc078bf23f" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 33027 } }
I20260808 04:44:10.836689 7358 leader_election.cc:288] T 93c519eef7294f839c78331838b51f8e P 17256af032074b1b9b1276bc078bf23f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f9f60f08a7dc4fbda63770a3b26a861e (127.20.240.194:45369), d5d9247b9d6e4516ab91bbbdec1c2fb1 (127.20.240.195:38511)
W20260808 04:44:10.837688 6869 leader_election.cc:341] T 93c519eef7294f839c78331838b51f8e P 17256af032074b1b9b1276bc078bf23f [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer d5d9247b9d6e4516ab91bbbdec1c2fb1 (127.20.240.195:38511): Not found: Tablet not found: 93c519eef7294f839c78331838b51f8e
W20260808 04:44:10.837903 6868 leader_election.cc:341] T 93c519eef7294f839c78331838b51f8e P 17256af032074b1b9b1276bc078bf23f [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer f9f60f08a7dc4fbda63770a3b26a861e (127.20.240.194:45369): Not found: Tablet not found: 93c519eef7294f839c78331838b51f8e
I20260808 04:44:10.838002 6868 leader_election.cc:302] T 93c519eef7294f839c78331838b51f8e P 17256af032074b1b9b1276bc078bf23f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17256af032074b1b9b1276bc078bf23f; no voters: d5d9247b9d6e4516ab91bbbdec1c2fb1, f9f60f08a7dc4fbda63770a3b26a861e
I20260808 04:44:10.838171 7358 raft_consensus.cc:2726] T 93c519eef7294f839c78331838b51f8e P 17256af032074b1b9b1276bc078bf23f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 04:44:11.291426 7359 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:11.290891 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:42631 (local address 127.20.240.193:37785)
0808 04:44:11.291248 (+ 357us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:11.291320 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.240.254:42631: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":244,"thread_start_us":85,"threads_started":1}
I20260808 04:44:11.439177 7360 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:11.438662 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:42631 (local address 127.20.240.194:46861)
0808 04:44:11.438993 (+ 331us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:11.439069 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.240.254:42631: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":232,"thread_start_us":82,"threads_started":1}
I20260808 04:44:11.657658 7361 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:11.657034 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:42631 (local address 127.20.240.195:39709)
0808 04:44:11.657438 (+ 404us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:11.657516 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.240.254:42631: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":294,"thread_start_us":163,"threads_started":1}
I20260808 04:44:12.292917 7362 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:12.292457 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:42631 (local address 127.20.240.193:57021)
0808 04:44:12.292745 (+ 288us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:12.292817 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.240.254:42631: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":208,"thread_start_us":86,"threads_started":1}
I20260808 04:44:12.440773 7363 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:12.440239 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:42631 (local address 127.20.240.194:50633)
0808 04:44:12.440593 (+ 354us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:12.440665 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.240.254:42631: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":260,"thread_start_us":107,"threads_started":1}
I20260808 04:44:12.659138 7364 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:12.658567 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:42631 (local address 127.20.240.195:58747)
0808 04:44:12.658966 (+ 399us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:12.659035 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.240.254:42631: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":305,"thread_start_us":100,"threads_started":1}
I20260808 04:44:13.294606 7365 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:13.294021 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:42631 (local address 127.20.240.193:34115)
0808 04:44:13.294428 (+ 407us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:13.294498 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.240.254:42631: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":271,"thread_start_us":146,"threads_started":1}
I20260808 04:44:13.443465 7366 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:13.442442 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:42631 (local address 127.20.240.194:44637)
0808 04:44:13.442815 (+ 373us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:13.442946 (+ 131us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.240.254:42631: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":273,"thread_start_us":96,"threads_started":1}
I20260808 04:44:13.660665 7367 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:13.660172 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:42631 (local address 127.20.240.195:56595)
0808 04:44:13.660486 (+ 314us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:13.660553 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.240.254:42631: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":226,"thread_start_us":98,"threads_started":1}
I20260808 04:44:14.296185 7368 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:14.295640 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:42631 (local address 127.20.240.193:47709)
0808 04:44:14.295975 (+ 335us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:14.296053 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.240.254:42631: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":250,"thread_start_us":109,"threads_started":1}
I20260808 04:44:14.445298 7369 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:14.444622 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:42631 (local address 127.20.240.194:33217)
0808 04:44:14.445008 (+ 386us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:14.445097 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.240.254:42631: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":296,"thread_start_us":86,"threads_started":1}
I20260808 04:44:14.662210 7370 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:14.661732 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:42631 (local address 127.20.240.195:58759)
0808 04:44:14.662032 (+ 300us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:14.662100 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.240.254:42631: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":220,"thread_start_us":89,"threads_started":1}
I20260808 04:44:15.297802 7371 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:15.297292 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:42631 (local address 127.20.240.193:56845)
0808 04:44:15.297622 (+ 330us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:15.297697 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.240.254:42631: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":235,"thread_start_us":103,"threads_started":1}
I20260808 04:44:15.446954 7372 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:15.446353 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:42631 (local address 127.20.240.194:50929)
0808 04:44:15.446700 (+ 347us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:15.446846 (+ 146us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.240.254:42631: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":255,"thread_start_us":103,"threads_started":1}
I20260808 04:44:15.663790 7374 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:15.663258 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:42631 (local address 127.20.240.195:57211)
0808 04:44:15.663618 (+ 360us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:15.663682 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.240.254:42631: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":253,"thread_start_us":135,"threads_started":1}
I20260808 04:44:16.299816 7375 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:16.299160 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:42631 (local address 127.20.240.193:35989)
0808 04:44:16.299574 (+ 414us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:16.299671 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.240.254:42631: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":278,"thread_start_us":94,"threads_started":1}
I20260808 04:44:16.366739 7377 raft_consensus.cc:482] T 93c519eef7294f839c78331838b51f8e P 17256af032074b1b9b1276bc078bf23f [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 04:44:16.367146 7377 raft_consensus.cc:504] T 93c519eef7294f839c78331838b51f8e P 17256af032074b1b9b1276bc078bf23f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9f60f08a7dc4fbda63770a3b26a861e" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 45369 } } peers { permanent_uuid: "d5d9247b9d6e4516ab91bbbdec1c2fb1" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 38511 } } peers { permanent_uuid: "17256af032074b1b9b1276bc078bf23f" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 33027 } }
I20260808 04:44:16.367871 7377 leader_election.cc:288] T 93c519eef7294f839c78331838b51f8e P 17256af032074b1b9b1276bc078bf23f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f9f60f08a7dc4fbda63770a3b26a861e (127.20.240.194:45369), d5d9247b9d6e4516ab91bbbdec1c2fb1 (127.20.240.195:38511)
W20260808 04:44:16.369088 6868 leader_election.cc:341] T 93c519eef7294f839c78331838b51f8e P 17256af032074b1b9b1276bc078bf23f [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer f9f60f08a7dc4fbda63770a3b26a861e (127.20.240.194:45369): Not found: Tablet not found: 93c519eef7294f839c78331838b51f8e
W20260808 04:44:16.369530 6869 leader_election.cc:341] T 93c519eef7294f839c78331838b51f8e P 17256af032074b1b9b1276bc078bf23f [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer d5d9247b9d6e4516ab91bbbdec1c2fb1 (127.20.240.195:38511): Not found: Tablet not found: 93c519eef7294f839c78331838b51f8e
I20260808 04:44:16.369626 6869 leader_election.cc:302] T 93c519eef7294f839c78331838b51f8e P 17256af032074b1b9b1276bc078bf23f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17256af032074b1b9b1276bc078bf23f; no voters: d5d9247b9d6e4516ab91bbbdec1c2fb1, f9f60f08a7dc4fbda63770a3b26a861e
I20260808 04:44:16.369855 7377 raft_consensus.cc:2726] T 93c519eef7294f839c78331838b51f8e P 17256af032074b1b9b1276bc078bf23f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 04:44:16.448487 7378 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:16.448015 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:42631 (local address 127.20.240.194:56291)
0808 04:44:16.448337 (+ 322us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:16.448390 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.240.254:42631: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":254,"thread_start_us":104,"threads_started":1}
I20260808 04:44:16.650296 21443 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu with pid 6802
I20260808 04:44:16.659507 21443 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu with pid 7003
I20260808 04:44:16.665371 7379 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:16.664859 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:42631 (local address 127.20.240.195:51899)
0808 04:44:16.665204 (+ 345us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:16.665269 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.240.254:42631: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":232,"thread_start_us":147,"threads_started":1}
I20260808 04:44:16.668222 21443 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu with pid 7157
2026-08-08T04:44:16Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedTSK (59964 ms)
[----------] 30 tests from SecurityITest (256041 ms total)
[----------] 6 tests from EncryptionPolicyTest
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/0
Loading random data
Initializing database '/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786164000593138-21443-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 04:44:16 dist-test-slave-vxj2 krb5kdc[7382](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 04:44:16 dist-test-slave-vxj2 krb5kdc[7382](info): set up 2 sockets
Aug 08 04:44:16 dist-test-slave-vxj2 krb5kdc[7382](info): commencing operation
krb5kdc: starting...
W20260808 04:44:17.808745 21443 mini_kdc.cc:121] Time spent starting KDC: real 1.113s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786164000593138-21443-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786164000593138-21443-0/krb5kdc/test-user.keytab.
Aug 08 04:44:17 dist-test-slave-vxj2 krb5kdc[7382](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164257, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T04:44:17Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T04:44:17Z Disabled control of system clock
WARNING: no policy specified for kudu/127.20.240.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.240.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.240.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.254.keytab.
Entry for principal kudu/127.20.240.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.254.keytab.
I20260808 04:44:17.958060 21443 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
/tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786164000593138-21443-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786164000593138-21443-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786164000593138-21443-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786164000593138-21443-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.240.254:33339
--webserver_interface=127.20.240.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.254.keytab
--principal=kudu/127.20.240.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.240.212:37607
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.240.254:33339
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786164000593138-21443-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786164000593138-21443-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786164000593138-21443-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 04:44:18.084050 7398 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:44:18.084442 7398 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:44:18.084530 7398 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:44:18.088995 7398 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 04:44:18.089126 7398 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:44:18.089203 7398 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:44:18.089234 7398 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 04:44:18.089274 7398 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 04:44:18.096278 7398 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.240.212:37607
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786164000593138-21443-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786164000593138-21443-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.240.254:33339
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.254.keytab
--principal=kudu/127.20.240.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.240.254:33339
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786164000593138-21443-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.240.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7398
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786164000593138-21443-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 04:05:18 UTC on ccycloud.quasar-drfdgt.root.comops.site
build id 4574101
I20260808 04:44:18.097633 7398 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:44:18.098793 7398 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:44:18.109220 7404 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:44:18.109227 7405 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:44:18.109329 7398 server_base.cc:1034] running on GCE node
W20260808 04:44:18.109227 7407 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:44:18.110172 7398 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:44:18.111423 7398 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:44:18.112623 7398 hybrid_clock.cc:648] HybridClock initialized: now 1786164258112607 us; error 30 us; skew 500 ppm
Aug 08 04:44:18 dist-test-slave-vxj2 krb5kdc[7382](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164258, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.240.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:44:18.116554 7398 init.cc:377] Logged in from keytab as kudu/127.20.240.254@KRBTEST.COM (short username kudu)
I20260808 04:44:18.117810 7398 webserver.cc:460] Webserver started at http://127.20.240.254:36749/ using document root <none> and password file <none>
I20260808 04:44:18.118516 7398 fs_manager.cc:359] Metadata directory not provided
I20260808 04:44:18.118597 7398 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:44:18.118856 7398 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 04:44:18.121516 7398 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786164000593138-21443-0/minicluster-data/master-0/data/instance:
uuid: "886f2ed093da421293512a49124ba082"
format_stamp: "Formatted at 2026-08-08 04:44:18 on dist-test-slave-vxj2"
server_key: "a13f0e910e74498ff98c08326e94928c"
server_key_iv: "55d1590f6297939f20931b66148e126d"
server_key_version: "encryptionkey@0"
I20260808 04:44:18.122253 7398 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786164000593138-21443-0/minicluster-data/master-0/wal/instance:
uuid: "886f2ed093da421293512a49124ba082"
format_stamp: "Formatted at 2026-08-08 04:44:18 on dist-test-slave-vxj2"
server_key: "a13f0e910e74498ff98c08326e94928c"
server_key_iv: "55d1590f6297939f20931b66148e126d"
server_key_version: "encryptionkey@0"
I20260808 04:44:18.127441 7398 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260808 04:44:18.131310 7415 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:44:18.133111 7398 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.000s
I20260808 04:44:18.133479 7398 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786164000593138-21443-0/minicluster-data/master-0/data,/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786164000593138-21443-0/minicluster-data/master-0/wal
uuid: "886f2ed093da421293512a49124ba082"
format_stamp: "Formatted at 2026-08-08 04:44:18 on dist-test-slave-vxj2"
server_key: "a13f0e910e74498ff98c08326e94928c"
server_key_iv: "55d1590f6297939f20931b66148e126d"
server_key_version: "encryptionkey@0"
I20260808 04:44:18.133646 7398 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786164000593138-21443-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786164000593138-21443-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786164000593138-21443-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:44:18.147063 7398 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:44:18.151712 7398 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:44:18.151997 7398 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:44:18.161051 7398 rpc_server.cc:307] RPC server started. Bound to: 127.20.240.254:33339
I20260808 04:44:18.161088 7471 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.240.254:33339 every 8 connection(s)
I20260808 04:44:18.162318 7398 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786164000593138-21443-0/minicluster-data/master-0/data/info.pb
I20260808 04:44:18.165742 7475 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:44:18.166981 21443 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu as pid 7398
I20260808 04:44:18.167191 21443 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786164000593138-21443-0/minicluster-data/master-0/wal/instance
I20260808 04:44:18.167526 21443 external_mini_cluster.cc:1428] Setting key 8b1524bb245e63a5d3a6221844beb8a6
I20260808 04:44:18.173610 7475 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 886f2ed093da421293512a49124ba082: Bootstrap starting.
I20260808 04:44:18.176963 7475 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 886f2ed093da421293512a49124ba082: Neither blocks nor log segments found. Creating new log.
I20260808 04:44:18.177929 7475 log.cc:824] T 00000000000000000000000000000000 P 886f2ed093da421293512a49124ba082: Log is configured to *not* fsync() on all Append() calls
Aug 08 04:44:18 dist-test-slave-vxj2 krb5kdc[7382](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164257, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.240.254@KRBTEST.COM
I20260808 04:44:18.180492 7475 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 886f2ed093da421293512a49124ba082: No bootstrap required, opened a new log
I20260808 04:44:18.184774 7478 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:18.169349 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48424 (local address 127.20.240.254:33339)
0808 04:44:18.169859 (+ 510us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:18.169881 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:18.169930 (+ 49us) server_negotiation.cc:407] Connection header received
0808 04:44:18.170828 (+ 898us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:18.170853 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:18.171333 (+ 480us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:18.171750 (+ 417us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:44:18.172586 (+ 836us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:18.174111 (+ 1525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:18.175261 (+ 1150us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:18.176005 (+ 744us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:18.176196 (+ 191us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:18.179468 (+ 3272us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:44:18.179475 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:44:18.179494 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:44:18.179525 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:44:18.181555 (+ 2030us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:44:18.182106 (+ 551us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:44:18.182119 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:44:18.182124 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:44:18.182262 (+ 138us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:44:18.182591 (+ 329us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:44:18.182596 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:44:18.182598 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:44:18.183052 (+ 454us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:44:18.183263 (+ 211us) server_negotiation.cc:1035] Waiting for connection context
0808 04:44:18.183613 (+ 350us) server_negotiation.cc:299] Negotiation successful
0808 04:44:18.183943 (+ 330us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":336,"thread_start_us":141,"threads_started":1}
I20260808 04:44:18.185081 7475 raft_consensus.cc:348] T 00000000000000000000000000000000 P 886f2ed093da421293512a49124ba082 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "886f2ed093da421293512a49124ba082" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 33339 } }
I20260808 04:44:18.185443 7475 raft_consensus.cc:374] T 00000000000000000000000000000000 P 886f2ed093da421293512a49124ba082 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:44:18.185534 7475 raft_consensus.cc:729] T 00000000000000000000000000000000 P 886f2ed093da421293512a49124ba082 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 886f2ed093da421293512a49124ba082, State: Initialized, Role: FOLLOWER
I20260808 04:44:18.186056 7475 consensus_queue.cc:260] T 00000000000000000000000000000000 P 886f2ed093da421293512a49124ba082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "886f2ed093da421293512a49124ba082" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 33339 } }
I20260808 04:44:18.186235 7475 raft_consensus.cc:388] T 00000000000000000000000000000000 P 886f2ed093da421293512a49124ba082 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 04:44:18.186335 7475 raft_consensus.cc:482] T 00000000000000000000000000000000 P 886f2ed093da421293512a49124ba082 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 04:44:18.186504 7475 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 886f2ed093da421293512a49124ba082 [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:44:18.188580 7475 raft_consensus.cc:504] T 00000000000000000000000000000000 P 886f2ed093da421293512a49124ba082 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "886f2ed093da421293512a49124ba082" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 33339 } }
I20260808 04:44:18.189038 7475 leader_election.cc:302] T 00000000000000000000000000000000 P 886f2ed093da421293512a49124ba082 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 886f2ed093da421293512a49124ba082; no voters:
I20260808 04:44:18.189503 7475 leader_election.cc:288] T 00000000000000000000000000000000 P 886f2ed093da421293512a49124ba082 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 04:44:18.189675 7480 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 886f2ed093da421293512a49124ba082 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 04:44:18.189927 7480 raft_consensus.cc:686] T 00000000000000000000000000000000 P 886f2ed093da421293512a49124ba082 [term 1 LEADER]: Becoming Leader. State: Replica: 886f2ed093da421293512a49124ba082, State: Running, Role: LEADER
I20260808 04:44:18.190316 7480 consensus_queue.cc:237] T 00000000000000000000000000000000 P 886f2ed093da421293512a49124ba082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "886f2ed093da421293512a49124ba082" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 33339 } }
I20260808 04:44:18.191210 7475 sys_catalog.cc:564] T 00000000000000000000000000000000 P 886f2ed093da421293512a49124ba082 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 04:44:18.192446 7484 sys_catalog.cc:455] T 00000000000000000000000000000000 P 886f2ed093da421293512a49124ba082 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 886f2ed093da421293512a49124ba082. Latest consensus state: current_term: 1 leader_uuid: "886f2ed093da421293512a49124ba082" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "886f2ed093da421293512a49124ba082" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 33339 } } }
I20260808 04:44:18.192461 7483 sys_catalog.cc:455] T 00000000000000000000000000000000 P 886f2ed093da421293512a49124ba082 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "886f2ed093da421293512a49124ba082" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "886f2ed093da421293512a49124ba082" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 33339 } } }
I20260808 04:44:18.192646 7483 sys_catalog.cc:458] T 00000000000000000000000000000000 P 886f2ed093da421293512a49124ba082 [sys.catalog]: This master's current role is: LEADER
I20260808 04:44:18.192649 7484 sys_catalog.cc:458] T 00000000000000000000000000000000 P 886f2ed093da421293512a49124ba082 [sys.catalog]: This master's current role is: LEADER
I20260808 04:44:18.193121 7492 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 04:44:18.196823 7492 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 04:44:18.203859 7492 catalog_manager.cc:1347] Generated new cluster ID: e5eab3e8c0cc46d4bd5cf5d09efba81a
I20260808 04:44:18.203984 7492 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 04:44:18.226337 7492 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 04:44:18.227581 7492 catalog_manager.cc:1504] Loading token signing keys...
I20260808 04:44:18.242094 7492 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 886f2ed093da421293512a49124ba082: Generated new TSK 0
I20260808 04:44:18.243152 7492 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.20.240.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.240.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.240.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.193.keytab.
Entry for principal kudu/127.20.240.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.193.keytab.
I20260808 04:44:18.301211 21443 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
/tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786164000593138-21443-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786164000593138-21443-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786164000593138-21443-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786164000593138-21443-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.240.193:0
--local_ip_for_outbound_sockets=127.20.240.193
--webserver_interface=127.20.240.193
--webserver_port=0
--tserver_master_addrs=127.20.240.254:33339
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.193.keytab
--principal=kudu/127.20.240.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.240.212:37607
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786164000593138-21443-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786164000593138-21443-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786164000593138-21443-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 04:44:18.452381 7505 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:44:18.452710 7505 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:44:18.452756 7505 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:44:18.457257 7505 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:44:18.457348 7505 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:44:18.457441 7505 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.240.193
I20260808 04:44:18.463488 7505 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.240.212:37607
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786164000593138-21443-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786164000593138-21443-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.193.keytab
--principal=kudu/127.20.240.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.240.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786164000593138-21443-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.240.193
--webserver_port=0
--tserver_master_addrs=127.20.240.254:33339
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7505
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.240.193
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786164000593138-21443-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 04:05:18 UTC on ccycloud.quasar-drfdgt.root.comops.site
build id 4574101
I20260808 04:44:18.464756 7505 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:44:18.466285 7505 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:44:18.478189 7512 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:44:18.478375 7514 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:44:18.478402 7511 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:44:18.478909 7505 server_base.cc:1034] running on GCE node
I20260808 04:44:18.479406 7505 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:44:18.480204 7505 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:44:18.481401 7505 hybrid_clock.cc:648] HybridClock initialized: now 1786164258481379 us; error 35 us; skew 500 ppm
Aug 08 04:44:18 dist-test-slave-vxj2 krb5kdc[7382](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164258, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.240.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:44:18.485235 7505 init.cc:377] Logged in from keytab as kudu/127.20.240.193@KRBTEST.COM (short username kudu)
I20260808 04:44:18.486433 7505 webserver.cc:460] Webserver started at http://127.20.240.193:43495/ using document root <none> and password file <none>
I20260808 04:44:18.487253 7505 fs_manager.cc:359] Metadata directory not provided
I20260808 04:44:18.487403 7505 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:44:18.487709 7505 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 04:44:18.490612 7505 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786164000593138-21443-0/minicluster-data/ts-0/data/instance:
uuid: "2665e7dae8d4464c81342eb3876e18a9"
format_stamp: "Formatted at 2026-08-08 04:44:18 on dist-test-slave-vxj2"
server_key: "ce998ba82837663804c572f4d5baff5b"
server_key_iv: "9eb989ca23dbec9ce423657b45578208"
server_key_version: "encryptionkey@0"
I20260808 04:44:18.491462 7505 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786164000593138-21443-0/minicluster-data/ts-0/wal/instance:
uuid: "2665e7dae8d4464c81342eb3876e18a9"
format_stamp: "Formatted at 2026-08-08 04:44:18 on dist-test-slave-vxj2"
server_key: "ce998ba82837663804c572f4d5baff5b"
server_key_iv: "9eb989ca23dbec9ce423657b45578208"
server_key_version: "encryptionkey@0"
I20260808 04:44:18.496387 7505 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260808 04:44:18.499401 7522 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:44:18.501048 7505 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260808 04:44:18.501263 7505 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786164000593138-21443-0/minicluster-data/ts-0/data,/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786164000593138-21443-0/minicluster-data/ts-0/wal
uuid: "2665e7dae8d4464c81342eb3876e18a9"
format_stamp: "Formatted at 2026-08-08 04:44:18 on dist-test-slave-vxj2"
server_key: "ce998ba82837663804c572f4d5baff5b"
server_key_iv: "9eb989ca23dbec9ce423657b45578208"
server_key_version: "encryptionkey@0"
I20260808 04:44:18.501416 7505 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786164000593138-21443-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786164000593138-21443-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786164000593138-21443-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:44:18.517946 7505 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:44:18.521809 7505 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:44:18.522065 7505 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:44:18.522751 7505 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 04:44:18.523711 7505 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 04:44:18.523806 7505 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 04:44:18.523903 7505 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 04:44:18.523957 7505 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 04:44:18.534893 7505 rpc_server.cc:307] RPC server started. Bound to: 127.20.240.193:38343
I20260808 04:44:18.534912 7654 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.240.193:38343 every 8 connection(s)
I20260808 04:44:18.535894 7505 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786164000593138-21443-0/minicluster-data/ts-0/data/info.pb
I20260808 04:44:18.541136 21443 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu as pid 7505
I20260808 04:44:18.541323 21443 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786164000593138-21443-0/minicluster-data/ts-0/wal/instance
I20260808 04:44:18.541700 21443 external_mini_cluster.cc:1428] Setting key e4b3a182021d4c122eef58deff90d571
Aug 08 04:44:18 dist-test-slave-vxj2 krb5kdc[7382](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164258, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.240.193@KRBTEST.COM for kudu/127.20.240.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.20.240.194@KRBTEST.COM; defaulting to no policy
I20260808 04:44:18.553773 7478 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:18.537878 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.240.193:47477 (local address 127.20.240.254:33339)
0808 04:44:18.538109 (+ 231us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:18.538115 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:18.539203 (+ 1088us) server_negotiation.cc:407] Connection header received
0808 04:44:18.540637 (+ 1434us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:18.540640 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:18.540701 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:18.540787 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:44:18.542610 (+ 1823us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:18.543484 (+ 874us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:18.545692 (+ 2208us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:18.545956 (+ 264us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:18.546103 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:18.549492 (+ 3389us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:44:18.549496 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:44:18.549498 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:44:18.549531 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:44:18.551158 (+ 1627us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:44:18.551846 (+ 688us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:44:18.551849 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:44:18.551853 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:44:18.551942 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:44:18.552334 (+ 392us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:44:18.552337 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:44:18.552339 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:44:18.552604 (+ 265us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:44:18.552719 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0808 04:44:18.553372 (+ 653us) server_negotiation.cc:299] Negotiation successful
0808 04:44:18.553580 (+ 208us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260808 04:44:18.554668 7657 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:18.538413 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:33339 (local address 127.20.240.193:47477)
0808 04:44:18.538959 (+ 546us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:18.539080 (+ 121us) client_negotiation.cc:174] Beginning negotiation
0808 04:44:18.540398 (+ 1318us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:44:18.541103 (+ 705us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:44:18.541114 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:44:18.541694 (+ 580us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:44:18.542431 (+ 737us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:44:18.542453 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:44:18.543726 (+ 1273us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:44:18.543730 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:44:18.545394 (+ 1664us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:44:18.545413 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:44:18.546173 (+ 760us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:44:18.546177 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:44:18.546415 (+ 238us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:18.547151 (+ 736us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:44:18.547170 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:44:18.549234 (+ 2064us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:44:18.551348 (+ 2114us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:44:18.551356 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:44:18.551378 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:44:18.551713 (+ 335us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:44:18.552043 (+ 330us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:44:18.552046 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:44:18.552048 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:44:18.552219 (+ 171us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:44:18.552719 (+ 500us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:44:18.552730 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:44:18.553041 (+ 311us) client_negotiation.cc:769] Sending connection context
0808 04:44:18.553314 (+ 273us) client_negotiation.cc:240] Negotiation successful
0808 04:44:18.553710 (+ 396us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":271,"thread_start_us":110,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.240.194@KRBTEST.COM" created.
I20260808 04:44:18.556252 7655 heartbeater.cc:347] Connected to a master server at 127.20.240.254:33339
I20260808 04:44:18.556540 7655 heartbeater.cc:464] Registering TS with master...
I20260808 04:44:18.557322 7655 heartbeater.cc:511] Master 127.20.240.254:33339 requested a full tablet report, sending...
I20260808 04:44:18.560113 7434 ts_manager.cc:194] Registered new tserver with Master: 2665e7dae8d4464c81342eb3876e18a9 (127.20.240.193:38343)
I20260808 04:44:18.561968 7434 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.240.193@KRBTEST.COM'} at 127.20.240.193:47477
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.240.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.194.keytab.
Entry for principal kudu/127.20.240.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.194.keytab.
I20260808 04:44:18.579896 21443 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
/tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786164000593138-21443-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786164000593138-21443-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786164000593138-21443-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786164000593138-21443-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.240.194:0
--local_ip_for_outbound_sockets=127.20.240.194
--webserver_interface=127.20.240.194
--webserver_port=0
--tserver_master_addrs=127.20.240.254:33339
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.194.keytab
--principal=kudu/127.20.240.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.240.212:37607
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786164000593138-21443-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786164000593138-21443-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786164000593138-21443-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 04:44:18.709527 7660 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:44:18.709852 7660 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:44:18.709900 7660 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:44:18.714349 7660 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:44:18.714439 7660 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:44:18.714505 7660 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.240.194
I20260808 04:44:18.720463 7660 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.240.212:37607
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786164000593138-21443-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786164000593138-21443-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.194.keytab
--principal=kudu/127.20.240.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.240.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786164000593138-21443-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.240.194
--webserver_port=0
--tserver_master_addrs=127.20.240.254:33339
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7660
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.240.194
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786164000593138-21443-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 04:05:18 UTC on ccycloud.quasar-drfdgt.root.comops.site
build id 4574101
I20260808 04:44:18.721719 7660 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:44:18.722787 7660 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:44:18.734092 7668 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:44:18.734043 7670 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:44:18.734054 7667 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:44:18.734479 7660 server_base.cc:1034] running on GCE node
I20260808 04:44:18.734943 7660 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:44:18.735703 7660 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:44:18.736937 7660 hybrid_clock.cc:648] HybridClock initialized: now 1786164258736919 us; error 36 us; skew 500 ppm
Aug 08 04:44:18 dist-test-slave-vxj2 krb5kdc[7382](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164258, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.240.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:44:18.740173 7660 init.cc:377] Logged in from keytab as kudu/127.20.240.194@KRBTEST.COM (short username kudu)
I20260808 04:44:18.741144 7660 webserver.cc:460] Webserver started at http://127.20.240.194:34533/ using document root <none> and password file <none>
I20260808 04:44:18.741875 7660 fs_manager.cc:359] Metadata directory not provided
I20260808 04:44:18.741943 7660 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:44:18.742177 7660 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 04:44:18.744426 7660 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786164000593138-21443-0/minicluster-data/ts-1/data/instance:
uuid: "d92192205f154e4c83a009638c9fdb8e"
format_stamp: "Formatted at 2026-08-08 04:44:18 on dist-test-slave-vxj2"
server_key: "34a5e3dd86b7c4e15d60f6f070d0f46e"
server_key_iv: "d95f1c32c3fa1503486693ca5a81196b"
server_key_version: "encryptionkey@0"
I20260808 04:44:18.745047 7660 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786164000593138-21443-0/minicluster-data/ts-1/wal/instance:
uuid: "d92192205f154e4c83a009638c9fdb8e"
format_stamp: "Formatted at 2026-08-08 04:44:18 on dist-test-slave-vxj2"
server_key: "34a5e3dd86b7c4e15d60f6f070d0f46e"
server_key_iv: "d95f1c32c3fa1503486693ca5a81196b"
server_key_version: "encryptionkey@0"
I20260808 04:44:18.749289 7660 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260808 04:44:18.752096 7677 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:44:18.753738 7660 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.003s
I20260808 04:44:18.753911 7660 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786164000593138-21443-0/minicluster-data/ts-1/data,/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786164000593138-21443-0/minicluster-data/ts-1/wal
uuid: "d92192205f154e4c83a009638c9fdb8e"
format_stamp: "Formatted at 2026-08-08 04:44:18 on dist-test-slave-vxj2"
server_key: "34a5e3dd86b7c4e15d60f6f070d0f46e"
server_key_iv: "d95f1c32c3fa1503486693ca5a81196b"
server_key_version: "encryptionkey@0"
I20260808 04:44:18.754055 7660 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786164000593138-21443-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786164000593138-21443-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786164000593138-21443-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:44:18.777012 7660 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:44:18.780858 7660 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:44:18.781095 7660 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:44:18.781898 7660 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 04:44:18.782835 7660 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 04:44:18.782886 7660 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 04:44:18.782929 7660 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 04:44:18.782944 7660 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 04:44:18.793392 7660 rpc_server.cc:307] RPC server started. Bound to: 127.20.240.194:37119
I20260808 04:44:18.793426 7803 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.240.194:37119 every 8 connection(s)
I20260808 04:44:18.794564 7660 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786164000593138-21443-0/minicluster-data/ts-1/data/info.pb
I20260808 04:44:18.799010 21443 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu as pid 7660
I20260808 04:44:18.799134 21443 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786164000593138-21443-0/minicluster-data/ts-1/wal/instance
I20260808 04:44:18.799444 21443 external_mini_cluster.cc:1428] Setting key 1e8fc9f7ac9deecb774adcda5afade44
Aug 08 04:44:18 dist-test-slave-vxj2 krb5kdc[7382](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164258, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.240.194@KRBTEST.COM for kudu/127.20.240.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.20.240.195@KRBTEST.COM; defaulting to no policy
I20260808 04:44:18.811635 7478 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:18.796660 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.240.194:51469 (local address 127.20.240.254:33339)
0808 04:44:18.796819 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:18.796823 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:18.797808 (+ 985us) server_negotiation.cc:407] Connection header received
0808 04:44:18.799352 (+ 1544us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:18.799356 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:18.799428 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:18.799515 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:44:18.800888 (+ 1373us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:18.801727 (+ 839us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:18.803172 (+ 1445us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:18.803401 (+ 229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:18.803504 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:18.807345 (+ 3841us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:44:18.807348 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:44:18.807350 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:44:18.807381 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:44:18.809024 (+ 1643us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:44:18.809747 (+ 723us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:44:18.809751 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:44:18.809752 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:44:18.809876 (+ 124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:44:18.810331 (+ 455us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:44:18.810339 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:44:18.810340 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:44:18.810551 (+ 211us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:44:18.810671 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0808 04:44:18.811291 (+ 620us) server_negotiation.cc:299] Negotiation successful
0808 04:44:18.811446 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260808 04:44:18.813270 7806 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:18.797068 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:33339 (local address 127.20.240.194:51469)
0808 04:44:18.797643 (+ 575us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:18.797688 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0808 04:44:18.799018 (+ 1330us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:44:18.799703 (+ 685us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:44:18.799710 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:44:18.800200 (+ 490us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:44:18.800717 (+ 517us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:44:18.800731 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:44:18.801859 (+ 1128us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:44:18.801862 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:44:18.803002 (+ 1140us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:44:18.803019 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:44:18.803591 (+ 572us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:44:18.803597 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:44:18.803841 (+ 244us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:18.804603 (+ 762us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:44:18.804630 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:44:18.806926 (+ 2296us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:44:18.809233 (+ 2307us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:44:18.809241 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:44:18.809264 (+ 23us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:44:18.809610 (+ 346us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:44:18.809998 (+ 388us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:44:18.810003 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:44:18.810008 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:44:18.810216 (+ 208us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:44:18.810669 (+ 453us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:44:18.810678 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:44:18.811011 (+ 333us) client_negotiation.cc:769] Sending connection context
0808 04:44:18.811220 (+ 209us) client_negotiation.cc:240] Negotiation successful
0808 04:44:18.811608 (+ 388us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":388,"thread_start_us":155,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.240.195@KRBTEST.COM" created.
I20260808 04:44:18.816295 7804 heartbeater.cc:347] Connected to a master server at 127.20.240.254:33339
I20260808 04:44:18.816682 7804 heartbeater.cc:464] Registering TS with master...
I20260808 04:44:18.817451 7804 heartbeater.cc:511] Master 127.20.240.254:33339 requested a full tablet report, sending...
I20260808 04:44:18.818936 7434 ts_manager.cc:194] Registered new tserver with Master: d92192205f154e4c83a009638c9fdb8e (127.20.240.194:37119)
I20260808 04:44:18.819608 7434 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.240.194@KRBTEST.COM'} at 127.20.240.194:51469
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.240.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.195.keytab.
Entry for principal kudu/127.20.240.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.195.keytab.
I20260808 04:44:18.833979 21443 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
/tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786164000593138-21443-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786164000593138-21443-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786164000593138-21443-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786164000593138-21443-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.240.195:0
--local_ip_for_outbound_sockets=127.20.240.195
--webserver_interface=127.20.240.195
--webserver_port=0
--tserver_master_addrs=127.20.240.254:33339
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.195.keytab
--principal=kudu/127.20.240.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.240.212:37607
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786164000593138-21443-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786164000593138-21443-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786164000593138-21443-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 04:44:18.962239 7809 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:44:18.962559 7809 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:44:18.962607 7809 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:44:18.967090 7809 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:44:18.967181 7809 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:44:18.967247 7809 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.240.195
I20260808 04:44:18.973452 7809 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.240.212:37607
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786164000593138-21443-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786164000593138-21443-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.195.keytab
--principal=kudu/127.20.240.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.240.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786164000593138-21443-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.240.195
--webserver_port=0
--tserver_master_addrs=127.20.240.254:33339
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7809
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.240.195
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786164000593138-21443-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 04:05:18 UTC on ccycloud.quasar-drfdgt.root.comops.site
build id 4574101
I20260808 04:44:18.974706 7809 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:44:18.975859 7809 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:44:18.987355 7814 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:44:18.987362 7817 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:44:18.987385 7815 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:44:18.987965 7809 server_base.cc:1034] running on GCE node
I20260808 04:44:18.988490 7809 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:44:18.989377 7809 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:44:18.990813 7809 hybrid_clock.cc:648] HybridClock initialized: now 1786164258990731 us; error 86 us; skew 500 ppm
Aug 08 04:44:18 dist-test-slave-vxj2 krb5kdc[7382](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164258, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.240.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:44:18.994586 7809 init.cc:377] Logged in from keytab as kudu/127.20.240.195@KRBTEST.COM (short username kudu)
I20260808 04:44:18.995731 7809 webserver.cc:460] Webserver started at http://127.20.240.195:36393/ using document root <none> and password file <none>
I20260808 04:44:18.996376 7809 fs_manager.cc:359] Metadata directory not provided
I20260808 04:44:18.996449 7809 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:44:18.996695 7809 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 04:44:18.999171 7809 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786164000593138-21443-0/minicluster-data/ts-2/data/instance:
uuid: "591611101beb46c3a30f23198362e599"
format_stamp: "Formatted at 2026-08-08 04:44:18 on dist-test-slave-vxj2"
server_key: "ff95517c76efb57af73deefe0140a54f"
server_key_iv: "d6a53ec63773c64c85de9a2b8d015269"
server_key_version: "encryptionkey@0"
I20260808 04:44:18.999917 7809 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786164000593138-21443-0/minicluster-data/ts-2/wal/instance:
uuid: "591611101beb46c3a30f23198362e599"
format_stamp: "Formatted at 2026-08-08 04:44:18 on dist-test-slave-vxj2"
server_key: "ff95517c76efb57af73deefe0140a54f"
server_key_iv: "d6a53ec63773c64c85de9a2b8d015269"
server_key_version: "encryptionkey@0"
I20260808 04:44:19.004916 7809 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.006s
I20260808 04:44:19.008128 7824 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:44:19.010057 7809 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 04:44:19.010281 7809 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786164000593138-21443-0/minicluster-data/ts-2/data,/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786164000593138-21443-0/minicluster-data/ts-2/wal
uuid: "591611101beb46c3a30f23198362e599"
format_stamp: "Formatted at 2026-08-08 04:44:18 on dist-test-slave-vxj2"
server_key: "ff95517c76efb57af73deefe0140a54f"
server_key_iv: "d6a53ec63773c64c85de9a2b8d015269"
server_key_version: "encryptionkey@0"
I20260808 04:44:19.010444 7809 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786164000593138-21443-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786164000593138-21443-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786164000593138-21443-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:44:19.026350 7809 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:44:19.030658 7809 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:44:19.031018 7809 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:44:19.031800 7809 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 04:44:19.032859 7809 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 04:44:19.032958 7809 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 04:44:19.033046 7809 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 04:44:19.033111 7809 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 04:44:19.044724 7809 rpc_server.cc:307] RPC server started. Bound to: 127.20.240.195:38735
I20260808 04:44:19.044817 7956 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.240.195:38735 every 8 connection(s)
I20260808 04:44:19.045841 7809 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786164000593138-21443-0/minicluster-data/ts-2/data/info.pb
I20260808 04:44:19.052760 21443 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu as pid 7809
I20260808 04:44:19.052907 21443 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786164000593138-21443-0/minicluster-data/ts-2/wal/instance
I20260808 04:44:19.053359 21443 external_mini_cluster.cc:1428] Setting key d5bf7b565cc59f50dd17c4d42b6a8f65
Aug 08 04:44:19 dist-test-slave-vxj2 krb5kdc[7382](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164258, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.240.195@KRBTEST.COM for kudu/127.20.240.254@KRBTEST.COM
I20260808 04:44:19.064217 7478 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:19.048370 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.240.195:55291 (local address 127.20.240.254:33339)
0808 04:44:19.048559 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:19.048563 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:19.049922 (+ 1359us) server_negotiation.cc:407] Connection header received
0808 04:44:19.051581 (+ 1659us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:19.051584 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:19.051660 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:19.051790 (+ 130us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:44:19.053386 (+ 1596us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:19.054033 (+ 647us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:19.055811 (+ 1778us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:19.056084 (+ 273us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:19.056221 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:19.059706 (+ 3485us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:44:19.059710 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:44:19.059712 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:44:19.059747 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:44:19.061522 (+ 1775us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:44:19.062299 (+ 777us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:44:19.062302 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:44:19.062303 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:44:19.062414 (+ 111us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:44:19.062900 (+ 486us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:44:19.062903 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:44:19.062905 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:44:19.063140 (+ 235us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:44:19.063238 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0808 04:44:19.063932 (+ 694us) server_negotiation.cc:299] Negotiation successful
0808 04:44:19.064078 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":87}
I20260808 04:44:19.065348 7961 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:19.048849 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:33339 (local address 127.20.240.195:55291)
0808 04:44:19.049691 (+ 842us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:19.049741 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0808 04:44:19.051295 (+ 1554us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:44:19.051996 (+ 701us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:44:19.052006 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:44:19.052433 (+ 427us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:44:19.053135 (+ 702us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:44:19.053207 (+ 72us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:44:19.054205 (+ 998us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:44:19.054209 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:44:19.055627 (+ 1418us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:44:19.055642 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:44:19.056283 (+ 641us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:44:19.056288 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:44:19.056505 (+ 217us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:19.057422 (+ 917us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:44:19.057445 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:44:19.059434 (+ 1989us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:44:19.061690 (+ 2256us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:44:19.061697 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:44:19.061715 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:44:19.062094 (+ 379us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:44:19.062563 (+ 469us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:44:19.062565 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:44:19.062567 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:44:19.062747 (+ 180us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:44:19.063297 (+ 550us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:44:19.063303 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:44:19.063626 (+ 323us) client_negotiation.cc:769] Sending connection context
0808 04:44:19.063811 (+ 185us) client_negotiation.cc:240] Negotiation successful
0808 04:44:19.064144 (+ 333us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":625,"thread_start_us":415,"threads_started":1}
I20260808 04:44:19.066787 7957 heartbeater.cc:347] Connected to a master server at 127.20.240.254:33339
I20260808 04:44:19.067153 7957 heartbeater.cc:464] Registering TS with master...
I20260808 04:44:19.067865 7957 heartbeater.cc:511] Master 127.20.240.254:33339 requested a full tablet report, sending...
I20260808 04:44:19.069402 7434 ts_manager.cc:194] Registered new tserver with Master: 591611101beb46c3a30f23198362e599 (127.20.240.195:38735)
I20260808 04:44:19.070098 7434 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.240.195@KRBTEST.COM'} at 127.20.240.195:55291
I20260808 04:44:19.081009 21443 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 04:44:19.093389 7478 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:19.083663 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48438 (local address 127.20.240.254:33339)
0808 04:44:19.083864 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:19.083867 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:19.083989 (+ 122us) server_negotiation.cc:407] Connection header received
0808 04:44:19.084207 (+ 218us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:19.084210 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:19.084287 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:19.084427 (+ 140us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:44:19.085441 (+ 1014us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:19.086038 (+ 597us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:19.087021 (+ 983us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:19.087274 (+ 253us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:19.087392 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:19.089100 (+ 1708us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:44:19.089104 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:44:19.089106 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:44:19.089139 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:44:19.091053 (+ 1914us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:44:19.091589 (+ 536us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:44:19.091592 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:44:19.091593 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:44:19.091684 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:44:19.092117 (+ 433us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:44:19.092123 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:44:19.092125 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:44:19.092533 (+ 408us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:44:19.092659 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0808 04:44:19.092954 (+ 295us) server_negotiation.cc:299] Negotiation successful
0808 04:44:19.093123 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":98}
I20260808 04:44:19.097025 7434 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48438:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 04:44:19.100324 7434 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 04:44:19.116580 7971 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:19.109899 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.194:37119 (local address 127.0.0.1:45306)
0808 04:44:19.110310 (+ 411us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:19.110369 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0808 04:44:19.110508 (+ 139us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:44:19.111865 (+ 1357us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:44:19.111870 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:44:19.111894 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 04:44:19.112048 (+ 154us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:44:19.112059 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:44:19.113313 (+ 1254us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:44:19.113318 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:44:19.114738 (+ 1420us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:44:19.114774 (+ 36us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:44:19.115844 (+ 1070us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:44:19.115848 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:44:19.116067 (+ 219us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:19.116143 (+ 76us) client_negotiation.cc:769] Sending connection context
0808 04:44:19.116269 (+ 126us) client_negotiation.cc:240] Negotiation successful
0808 04:44:19.116425 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":220,"mutex_wait_us":42,"thread_start_us":131,"threads_started":1}
I20260808 04:44:19.116590 7972 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:19.110089 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45306 (local address 127.20.240.194:37119)
0808 04:44:19.111253 (+ 1164us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:19.111270 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:19.111297 (+ 27us) server_negotiation.cc:407] Connection header received
0808 04:44:19.111381 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:19.111387 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:19.111640 (+ 253us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:19.111843 (+ 203us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 04:44:19.112185 (+ 342us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:19.113072 (+ 887us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:19.114943 (+ 1871us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:19.115713 (+ 770us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:19.115870 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:19.116021 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0808 04:44:19.116304 (+ 283us) server_negotiation.cc:299] Negotiation successful
0808 04:44:19.116420 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":610,"thread_start_us":123,"threads_started":1}
I20260808 04:44:19.116623 7977 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:19.110898 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42618 (local address 127.20.240.195:38735)
0808 04:44:19.111370 (+ 472us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:19.111384 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:19.111411 (+ 27us) server_negotiation.cc:407] Connection header received
0808 04:44:19.111691 (+ 280us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:19.111702 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:19.111874 (+ 172us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:19.112028 (+ 154us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 04:44:19.112305 (+ 277us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:19.113526 (+ 1221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:19.115028 (+ 1502us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:19.115864 (+ 836us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:19.115970 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:19.116115 (+ 145us) server_negotiation.cc:1035] Waiting for connection context
0808 04:44:19.116359 (+ 244us) server_negotiation.cc:299] Negotiation successful
0808 04:44:19.116462 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":379,"thread_start_us":164,"threads_started":1}
I20260808 04:44:19.117784 7974 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:19.110705 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.193:38343 (local address 127.0.0.1:37766)
0808 04:44:19.111559 (+ 854us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:19.111573 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 04:44:19.111656 (+ 83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:44:19.112283 (+ 627us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:44:19.112286 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:44:19.112302 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 04:44:19.112389 (+ 87us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:44:19.112398 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:44:19.113726 (+ 1328us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:44:19.113728 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:44:19.116411 (+ 2683us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:44:19.116418 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:44:19.117424 (+ 1006us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:44:19.117428 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:44:19.117513 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:19.117536 (+ 23us) client_negotiation.cc:769] Sending connection context
0808 04:44:19.117603 (+ 67us) client_negotiation.cc:240] Negotiation successful
0808 04:44:19.117666 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":795,"mutex_wait_us":377,"thread_start_us":117,"threads_started":1}
I20260808 04:44:19.117862 7976 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:19.110921 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37766 (local address 127.20.240.193:38343)
0808 04:44:19.111434 (+ 513us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:19.111440 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:19.111688 (+ 248us) server_negotiation.cc:407] Connection header received
0808 04:44:19.111778 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:19.111782 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:19.111992 (+ 210us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:19.112141 (+ 149us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 04:44:19.112522 (+ 381us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:19.113612 (+ 1090us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:19.116553 (+ 2941us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:19.117293 (+ 740us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:19.117433 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:19.117564 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0808 04:44:19.117629 (+ 65us) server_negotiation.cc:299] Negotiation successful
0808 04:44:19.117727 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":423,"thread_start_us":107,"threads_started":1}
I20260808 04:44:19.118093 7973 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:19.110266 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.195:38735 (local address 127.0.0.1:42618)
0808 04:44:19.111173 (+ 907us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:19.111187 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 04:44:19.111551 (+ 364us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:44:19.112049 (+ 498us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:44:19.112052 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:44:19.112070 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 04:44:19.112181 (+ 111us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:44:19.112188 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:44:19.113716 (+ 1528us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:44:19.113720 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:44:19.114884 (+ 1164us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:44:19.114893 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:44:19.116087 (+ 1194us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:44:19.116091 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:44:19.116206 (+ 115us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:19.116231 (+ 25us) client_negotiation.cc:769] Sending connection context
0808 04:44:19.116323 (+ 92us) client_negotiation.cc:240] Negotiation successful
0808 04:44:19.117434 (+ 1111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":845,"mutex_wait_us":1018,"thread_start_us":99,"threads_started":1}
I20260808 04:44:19.120653 7729 tablet_service.cc:1467] Processing CreateTablet for tablet 729fc857bac44a2ea4cce68686717cc5 (DEFAULT_TABLE table=test-table [id=aa739780f0944e9d86c2f285d355899d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 04:44:19.120910 7883 tablet_service.cc:1467] Processing CreateTablet for tablet 729fc857bac44a2ea4cce68686717cc5 (DEFAULT_TABLE table=test-table [id=aa739780f0944e9d86c2f285d355899d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 04:44:19.121912 7883 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 729fc857bac44a2ea4cce68686717cc5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:44:19.121927 7729 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 729fc857bac44a2ea4cce68686717cc5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:44:19.123545 7577 tablet_service.cc:1467] Processing CreateTablet for tablet 729fc857bac44a2ea4cce68686717cc5 (DEFAULT_TABLE table=test-table [id=aa739780f0944e9d86c2f285d355899d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 04:44:19.124437 7577 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 729fc857bac44a2ea4cce68686717cc5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:44:19.130215 7979 tablet_bootstrap.cc:492] T 729fc857bac44a2ea4cce68686717cc5 P 591611101beb46c3a30f23198362e599: Bootstrap starting.
I20260808 04:44:19.130748 7978 tablet_bootstrap.cc:492] T 729fc857bac44a2ea4cce68686717cc5 P d92192205f154e4c83a009638c9fdb8e: Bootstrap starting.
I20260808 04:44:19.132325 7982 tablet_bootstrap.cc:492] T 729fc857bac44a2ea4cce68686717cc5 P 2665e7dae8d4464c81342eb3876e18a9: Bootstrap starting.
I20260808 04:44:19.134981 7979 tablet_bootstrap.cc:654] T 729fc857bac44a2ea4cce68686717cc5 P 591611101beb46c3a30f23198362e599: Neither blocks nor log segments found. Creating new log.
I20260808 04:44:19.134981 7982 tablet_bootstrap.cc:654] T 729fc857bac44a2ea4cce68686717cc5 P 2665e7dae8d4464c81342eb3876e18a9: Neither blocks nor log segments found. Creating new log.
I20260808 04:44:19.136096 7982 log.cc:824] T 729fc857bac44a2ea4cce68686717cc5 P 2665e7dae8d4464c81342eb3876e18a9: Log is configured to *not* fsync() on all Append() calls
I20260808 04:44:19.136189 7978 tablet_bootstrap.cc:654] T 729fc857bac44a2ea4cce68686717cc5 P d92192205f154e4c83a009638c9fdb8e: Neither blocks nor log segments found. Creating new log.
I20260808 04:44:19.136319 7979 log.cc:824] T 729fc857bac44a2ea4cce68686717cc5 P 591611101beb46c3a30f23198362e599: Log is configured to *not* fsync() on all Append() calls
I20260808 04:44:19.137763 7978 log.cc:824] T 729fc857bac44a2ea4cce68686717cc5 P d92192205f154e4c83a009638c9fdb8e: Log is configured to *not* fsync() on all Append() calls
I20260808 04:44:19.138737 7979 tablet_bootstrap.cc:492] T 729fc857bac44a2ea4cce68686717cc5 P 591611101beb46c3a30f23198362e599: No bootstrap required, opened a new log
I20260808 04:44:19.138736 7982 tablet_bootstrap.cc:492] T 729fc857bac44a2ea4cce68686717cc5 P 2665e7dae8d4464c81342eb3876e18a9: No bootstrap required, opened a new log
I20260808 04:44:19.138972 7982 ts_tablet_manager.cc:1397] T 729fc857bac44a2ea4cce68686717cc5 P 2665e7dae8d4464c81342eb3876e18a9: Time spent bootstrapping tablet: real 0.007s user 0.001s sys 0.004s
I20260808 04:44:19.138974 7979 ts_tablet_manager.cc:1397] T 729fc857bac44a2ea4cce68686717cc5 P 591611101beb46c3a30f23198362e599: Time spent bootstrapping tablet: real 0.009s user 0.000s sys 0.005s
I20260808 04:44:19.139971 7978 tablet_bootstrap.cc:492] T 729fc857bac44a2ea4cce68686717cc5 P d92192205f154e4c83a009638c9fdb8e: No bootstrap required, opened a new log
I20260808 04:44:19.140239 7978 ts_tablet_manager.cc:1397] T 729fc857bac44a2ea4cce68686717cc5 P d92192205f154e4c83a009638c9fdb8e: Time spent bootstrapping tablet: real 0.010s user 0.002s sys 0.004s
I20260808 04:44:19.142972 7982 raft_consensus.cc:348] T 729fc857bac44a2ea4cce68686717cc5 P 2665e7dae8d4464c81342eb3876e18a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d92192205f154e4c83a009638c9fdb8e" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 37119 } } peers { permanent_uuid: "2665e7dae8d4464c81342eb3876e18a9" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 38343 } } peers { permanent_uuid: "591611101beb46c3a30f23198362e599" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 38735 } }
I20260808 04:44:19.143292 7982 raft_consensus.cc:374] T 729fc857bac44a2ea4cce68686717cc5 P 2665e7dae8d4464c81342eb3876e18a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:44:19.143121 7979 raft_consensus.cc:348] T 729fc857bac44a2ea4cce68686717cc5 P 591611101beb46c3a30f23198362e599 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d92192205f154e4c83a009638c9fdb8e" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 37119 } } peers { permanent_uuid: "2665e7dae8d4464c81342eb3876e18a9" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 38343 } } peers { permanent_uuid: "591611101beb46c3a30f23198362e599" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 38735 } }
I20260808 04:44:19.143375 7979 raft_consensus.cc:374] T 729fc857bac44a2ea4cce68686717cc5 P 591611101beb46c3a30f23198362e599 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:44:19.143388 7982 raft_consensus.cc:729] T 729fc857bac44a2ea4cce68686717cc5 P 2665e7dae8d4464c81342eb3876e18a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2665e7dae8d4464c81342eb3876e18a9, State: Initialized, Role: FOLLOWER
I20260808 04:44:19.143486 7979 raft_consensus.cc:729] T 729fc857bac44a2ea4cce68686717cc5 P 591611101beb46c3a30f23198362e599 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 591611101beb46c3a30f23198362e599, State: Initialized, Role: FOLLOWER
I20260808 04:44:19.143913 7982 consensus_queue.cc:260] T 729fc857bac44a2ea4cce68686717cc5 P 2665e7dae8d4464c81342eb3876e18a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d92192205f154e4c83a009638c9fdb8e" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 37119 } } peers { permanent_uuid: "2665e7dae8d4464c81342eb3876e18a9" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 38343 } } peers { permanent_uuid: "591611101beb46c3a30f23198362e599" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 38735 } }
I20260808 04:44:19.143946 7979 consensus_queue.cc:260] T 729fc857bac44a2ea4cce68686717cc5 P 591611101beb46c3a30f23198362e599 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d92192205f154e4c83a009638c9fdb8e" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 37119 } } peers { permanent_uuid: "2665e7dae8d4464c81342eb3876e18a9" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 38343 } } peers { permanent_uuid: "591611101beb46c3a30f23198362e599" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 38735 } }
I20260808 04:44:19.144261 7978 raft_consensus.cc:348] T 729fc857bac44a2ea4cce68686717cc5 P d92192205f154e4c83a009638c9fdb8e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d92192205f154e4c83a009638c9fdb8e" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 37119 } } peers { permanent_uuid: "2665e7dae8d4464c81342eb3876e18a9" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 38343 } } peers { permanent_uuid: "591611101beb46c3a30f23198362e599" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 38735 } }
I20260808 04:44:19.144587 7978 raft_consensus.cc:374] T 729fc857bac44a2ea4cce68686717cc5 P d92192205f154e4c83a009638c9fdb8e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:44:19.144659 7978 raft_consensus.cc:729] T 729fc857bac44a2ea4cce68686717cc5 P d92192205f154e4c83a009638c9fdb8e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d92192205f154e4c83a009638c9fdb8e, State: Initialized, Role: FOLLOWER
I20260808 04:44:19.144670 7655 heartbeater.cc:503] Master 127.20.240.254:33339 was elected leader, sending a full tablet report...
I20260808 04:44:19.145108 7979 ts_tablet_manager.cc:1428] T 729fc857bac44a2ea4cce68686717cc5 P 591611101beb46c3a30f23198362e599: Time spent starting tablet: real 0.006s user 0.006s sys 0.001s
I20260808 04:44:19.145120 7978 consensus_queue.cc:260] T 729fc857bac44a2ea4cce68686717cc5 P d92192205f154e4c83a009638c9fdb8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d92192205f154e4c83a009638c9fdb8e" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 37119 } } peers { permanent_uuid: "2665e7dae8d4464c81342eb3876e18a9" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 38343 } } peers { permanent_uuid: "591611101beb46c3a30f23198362e599" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 38735 } }
I20260808 04:44:19.145543 7957 heartbeater.cc:503] Master 127.20.240.254:33339 was elected leader, sending a full tablet report...
I20260808 04:44:19.146183 7978 ts_tablet_manager.cc:1428] T 729fc857bac44a2ea4cce68686717cc5 P d92192205f154e4c83a009638c9fdb8e: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20260808 04:44:19.146322 7982 ts_tablet_manager.cc:1428] T 729fc857bac44a2ea4cce68686717cc5 P 2665e7dae8d4464c81342eb3876e18a9: Time spent starting tablet: real 0.007s user 0.006s sys 0.000s
I20260808 04:44:19.146494 7804 heartbeater.cc:503] Master 127.20.240.254:33339 was elected leader, sending a full tablet report...
W20260808 04:44:19.287482 7656 tablet.cc:2369] T 729fc857bac44a2ea4cce68686717cc5 P 2665e7dae8d4464c81342eb3876e18a9: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 04:44:19.295861 7805 tablet.cc:2369] T 729fc857bac44a2ea4cce68686717cc5 P d92192205f154e4c83a009638c9fdb8e: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 04:44:19.297034 7958 tablet.cc:2369] T 729fc857bac44a2ea4cce68686717cc5 P 591611101beb46c3a30f23198362e599: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 04:44:19.473042 7986 raft_consensus.cc:482] T 729fc857bac44a2ea4cce68686717cc5 P 2665e7dae8d4464c81342eb3876e18a9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 04:44:19.473378 7986 raft_consensus.cc:504] T 729fc857bac44a2ea4cce68686717cc5 P 2665e7dae8d4464c81342eb3876e18a9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d92192205f154e4c83a009638c9fdb8e" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 37119 } } peers { permanent_uuid: "2665e7dae8d4464c81342eb3876e18a9" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 38343 } } peers { permanent_uuid: "591611101beb46c3a30f23198362e599" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 38735 } }
I20260808 04:44:19.474768 7986 leader_election.cc:288] T 729fc857bac44a2ea4cce68686717cc5 P 2665e7dae8d4464c81342eb3876e18a9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d92192205f154e4c83a009638c9fdb8e (127.20.240.194:37119), 591611101beb46c3a30f23198362e599 (127.20.240.195:38735)
I20260808 04:44:19.479067 7972 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:19.475505 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.240.193:43021 (local address 127.20.240.194:37119)
0808 04:44:19.475630 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:19.475635 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:19.475652 (+ 17us) server_negotiation.cc:407] Connection header received
0808 04:44:19.475709 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:19.475712 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:19.475769 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:19.475876 (+ 107us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 04:44:19.476214 (+ 338us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:19.476737 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:19.478049 (+ 1312us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:19.478457 (+ 408us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:19.478593 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:19.478650 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0808 04:44:19.478839 (+ 189us) server_negotiation.cc:299] Negotiation successful
0808 04:44:19.478916 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260808 04:44:19.479110 7990 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:19.474973 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.194:37119 (local address 127.20.240.193:43021)
0808 04:44:19.475415 (+ 442us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:19.475434 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0808 04:44:19.475574 (+ 140us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:44:19.475892 (+ 318us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:44:19.475895 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:44:19.475913 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 04:44:19.476092 (+ 179us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:44:19.476099 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:44:19.476857 (+ 758us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:44:19.476860 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:44:19.477916 (+ 1056us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:44:19.477927 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:44:19.478586 (+ 659us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:44:19.478590 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:44:19.478703 (+ 113us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:19.478722 (+ 19us) client_negotiation.cc:769] Sending connection context
0808 04:44:19.478810 (+ 88us) client_negotiation.cc:240] Negotiation successful
0808 04:44:19.478891 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":355,"mutex_wait_us":63,"spinlock_wait_cycles":896,"thread_start_us":128,"threads_started":1}
I20260808 04:44:19.479120 7977 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:19.475158 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.240.193:50311 (local address 127.20.240.195:38735)
0808 04:44:19.475300 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:19.475307 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:19.475522 (+ 215us) server_negotiation.cc:407] Connection header received
0808 04:44:19.475738 (+ 216us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:19.475743 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:19.475803 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:19.475884 (+ 81us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 04:44:19.476248 (+ 364us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:19.476784 (+ 536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:19.478061 (+ 1277us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:19.478498 (+ 437us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:19.478649 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:19.478711 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0808 04:44:19.478903 (+ 192us) server_negotiation.cc:299] Negotiation successful
0808 04:44:19.478984 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260808 04:44:19.479143 7991 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:19.474994 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.195:38735 (local address 127.20.240.193:50311)
0808 04:44:19.475415 (+ 421us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:19.475434 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0808 04:44:19.475580 (+ 146us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:44:19.475926 (+ 346us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:44:19.475929 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:44:19.475976 (+ 47us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 04:44:19.476107 (+ 131us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:44:19.476113 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:44:19.476918 (+ 805us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:44:19.476924 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:44:19.477907 (+ 983us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:44:19.477919 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:44:19.478649 (+ 730us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:44:19.478653 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:44:19.478763 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:19.478790 (+ 27us) client_negotiation.cc:769] Sending connection context
0808 04:44:19.478887 (+ 97us) client_negotiation.cc:240] Negotiation successful
0808 04:44:19.478965 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":346,"mutex_wait_us":18,"spinlock_wait_cycles":30720,"thread_start_us":135,"threads_started":1}
I20260808 04:44:19.479842 7888 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "729fc857bac44a2ea4cce68686717cc5" candidate_uuid: "2665e7dae8d4464c81342eb3876e18a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "591611101beb46c3a30f23198362e599" is_pre_election: true
I20260808 04:44:19.479940 7753 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "729fc857bac44a2ea4cce68686717cc5" candidate_uuid: "2665e7dae8d4464c81342eb3876e18a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d92192205f154e4c83a009638c9fdb8e" is_pre_election: true
I20260808 04:44:19.480219 7888 raft_consensus.cc:2454] T 729fc857bac44a2ea4cce68686717cc5 P 591611101beb46c3a30f23198362e599 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2665e7dae8d4464c81342eb3876e18a9 in term 0.
I20260808 04:44:19.480258 7753 raft_consensus.cc:2454] T 729fc857bac44a2ea4cce68686717cc5 P d92192205f154e4c83a009638c9fdb8e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2665e7dae8d4464c81342eb3876e18a9 in term 0.
I20260808 04:44:19.480800 7523 leader_election.cc:302] T 729fc857bac44a2ea4cce68686717cc5 P 2665e7dae8d4464c81342eb3876e18a9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 2665e7dae8d4464c81342eb3876e18a9, 591611101beb46c3a30f23198362e599, d92192205f154e4c83a009638c9fdb8e; no voters:
I20260808 04:44:19.481119 7986 raft_consensus.cc:2781] T 729fc857bac44a2ea4cce68686717cc5 P 2665e7dae8d4464c81342eb3876e18a9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 04:44:19.481241 7986 raft_consensus.cc:482] T 729fc857bac44a2ea4cce68686717cc5 P 2665e7dae8d4464c81342eb3876e18a9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 04:44:19.481288 7986 raft_consensus.cc:3037] T 729fc857bac44a2ea4cce68686717cc5 P 2665e7dae8d4464c81342eb3876e18a9 [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:44:19.482430 7986 raft_consensus.cc:504] T 729fc857bac44a2ea4cce68686717cc5 P 2665e7dae8d4464c81342eb3876e18a9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d92192205f154e4c83a009638c9fdb8e" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 37119 } } peers { permanent_uuid: "2665e7dae8d4464c81342eb3876e18a9" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 38343 } } peers { permanent_uuid: "591611101beb46c3a30f23198362e599" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 38735 } }
I20260808 04:44:19.482829 7986 leader_election.cc:288] T 729fc857bac44a2ea4cce68686717cc5 P 2665e7dae8d4464c81342eb3876e18a9 [CANDIDATE]: Term 1 election: Requested vote from peers d92192205f154e4c83a009638c9fdb8e (127.20.240.194:37119), 591611101beb46c3a30f23198362e599 (127.20.240.195:38735)
I20260808 04:44:19.483291 7888 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "729fc857bac44a2ea4cce68686717cc5" candidate_uuid: "2665e7dae8d4464c81342eb3876e18a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "591611101beb46c3a30f23198362e599"
I20260808 04:44:19.483309 7753 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "729fc857bac44a2ea4cce68686717cc5" candidate_uuid: "2665e7dae8d4464c81342eb3876e18a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d92192205f154e4c83a009638c9fdb8e"
I20260808 04:44:19.483433 7888 raft_consensus.cc:3037] T 729fc857bac44a2ea4cce68686717cc5 P 591611101beb46c3a30f23198362e599 [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:44:19.483486 7753 raft_consensus.cc:3037] T 729fc857bac44a2ea4cce68686717cc5 P d92192205f154e4c83a009638c9fdb8e [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:44:19.484705 7888 raft_consensus.cc:2454] T 729fc857bac44a2ea4cce68686717cc5 P 591611101beb46c3a30f23198362e599 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2665e7dae8d4464c81342eb3876e18a9 in term 1.
I20260808 04:44:19.484725 7753 raft_consensus.cc:2454] T 729fc857bac44a2ea4cce68686717cc5 P d92192205f154e4c83a009638c9fdb8e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2665e7dae8d4464c81342eb3876e18a9 in term 1.
I20260808 04:44:19.485208 7525 leader_election.cc:302] T 729fc857bac44a2ea4cce68686717cc5 P 2665e7dae8d4464c81342eb3876e18a9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2665e7dae8d4464c81342eb3876e18a9, 591611101beb46c3a30f23198362e599; no voters:
I20260808 04:44:19.485482 7986 raft_consensus.cc:2781] T 729fc857bac44a2ea4cce68686717cc5 P 2665e7dae8d4464c81342eb3876e18a9 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 04:44:19.485769 7986 raft_consensus.cc:686] T 729fc857bac44a2ea4cce68686717cc5 P 2665e7dae8d4464c81342eb3876e18a9 [term 1 LEADER]: Becoming Leader. State: Replica: 2665e7dae8d4464c81342eb3876e18a9, State: Running, Role: LEADER
I20260808 04:44:19.486212 7986 consensus_queue.cc:237] T 729fc857bac44a2ea4cce68686717cc5 P 2665e7dae8d4464c81342eb3876e18a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d92192205f154e4c83a009638c9fdb8e" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 37119 } } peers { permanent_uuid: "2665e7dae8d4464c81342eb3876e18a9" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 38343 } } peers { permanent_uuid: "591611101beb46c3a30f23198362e599" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 38735 } }
I20260808 04:44:19.490257 7434 catalog_manager.cc:5495] T 729fc857bac44a2ea4cce68686717cc5 P 2665e7dae8d4464c81342eb3876e18a9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2665e7dae8d4464c81342eb3876e18a9 (127.20.240.193). New cstate: current_term: 1 leader_uuid: "2665e7dae8d4464c81342eb3876e18a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d92192205f154e4c83a009638c9fdb8e" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 37119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2665e7dae8d4464c81342eb3876e18a9" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 38343 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "591611101beb46c3a30f23198362e599" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 38735 } health_report { overall_health: UNKNOWN } } }
I20260808 04:44:19.573680 7976 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:19.569697 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37780 (local address 127.20.240.193:38343)
0808 04:44:19.569852 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:19.569857 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:19.569874 (+ 17us) server_negotiation.cc:407] Connection header received
0808 04:44:19.570052 (+ 178us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:19.570055 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:19.570134 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:19.570253 (+ 119us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 04:44:19.570526 (+ 273us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:19.571055 (+ 529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:19.572046 (+ 991us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:19.572269 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:19.572388 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:19.572727 (+ 339us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 04:44:19.573205 (+ 478us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 04:44:19.573345 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0808 04:44:19.573454 (+ 109us) server_negotiation.cc:299] Negotiation successful
0808 04:44:19.573517 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260808 04:44:19.579715 7888 raft_consensus.cc:1261] T 729fc857bac44a2ea4cce68686717cc5 P 591611101beb46c3a30f23198362e599 [term 1 FOLLOWER]: Refusing update from remote peer 2665e7dae8d4464c81342eb3876e18a9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 04:44:19.579777 7753 raft_consensus.cc:1261] T 729fc857bac44a2ea4cce68686717cc5 P d92192205f154e4c83a009638c9fdb8e [term 1 FOLLOWER]: Refusing update from remote peer 2665e7dae8d4464c81342eb3876e18a9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 04:44:19.580504 7986 consensus_queue.cc:1035] T 729fc857bac44a2ea4cce68686717cc5 P 2665e7dae8d4464c81342eb3876e18a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "591611101beb46c3a30f23198362e599" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 38735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 04:44:19.580731 7993 consensus_queue.cc:1035] T 729fc857bac44a2ea4cce68686717cc5 P 2665e7dae8d4464c81342eb3876e18a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d92192205f154e4c83a009638c9fdb8e" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 37119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 04:44:19.589504 7999 mvcc.cc:205] Tried to move back new op lower bound from 7316128807230709760 to 7316128806858567680. Current Snapshot: MvccSnapshot[applied={T|T < 7316128807230709760}]
I20260808 04:44:19.602403 7434 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48438:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 04:44:19.602622 7434 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48438:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 04:44:19.605299 7434 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 886f2ed093da421293512a49124ba082: Sending DeleteTablet for 3 replicas of tablet 729fc857bac44a2ea4cce68686717cc5
I20260808 04:44:19.606715 7577 tablet_service.cc:1514] Processing DeleteTablet for tablet 729fc857bac44a2ea4cce68686717cc5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 04:44:19 UTC) from {username='kudu', principal='kudu/127.20.240.254@KRBTEST.COM'} at 127.0.0.1:37766
I20260808 04:44:19.606724 7883 tablet_service.cc:1514] Processing DeleteTablet for tablet 729fc857bac44a2ea4cce68686717cc5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 04:44:19 UTC) from {username='kudu', principal='kudu/127.20.240.254@KRBTEST.COM'} at 127.0.0.1:42618
I20260808 04:44:19.606832 7729 tablet_service.cc:1514] Processing DeleteTablet for tablet 729fc857bac44a2ea4cce68686717cc5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 04:44:19 UTC) from {username='kudu', principal='kudu/127.20.240.254@KRBTEST.COM'} at 127.0.0.1:45306
I20260808 04:44:19.607350 8009 tablet_replica.cc:330] T 729fc857bac44a2ea4cce68686717cc5 P 591611101beb46c3a30f23198362e599: stopping tablet replica
I20260808 04:44:19.607692 21443 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu with pid 7505
I20260808 04:44:19.607801 8009 raft_consensus.cc:2229] T 729fc857bac44a2ea4cce68686717cc5 P 591611101beb46c3a30f23198362e599 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 04:44:19.608579 8010 tablet_replica.cc:330] T 729fc857bac44a2ea4cce68686717cc5 P d92192205f154e4c83a009638c9fdb8e: stopping tablet replica
I20260808 04:44:19.608955 8010 raft_consensus.cc:2229] T 729fc857bac44a2ea4cce68686717cc5 P d92192205f154e4c83a009638c9fdb8e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 04:44:19.609356 8010 raft_consensus.cc:2258] T 729fc857bac44a2ea4cce68686717cc5 P d92192205f154e4c83a009638c9fdb8e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 04:44:19.608245 8009 raft_consensus.cc:2258] T 729fc857bac44a2ea4cce68686717cc5 P 591611101beb46c3a30f23198362e599 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 04:44:19.611516 8010 ts_tablet_manager.cc:1905] T 729fc857bac44a2ea4cce68686717cc5 P d92192205f154e4c83a009638c9fdb8e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 04:44:19.613277 8009 ts_tablet_manager.cc:1905] T 729fc857bac44a2ea4cce68686717cc5 P 591611101beb46c3a30f23198362e599: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 04:44:19.615821 8009 ts_tablet_manager.cc:1918] T 729fc857bac44a2ea4cce68686717cc5 P 591611101beb46c3a30f23198362e599: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 04:44:19.615805 8010 ts_tablet_manager.cc:1918] T 729fc857bac44a2ea4cce68686717cc5 P d92192205f154e4c83a009638c9fdb8e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 04:44:19.615960 8009 log.cc:1196] T 729fc857bac44a2ea4cce68686717cc5 P 591611101beb46c3a30f23198362e599: Deleting WAL directory at /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786164000593138-21443-0/minicluster-data/ts-2/wal/wals/729fc857bac44a2ea4cce68686717cc5
I20260808 04:44:19.615960 8010 log.cc:1196] T 729fc857bac44a2ea4cce68686717cc5 P d92192205f154e4c83a009638c9fdb8e: Deleting WAL directory at /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786164000593138-21443-0/minicluster-data/ts-1/wal/wals/729fc857bac44a2ea4cce68686717cc5
I20260808 04:44:19.616353 8009 ts_tablet_manager.cc:1939] T 729fc857bac44a2ea4cce68686717cc5 P 591611101beb46c3a30f23198362e599: Deleting consensus metadata
I20260808 04:44:19.616451 8010 ts_tablet_manager.cc:1939] T 729fc857bac44a2ea4cce68686717cc5 P d92192205f154e4c83a009638c9fdb8e: Deleting consensus metadata
I20260808 04:44:19.618012 7416 catalog_manager.cc:4841] TS d92192205f154e4c83a009638c9fdb8e (127.20.240.194:37119): tablet 729fc857bac44a2ea4cce68686717cc5 (table test-table [id=aa739780f0944e9d86c2f285d355899d]) successfully deleted
I20260808 04:44:19.618009 7419 catalog_manager.cc:4841] TS 591611101beb46c3a30f23198362e599 (127.20.240.195:38735): tablet 729fc857bac44a2ea4cce68686717cc5 (table test-table [id=aa739780f0944e9d86c2f285d355899d]) successfully deleted
W20260808 04:44:19.619278 7416 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.20.240.193:38343 (error 108)
I20260808 04:44:19.619432 21443 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu with pid 7660
I20260808 04:44:19.620930 8012 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:19.620170 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.193:38343 (local address 127.0.0.1:37788)
0808 04:44:19.620687 (+ 517us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:19.620775 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.240.193:38343: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":409,"thread_start_us":314,"threads_started":1}
W20260808 04:44:19.621074 7416 catalog_manager.cc:4584] TS 2665e7dae8d4464c81342eb3876e18a9 (127.20.240.193:38343): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 729fc857bac44a2ea4cce68686717cc5: Network error: Client connection negotiation failed: client connection to 127.20.240.193:38343: connect: Connection refused (error 111)
I20260808 04:44:19.629122 21443 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu with pid 7809
I20260808 04:44:19.637074 21443 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu with pid 7398
2026-08-08T04:44:19Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/0 (2967 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/1
2026-08-08T04:44:19Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T04:44:19Z Disabled control of system clock
I20260808 04:44:19.673681 21443 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
/tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786164000593138-21443-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786164000593138-21443-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786164000593138-21443-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786164000593138-21443-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.240.254:38653
--webserver_interface=127.20.240.254
--webserver_port=0
--builtin_ntp_servers=127.20.240.212:44161
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.240.254:38653
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260808 04:44:19.798707 8016 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:44:19.799052 8016 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:44:19.799094 8016 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:44:19.803839 8016 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 04:44:19.803925 8016 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:44:19.803941 8016 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:44:19.803959 8016 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 04:44:19.803975 8016 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 04:44:19.809327 8016 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.240.212:44161
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786164000593138-21443-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786164000593138-21443-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.240.254:38653
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.240.254:38653
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786164000593138-21443-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.240.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8016
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786164000593138-21443-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 04:05:18 UTC on ccycloud.quasar-drfdgt.root.comops.site
build id 4574101
I20260808 04:44:19.810564 8016 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:44:19.812064 8016 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:44:19.821023 8022 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:44:19.821033 8024 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:44:19.821105 8021 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:44:19.821311 8016 server_base.cc:1034] running on GCE node
I20260808 04:44:19.822085 8016 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:44:19.823292 8016 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:44:19.824528 8016 hybrid_clock.cc:648] HybridClock initialized: now 1786164259824492 us; error 41 us; skew 500 ppm
I20260808 04:44:19.827121 8016 webserver.cc:460] Webserver started at http://127.20.240.254:35817/ using document root <none> and password file <none>
I20260808 04:44:19.827792 8016 fs_manager.cc:359] Metadata directory not provided
I20260808 04:44:19.827906 8016 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:44:19.828161 8016 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 04:44:19.830514 8016 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786164000593138-21443-0/minicluster-data/master-0/data/instance:
uuid: "2b6464c9fcd74237bf405fc543c7a01e"
format_stamp: "Formatted at 2026-08-08 04:44:19 on dist-test-slave-vxj2"
server_key: "67f130230b3aa6a1e2928271380d95f5"
server_key_iv: "6d9bda9de9850290a000d6cff1ed73dd"
server_key_version: "encryptionkey@0"
I20260808 04:44:19.831148 8016 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786164000593138-21443-0/minicluster-data/master-0/wal/instance:
uuid: "2b6464c9fcd74237bf405fc543c7a01e"
format_stamp: "Formatted at 2026-08-08 04:44:19 on dist-test-slave-vxj2"
server_key: "67f130230b3aa6a1e2928271380d95f5"
server_key_iv: "6d9bda9de9850290a000d6cff1ed73dd"
server_key_version: "encryptionkey@0"
I20260808 04:44:19.836098 8016 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260808 04:44:19.839248 8030 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:44:19.840823 8016 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260808 04:44:19.841019 8016 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786164000593138-21443-0/minicluster-data/master-0/data,/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786164000593138-21443-0/minicluster-data/master-0/wal
uuid: "2b6464c9fcd74237bf405fc543c7a01e"
format_stamp: "Formatted at 2026-08-08 04:44:19 on dist-test-slave-vxj2"
server_key: "67f130230b3aa6a1e2928271380d95f5"
server_key_iv: "6d9bda9de9850290a000d6cff1ed73dd"
server_key_version: "encryptionkey@0"
I20260808 04:44:19.841194 8016 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786164000593138-21443-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786164000593138-21443-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786164000593138-21443-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:44:19.863102 8016 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:44:19.863986 8016 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:44:19.864215 8016 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:44:19.871964 8016 rpc_server.cc:307] RPC server started. Bound to: 127.20.240.254:38653
I20260808 04:44:19.872001 8089 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.240.254:38653 every 8 connection(s)
I20260808 04:44:19.873011 8016 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786164000593138-21443-0/minicluster-data/master-0/data/info.pb
I20260808 04:44:19.876396 8091 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:44:19.881235 21443 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu as pid 8016
I20260808 04:44:19.881399 21443 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786164000593138-21443-0/minicluster-data/master-0/wal/instance
I20260808 04:44:19.881703 21443 external_mini_cluster.cc:1428] Setting key 4ddb1a0921108c8bc8b8a85b1227bfdf
I20260808 04:44:19.883734 8091 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2b6464c9fcd74237bf405fc543c7a01e: Bootstrap starting.
I20260808 04:44:19.886528 8091 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2b6464c9fcd74237bf405fc543c7a01e: Neither blocks nor log segments found. Creating new log.
I20260808 04:44:19.887360 8091 log.cc:824] T 00000000000000000000000000000000 P 2b6464c9fcd74237bf405fc543c7a01e: Log is configured to *not* fsync() on all Append() calls
I20260808 04:44:19.889551 8091 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2b6464c9fcd74237bf405fc543c7a01e: No bootstrap required, opened a new log
I20260808 04:44:19.892659 8095 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:19.883358 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41974 (local address 127.20.240.254:38653)
0808 04:44:19.884228 (+ 870us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:19.884248 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:19.884291 (+ 43us) server_negotiation.cc:407] Connection header received
0808 04:44:19.885084 (+ 793us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:19.885105 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:19.885667 (+ 562us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:19.886077 (+ 410us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:44:19.886597 (+ 520us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:19.887839 (+ 1242us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:19.888874 (+ 1035us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:19.889472 (+ 598us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:19.889655 (+ 183us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:19.890676 (+ 1021us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:44:19.890681 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:44:19.890696 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 04:44:19.891148 (+ 452us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:44:19.891212 (+ 64us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 04:44:19.891235 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:44:19.891369 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0808 04:44:19.891526 (+ 157us) server_negotiation.cc:299] Negotiation successful
0808 04:44:19.891838 (+ 312us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":359,"thread_start_us":158,"threads_started":1}
I20260808 04:44:19.893893 8091 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2b6464c9fcd74237bf405fc543c7a01e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2b6464c9fcd74237bf405fc543c7a01e" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 38653 } }
I20260808 04:44:19.894165 8091 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2b6464c9fcd74237bf405fc543c7a01e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:44:19.894251 8091 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2b6464c9fcd74237bf405fc543c7a01e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b6464c9fcd74237bf405fc543c7a01e, State: Initialized, Role: FOLLOWER
I20260808 04:44:19.894696 8091 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2b6464c9fcd74237bf405fc543c7a01e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2b6464c9fcd74237bf405fc543c7a01e" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 38653 } }
I20260808 04:44:19.894865 8091 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2b6464c9fcd74237bf405fc543c7a01e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 04:44:19.894953 8091 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2b6464c9fcd74237bf405fc543c7a01e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 04:44:19.895067 8091 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2b6464c9fcd74237bf405fc543c7a01e [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:44:19.896158 8091 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2b6464c9fcd74237bf405fc543c7a01e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2b6464c9fcd74237bf405fc543c7a01e" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 38653 } }
I20260808 04:44:19.896523 8091 leader_election.cc:302] T 00000000000000000000000000000000 P 2b6464c9fcd74237bf405fc543c7a01e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2b6464c9fcd74237bf405fc543c7a01e; no voters:
I20260808 04:44:19.896869 8091 leader_election.cc:288] T 00000000000000000000000000000000 P 2b6464c9fcd74237bf405fc543c7a01e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 04:44:19.897039 8097 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2b6464c9fcd74237bf405fc543c7a01e [term 1 FOLLOWER]: Leader election won for term 1
I20260808 04:44:19.897354 8097 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2b6464c9fcd74237bf405fc543c7a01e [term 1 LEADER]: Becoming Leader. State: Replica: 2b6464c9fcd74237bf405fc543c7a01e, State: Running, Role: LEADER
I20260808 04:44:19.897691 8097 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2b6464c9fcd74237bf405fc543c7a01e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2b6464c9fcd74237bf405fc543c7a01e" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 38653 } }
I20260808 04:44:19.898229 8091 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2b6464c9fcd74237bf405fc543c7a01e [sys.catalog]: configured and running, proceeding with master startup.
I20260808 04:44:19.899652 8099 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2b6464c9fcd74237bf405fc543c7a01e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2b6464c9fcd74237bf405fc543c7a01e. Latest consensus state: current_term: 1 leader_uuid: "2b6464c9fcd74237bf405fc543c7a01e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2b6464c9fcd74237bf405fc543c7a01e" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 38653 } } }
I20260808 04:44:19.899796 8099 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2b6464c9fcd74237bf405fc543c7a01e [sys.catalog]: This master's current role is: LEADER
I20260808 04:44:19.900328 8098 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2b6464c9fcd74237bf405fc543c7a01e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2b6464c9fcd74237bf405fc543c7a01e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2b6464c9fcd74237bf405fc543c7a01e" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 38653 } } }
I20260808 04:44:19.900473 8098 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2b6464c9fcd74237bf405fc543c7a01e [sys.catalog]: This master's current role is: LEADER
I20260808 04:44:19.900586 8106 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 04:44:19.903865 8106 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 04:44:19.910624 8106 catalog_manager.cc:1347] Generated new cluster ID: e5d77ba4a98d48f5830df910b12c19c5
I20260808 04:44:19.910734 8106 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 04:44:19.925554 8106 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 04:44:19.926914 8106 catalog_manager.cc:1504] Loading token signing keys...
I20260808 04:44:19.934381 8106 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2b6464c9fcd74237bf405fc543c7a01e: Generated new TSK 0
I20260808 04:44:19.935405 8106 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 04:44:19.938747 21443 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
/tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786164000593138-21443-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786164000593138-21443-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786164000593138-21443-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786164000593138-21443-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.240.193:0
--local_ip_for_outbound_sockets=127.20.240.193
--webserver_interface=127.20.240.193
--webserver_port=0
--tserver_master_addrs=127.20.240.254:38653
--builtin_ntp_servers=127.20.240.212:44161
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260808 04:44:20.078612 8118 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:44:20.079095 8118 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:44:20.079182 8118 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:44:20.088724 8118 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:44:20.088845 8118 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:44:20.088975 8118 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.240.193
I20260808 04:44:20.098366 8118 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.240.212:44161
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786164000593138-21443-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786164000593138-21443-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.240.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786164000593138-21443-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.240.193
--webserver_port=0
--tserver_master_addrs=127.20.240.254:38653
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8118
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.240.193
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786164000593138-21443-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 04:05:18 UTC on ccycloud.quasar-drfdgt.root.comops.site
build id 4574101
I20260808 04:44:20.099666 8118 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:44:20.101189 8118 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:44:20.112342 8126 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:44:20.112457 8118 server_base.cc:1034] running on GCE node
W20260808 04:44:20.112342 8129 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:44:20.112342 8127 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:44:20.113108 8118 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:44:20.113906 8118 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:44:20.115129 8118 hybrid_clock.cc:648] HybridClock initialized: now 1786164260115101 us; error 43 us; skew 500 ppm
I20260808 04:44:20.117309 8118 webserver.cc:460] Webserver started at http://127.20.240.193:40765/ using document root <none> and password file <none>
I20260808 04:44:20.117945 8118 fs_manager.cc:359] Metadata directory not provided
I20260808 04:44:20.118047 8118 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:44:20.118290 8118 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 04:44:20.120462 8118 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786164000593138-21443-0/minicluster-data/ts-0/data/instance:
uuid: "03d53d118b784bd29011f1fa97d6e69f"
format_stamp: "Formatted at 2026-08-08 04:44:20 on dist-test-slave-vxj2"
server_key: "e9319f4d2c566582acc58c2c09ba94b6"
server_key_iv: "7f9eaed96c29c4eb2f33e87b541550ee"
server_key_version: "encryptionkey@0"
I20260808 04:44:20.121068 8118 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786164000593138-21443-0/minicluster-data/ts-0/wal/instance:
uuid: "03d53d118b784bd29011f1fa97d6e69f"
format_stamp: "Formatted at 2026-08-08 04:44:20 on dist-test-slave-vxj2"
server_key: "e9319f4d2c566582acc58c2c09ba94b6"
server_key_iv: "7f9eaed96c29c4eb2f33e87b541550ee"
server_key_version: "encryptionkey@0"
I20260808 04:44:20.125000 8118 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.000s
I20260808 04:44:20.127655 8135 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:44:20.129065 8118 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260808 04:44:20.129251 8118 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786164000593138-21443-0/minicluster-data/ts-0/data,/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786164000593138-21443-0/minicluster-data/ts-0/wal
uuid: "03d53d118b784bd29011f1fa97d6e69f"
format_stamp: "Formatted at 2026-08-08 04:44:20 on dist-test-slave-vxj2"
server_key: "e9319f4d2c566582acc58c2c09ba94b6"
server_key_iv: "7f9eaed96c29c4eb2f33e87b541550ee"
server_key_version: "encryptionkey@0"
I20260808 04:44:20.129388 8118 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786164000593138-21443-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786164000593138-21443-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786164000593138-21443-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:44:20.148854 8118 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:44:20.150085 8118 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:44:20.150381 8118 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:44:20.151160 8118 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 04:44:20.152419 8118 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 04:44:20.152509 8118 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 04:44:20.152588 8118 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 04:44:20.152635 8118 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 04:44:20.162390 8118 rpc_server.cc:307] RPC server started. Bound to: 127.20.240.193:42501
I20260808 04:44:20.162453 8258 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.240.193:42501 every 8 connection(s)
I20260808 04:44:20.163388 8118 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786164000593138-21443-0/minicluster-data/ts-0/data/info.pb
I20260808 04:44:20.167229 21443 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu as pid 8118
I20260808 04:44:20.167399 21443 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786164000593138-21443-0/minicluster-data/ts-0/wal/instance
I20260808 04:44:20.167757 21443 external_mini_cluster.cc:1428] Setting key c31bb567067c4fa886efa6062390be9c
I20260808 04:44:20.170164 21443 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
/tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786164000593138-21443-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786164000593138-21443-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786164000593138-21443-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786164000593138-21443-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.240.194:0
--local_ip_for_outbound_sockets=127.20.240.194
--webserver_interface=127.20.240.194
--webserver_port=0
--tserver_master_addrs=127.20.240.254:38653
--builtin_ntp_servers=127.20.240.212:44161
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260808 04:44:20.175643 8095 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:20.165635 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.240.193:36123 (local address 127.20.240.254:38653)
0808 04:44:20.165898 (+ 263us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:20.165902 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:20.167401 (+ 1499us) server_negotiation.cc:407] Connection header received
0808 04:44:20.169440 (+ 2039us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:20.169444 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:20.169501 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:20.169591 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:44:20.170774 (+ 1183us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:20.171377 (+ 603us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:20.172988 (+ 1611us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:20.173339 (+ 351us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:20.173424 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:20.175004 (+ 1580us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:44:20.175009 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:44:20.175012 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 04:44:20.175037 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:44:20.175062 (+ 25us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 04:44:20.175071 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:44:20.175162 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0808 04:44:20.175370 (+ 208us) server_negotiation.cc:299] Negotiation successful
0808 04:44:20.175466 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":137}
I20260808 04:44:20.176995 8261 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:20.166057 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:38653 (local address 127.20.240.193:36123)
0808 04:44:20.167116 (+ 1059us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:20.167189 (+ 73us) client_negotiation.cc:174] Beginning negotiation
0808 04:44:20.169109 (+ 1920us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:44:20.169818 (+ 709us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:44:20.169827 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:44:20.169942 (+ 115us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:44:20.170607 (+ 665us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:44:20.170624 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:44:20.171550 (+ 926us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:44:20.171554 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:44:20.172805 (+ 1251us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:44:20.172820 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:44:20.173662 (+ 842us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:44:20.173665 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:44:20.173844 (+ 179us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:20.174652 (+ 808us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 04:44:20.174654 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:44:20.174704 (+ 50us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 04:44:20.174789 (+ 85us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:44:20.175178 (+ 389us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:44:20.175193 (+ 15us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:44:20.175205 (+ 12us) client_negotiation.cc:769] Sending connection context
0808 04:44:20.175351 (+ 146us) client_negotiation.cc:240] Negotiation successful
0808 04:44:20.175722 (+ 371us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":326,"thread_start_us":133,"threads_started":1}
I20260808 04:44:20.178669 8259 heartbeater.cc:347] Connected to a master server at 127.20.240.254:38653
I20260808 04:44:20.178987 8259 heartbeater.cc:464] Registering TS with master...
I20260808 04:44:20.179917 8259 heartbeater.cc:511] Master 127.20.240.254:38653 requested a full tablet report, sending...
I20260808 04:44:20.182250 8050 ts_manager.cc:194] Registered new tserver with Master: 03d53d118b784bd29011f1fa97d6e69f (127.20.240.193:42501)
I20260808 04:44:20.184077 8050 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.20.240.193:36123
W20260808 04:44:20.295497 8263 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:44:20.295785 8263 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:44:20.295826 8263 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:44:20.300312 8263 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:44:20.300390 8263 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:44:20.300453 8263 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.240.194
I20260808 04:44:20.305527 8263 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.240.212:44161
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786164000593138-21443-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786164000593138-21443-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.240.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786164000593138-21443-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.240.194
--webserver_port=0
--tserver_master_addrs=127.20.240.254:38653
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8263
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.240.194
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786164000593138-21443-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 04:05:18 UTC on ccycloud.quasar-drfdgt.root.comops.site
build id 4574101
I20260808 04:44:20.306697 8263 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:44:20.308094 8263 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:44:20.318113 8271 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:44:20.318115 8269 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:44:20.318450 8263 server_base.cc:1034] running on GCE node
W20260808 04:44:20.318113 8268 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:44:20.318996 8263 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:44:20.319658 8263 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:44:20.320834 8263 hybrid_clock.cc:648] HybridClock initialized: now 1786164260320805 us; error 44 us; skew 500 ppm
I20260808 04:44:20.322852 8263 webserver.cc:460] Webserver started at http://127.20.240.194:46151/ using document root <none> and password file <none>
I20260808 04:44:20.323462 8263 fs_manager.cc:359] Metadata directory not provided
I20260808 04:44:20.323526 8263 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:44:20.323750 8263 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 04:44:20.325987 8263 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786164000593138-21443-0/minicluster-data/ts-1/data/instance:
uuid: "c1e2f18918354999812f66ce99a57b6f"
format_stamp: "Formatted at 2026-08-08 04:44:20 on dist-test-slave-vxj2"
server_key: "56f5a466f6914944427cff870da7d3a7"
server_key_iv: "3d60745431900fe26b18f3896046bbcd"
server_key_version: "encryptionkey@0"
I20260808 04:44:20.326586 8263 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786164000593138-21443-0/minicluster-data/ts-1/wal/instance:
uuid: "c1e2f18918354999812f66ce99a57b6f"
format_stamp: "Formatted at 2026-08-08 04:44:20 on dist-test-slave-vxj2"
server_key: "56f5a466f6914944427cff870da7d3a7"
server_key_iv: "3d60745431900fe26b18f3896046bbcd"
server_key_version: "encryptionkey@0"
I20260808 04:44:20.330655 8263 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260808 04:44:20.333416 8279 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:44:20.334794 8263 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 04:44:20.334967 8263 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786164000593138-21443-0/minicluster-data/ts-1/data,/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786164000593138-21443-0/minicluster-data/ts-1/wal
uuid: "c1e2f18918354999812f66ce99a57b6f"
format_stamp: "Formatted at 2026-08-08 04:44:20 on dist-test-slave-vxj2"
server_key: "56f5a466f6914944427cff870da7d3a7"
server_key_iv: "3d60745431900fe26b18f3896046bbcd"
server_key_version: "encryptionkey@0"
I20260808 04:44:20.335107 8263 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786164000593138-21443-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786164000593138-21443-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786164000593138-21443-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:44:20.360074 8263 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:44:20.360836 8263 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:44:20.361070 8263 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:44:20.361752 8263 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 04:44:20.362767 8263 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 04:44:20.362852 8263 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 04:44:20.363003 8263 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 04:44:20.363062 8263 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 04:44:20.373282 8263 rpc_server.cc:307] RPC server started. Bound to: 127.20.240.194:46689
I20260808 04:44:20.373308 8407 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.240.194:46689 every 8 connection(s)
I20260808 04:44:20.374266 8263 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786164000593138-21443-0/minicluster-data/ts-1/data/info.pb
I20260808 04:44:20.378458 21443 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu as pid 8263
I20260808 04:44:20.378608 21443 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786164000593138-21443-0/minicluster-data/ts-1/wal/instance
I20260808 04:44:20.379007 21443 external_mini_cluster.cc:1428] Setting key 7cdf8e4cdcbb636e6856d5ad278df98d
I20260808 04:44:20.381685 21443 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
/tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786164000593138-21443-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786164000593138-21443-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786164000593138-21443-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786164000593138-21443-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.240.195:0
--local_ip_for_outbound_sockets=127.20.240.195
--webserver_interface=127.20.240.195
--webserver_port=0
--tserver_master_addrs=127.20.240.254:38653
--builtin_ntp_servers=127.20.240.212:44161
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260808 04:44:20.385576 8095 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:20.376281 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.240.194:47253 (local address 127.20.240.254:38653)
0808 04:44:20.376467 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:20.376473 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:20.377729 (+ 1256us) server_negotiation.cc:407] Connection header received
0808 04:44:20.379776 (+ 2047us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:20.379786 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:20.379839 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:20.379914 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:44:20.381262 (+ 1348us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:20.381825 (+ 563us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:20.383172 (+ 1347us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:20.383436 (+ 264us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:20.383564 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:20.384944 (+ 1380us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:44:20.384948 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:44:20.384950 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 04:44:20.384964 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:44:20.384984 (+ 20us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 04:44:20.384992 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:44:20.385074 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0808 04:44:20.385323 (+ 249us) server_negotiation.cc:299] Negotiation successful
0808 04:44:20.385396 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
I20260808 04:44:20.386516 8411 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:20.376743 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:38653 (local address 127.20.240.194:47253)
0808 04:44:20.377569 (+ 826us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:20.377616 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0808 04:44:20.379499 (+ 1883us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:44:20.380212 (+ 713us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:44:20.380227 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:44:20.380327 (+ 100us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:44:20.381071 (+ 744us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:44:20.381095 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:44:20.382037 (+ 942us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:44:20.382040 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:44:20.383018 (+ 978us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:44:20.383029 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:44:20.383621 (+ 592us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:44:20.383625 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:44:20.383812 (+ 187us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:20.384558 (+ 746us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 04:44:20.384559 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:44:20.384605 (+ 46us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 04:44:20.384682 (+ 77us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:44:20.385077 (+ 395us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:44:20.385090 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:44:20.385099 (+ 9us) client_negotiation.cc:769] Sending connection context
0808 04:44:20.385302 (+ 203us) client_negotiation.cc:240] Negotiation successful
0808 04:44:20.385628 (+ 326us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":308,"thread_start_us":117,"threads_started":1}
I20260808 04:44:20.387990 8409 heartbeater.cc:347] Connected to a master server at 127.20.240.254:38653
I20260808 04:44:20.388324 8409 heartbeater.cc:464] Registering TS with master...
I20260808 04:44:20.389184 8409 heartbeater.cc:511] Master 127.20.240.254:38653 requested a full tablet report, sending...
I20260808 04:44:20.390499 8050 ts_manager.cc:194] Registered new tserver with Master: c1e2f18918354999812f66ce99a57b6f (127.20.240.194:46689)
I20260808 04:44:20.391126 8050 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.20.240.194:47253
W20260808 04:44:20.509999 8412 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:44:20.510330 8412 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:44:20.510377 8412 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:44:20.515447 8412 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:44:20.515520 8412 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:44:20.515580 8412 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.240.195
I20260808 04:44:20.520798 8412 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.240.212:44161
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786164000593138-21443-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786164000593138-21443-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.240.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786164000593138-21443-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.240.195
--webserver_port=0
--tserver_master_addrs=127.20.240.254:38653
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8412
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.240.195
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786164000593138-21443-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 04:05:18 UTC on ccycloud.quasar-drfdgt.root.comops.site
build id 4574101
I20260808 04:44:20.522051 8412 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:44:20.523550 8412 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260808 04:44:20.534368 8412 server_base.cc:1034] running on GCE node
W20260808 04:44:20.534291 8421 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:44:20.534292 8417 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:44:20.534292 8418 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:44:20.535333 8412 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:44:20.536069 8412 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:44:20.537240 8412 hybrid_clock.cc:648] HybridClock initialized: now 1786164260537193 us; error 49 us; skew 500 ppm
I20260808 04:44:20.539546 8412 webserver.cc:460] Webserver started at http://127.20.240.195:38297/ using document root <none> and password file <none>
I20260808 04:44:20.540179 8412 fs_manager.cc:359] Metadata directory not provided
I20260808 04:44:20.540251 8412 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:44:20.540490 8412 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 04:44:20.542995 8412 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786164000593138-21443-0/minicluster-data/ts-2/data/instance:
uuid: "2e45193c9c9e440e83fdd3d762d478d3"
format_stamp: "Formatted at 2026-08-08 04:44:20 on dist-test-slave-vxj2"
server_key: "20d68dddb21370db7bd382a3ce102cf6"
server_key_iv: "b9d4fadb2095bc84344ace9d5b963f29"
server_key_version: "encryptionkey@0"
I20260808 04:44:20.543639 8412 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786164000593138-21443-0/minicluster-data/ts-2/wal/instance:
uuid: "2e45193c9c9e440e83fdd3d762d478d3"
format_stamp: "Formatted at 2026-08-08 04:44:20 on dist-test-slave-vxj2"
server_key: "20d68dddb21370db7bd382a3ce102cf6"
server_key_iv: "b9d4fadb2095bc84344ace9d5b963f29"
server_key_version: "encryptionkey@0"
I20260808 04:44:20.548067 8412 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.002s
I20260808 04:44:20.550935 8428 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:44:20.552260 8412 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260808 04:44:20.552428 8412 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786164000593138-21443-0/minicluster-data/ts-2/data,/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786164000593138-21443-0/minicluster-data/ts-2/wal
uuid: "2e45193c9c9e440e83fdd3d762d478d3"
format_stamp: "Formatted at 2026-08-08 04:44:20 on dist-test-slave-vxj2"
server_key: "20d68dddb21370db7bd382a3ce102cf6"
server_key_iv: "b9d4fadb2095bc84344ace9d5b963f29"
server_key_version: "encryptionkey@0"
I20260808 04:44:20.552552 8412 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786164000593138-21443-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786164000593138-21443-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786164000593138-21443-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:44:20.566418 8412 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:44:20.567221 8412 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:44:20.567442 8412 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:44:20.568131 8412 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 04:44:20.569231 8412 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 04:44:20.569301 8412 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 04:44:20.569377 8412 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 04:44:20.569447 8412 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 04:44:20.579465 8412 rpc_server.cc:307] RPC server started. Bound to: 127.20.240.195:40747
I20260808 04:44:20.579486 8557 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.240.195:40747 every 8 connection(s)
I20260808 04:44:20.580546 8412 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786164000593138-21443-0/minicluster-data/ts-2/data/info.pb
I20260808 04:44:20.590086 21443 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu as pid 8412
I20260808 04:44:20.590236 21443 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786164000593138-21443-0/minicluster-data/ts-2/wal/instance
I20260808 04:44:20.590515 21443 external_mini_cluster.cc:1428] Setting key 0afca7f798395af151f9a889e43a06dc
I20260808 04:44:20.591996 8095 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:20.582816 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.240.195:55263 (local address 127.20.240.254:38653)
0808 04:44:20.582992 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:20.582996 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:20.584227 (+ 1231us) server_negotiation.cc:407] Connection header received
0808 04:44:20.586018 (+ 1791us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:20.586022 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:20.586105 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:20.586213 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:44:20.587343 (+ 1130us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:20.588044 (+ 701us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:20.589509 (+ 1465us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:20.589806 (+ 297us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:20.589950 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:20.591352 (+ 1402us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:44:20.591355 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:44:20.591357 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 04:44:20.591369 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:44:20.591391 (+ 22us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 04:44:20.591399 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:44:20.591521 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0808 04:44:20.591742 (+ 221us) server_negotiation.cc:299] Negotiation successful
0808 04:44:20.591812 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260808 04:44:20.593190 8560 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:20.583275 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:38653 (local address 127.20.240.195:55263)
0808 04:44:20.584046 (+ 771us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:20.584095 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0808 04:44:20.585723 (+ 1628us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:44:20.586430 (+ 707us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:44:20.586439 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:44:20.586559 (+ 120us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:44:20.587160 (+ 601us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:44:20.587176 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:44:20.588198 (+ 1022us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:44:20.588207 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:44:20.589357 (+ 1150us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:44:20.589369 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:44:20.590018 (+ 649us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:44:20.590022 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:44:20.590218 (+ 196us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:20.591033 (+ 815us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 04:44:20.591035 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:44:20.591083 (+ 48us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 04:44:20.591162 (+ 79us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:44:20.591550 (+ 388us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:44:20.591561 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:44:20.591567 (+ 6us) client_negotiation.cc:769] Sending connection context
0808 04:44:20.591716 (+ 149us) client_negotiation.cc:240] Negotiation successful
0808 04:44:20.592114 (+ 398us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":305,"thread_start_us":129,"threads_started":1}
I20260808 04:44:20.594432 8558 heartbeater.cc:347] Connected to a master server at 127.20.240.254:38653
I20260808 04:44:20.594728 8558 heartbeater.cc:464] Registering TS with master...
I20260808 04:44:20.595384 8558 heartbeater.cc:511] Master 127.20.240.254:38653 requested a full tablet report, sending...
I20260808 04:44:20.596563 8050 ts_manager.cc:194] Registered new tserver with Master: 2e45193c9c9e440e83fdd3d762d478d3 (127.20.240.195:40747)
I20260808 04:44:20.597376 8050 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.20.240.195:55263
I20260808 04:44:20.605108 21443 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 04:44:20.611608 8095 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:20.607292 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41988 (local address 127.20.240.254:38653)
0808 04:44:20.607479 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:20.607484 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:20.607638 (+ 154us) server_negotiation.cc:407] Connection header received
0808 04:44:20.607817 (+ 179us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:20.607821 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:20.607874 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:20.607963 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:44:20.608279 (+ 316us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:20.608841 (+ 562us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:20.609829 (+ 988us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:20.610082 (+ 253us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:20.610191 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:20.611136 (+ 945us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:44:20.611139 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:44:20.611141 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 04:44:20.611155 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:44:20.611176 (+ 21us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 04:44:20.611185 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:44:20.611268 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0808 04:44:20.611363 (+ 95us) server_negotiation.cc:299] Negotiation successful
0808 04:44:20.611437 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
I20260808 04:44:20.614858 8050 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41988:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 04:44:20.618150 8050 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 04:44:20.634322 8570 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:20.628136 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37524 (local address 127.20.240.194:46689)
0808 04:44:20.629290 (+ 1154us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:20.629303 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:20.629326 (+ 23us) server_negotiation.cc:407] Connection header received
0808 04:44:20.629406 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:20.629411 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:20.629627 (+ 216us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:20.630129 (+ 502us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 04:44:20.630265 (+ 136us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:20.631086 (+ 821us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:20.632699 (+ 1613us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:20.633538 (+ 839us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:20.633687 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:20.633883 (+ 196us) server_negotiation.cc:1035] Waiting for connection context
0808 04:44:20.634038 (+ 155us) server_negotiation.cc:299] Negotiation successful
0808 04:44:20.634142 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1057,"thread_start_us":109,"threads_started":1}
I20260808 04:44:20.634315 8569 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:20.627953 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.194:46689 (local address 127.0.0.1:37524)
0808 04:44:20.628557 (+ 604us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:20.628615 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0808 04:44:20.628755 (+ 140us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:44:20.629807 (+ 1052us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:44:20.629826 (+ 19us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:44:20.629858 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 04:44:20.629978 (+ 120us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:44:20.629983 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:44:20.631203 (+ 1220us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:44:20.631209 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:44:20.632584 (+ 1375us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:44:20.632595 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:44:20.633707 (+ 1112us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:44:20.633711 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:44:20.633816 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:20.633854 (+ 38us) client_negotiation.cc:769] Sending connection context
0808 04:44:20.634007 (+ 153us) client_negotiation.cc:240] Negotiation successful
0808 04:44:20.634142 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":412,"mutex_wait_us":2,"thread_start_us":110,"threads_started":1}
I20260808 04:44:20.634816 8573 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:20.628795 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.195:40747 (local address 127.0.0.1:43452)
0808 04:44:20.629385 (+ 590us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:20.629397 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 04:44:20.629486 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:44:20.630138 (+ 652us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:44:20.630141 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:44:20.630157 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 04:44:20.630254 (+ 97us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:44:20.630260 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:44:20.631682 (+ 1422us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:44:20.631686 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:44:20.632804 (+ 1118us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:44:20.632811 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:44:20.634014 (+ 1203us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:44:20.634018 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:44:20.634131 (+ 113us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:20.634155 (+ 24us) client_negotiation.cc:769] Sending connection context
0808 04:44:20.634229 (+ 74us) client_negotiation.cc:240] Negotiation successful
0808 04:44:20.634299 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":534,"thread_start_us":144,"threads_started":1}
I20260808 04:44:20.635151 8571 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:20.628187 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.193:42501 (local address 127.0.0.1:35872)
0808 04:44:20.629196 (+ 1009us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:20.629210 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 04:44:20.629380 (+ 170us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:44:20.630070 (+ 690us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:44:20.630076 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:44:20.630098 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 04:44:20.630194 (+ 96us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:44:20.630200 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:44:20.632043 (+ 1843us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:44:20.632047 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:44:20.633316 (+ 1269us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:44:20.633328 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:44:20.634728 (+ 1400us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:44:20.634732 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:44:20.634846 (+ 114us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:20.634868 (+ 22us) client_negotiation.cc:769] Sending connection context
0808 04:44:20.634957 (+ 89us) client_negotiation.cc:240] Negotiation successful
0808 04:44:20.635026 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":919,"mutex_wait_us":1,"thread_start_us":92,"threads_started":1}
I20260808 04:44:20.635429 8575 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:20.628961 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43452 (local address 127.20.240.195:40747)
0808 04:44:20.629714 (+ 753us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:20.629726 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:20.629748 (+ 22us) server_negotiation.cc:407] Connection header received
0808 04:44:20.629824 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:20.629830 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:20.629990 (+ 160us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:20.630137 (+ 147us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 04:44:20.630371 (+ 234us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:20.631552 (+ 1181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:20.632924 (+ 1372us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:20.633673 (+ 749us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:20.633793 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:20.633948 (+ 155us) server_negotiation.cc:1035] Waiting for connection context
0808 04:44:20.634840 (+ 892us) server_negotiation.cc:299] Negotiation successful
0808 04:44:20.635093 (+ 253us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":658,"thread_start_us":149,"threads_started":1}
I20260808 04:44:20.635676 8572 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:20.628675 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35872 (local address 127.20.240.193:42501)
0808 04:44:20.629063 (+ 388us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:20.629070 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:20.629300 (+ 230us) server_negotiation.cc:407] Connection header received
0808 04:44:20.629547 (+ 247us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:20.629554 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:20.629745 (+ 191us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:20.629876 (+ 131us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 04:44:20.630371 (+ 495us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:20.631552 (+ 1181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:20.633452 (+ 1900us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:20.634370 (+ 918us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:20.634503 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:20.634669 (+ 166us) server_negotiation.cc:1035] Waiting for connection context
0808 04:44:20.635389 (+ 720us) server_negotiation.cc:299] Negotiation successful
0808 04:44:20.635511 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":280,"thread_start_us":82,"threads_started":1}
I20260808 04:44:20.637818 8337 tablet_service.cc:1467] Processing CreateTablet for tablet d50e80cebd8c449d878ee67dc3678f1c (DEFAULT_TABLE table=test-table [id=9a1bbecf58984a10951e1fe746bc9a2d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 04:44:20.638023 8190 tablet_service.cc:1467] Processing CreateTablet for tablet d50e80cebd8c449d878ee67dc3678f1c (DEFAULT_TABLE table=test-table [id=9a1bbecf58984a10951e1fe746bc9a2d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 04:44:20.638172 8482 tablet_service.cc:1467] Processing CreateTablet for tablet d50e80cebd8c449d878ee67dc3678f1c (DEFAULT_TABLE table=test-table [id=9a1bbecf58984a10951e1fe746bc9a2d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 04:44:20.639019 8190 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d50e80cebd8c449d878ee67dc3678f1c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:44:20.639050 8482 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d50e80cebd8c449d878ee67dc3678f1c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:44:20.639051 8337 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d50e80cebd8c449d878ee67dc3678f1c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:44:20.646126 8576 tablet_bootstrap.cc:492] T d50e80cebd8c449d878ee67dc3678f1c P 03d53d118b784bd29011f1fa97d6e69f: Bootstrap starting.
I20260808 04:44:20.647328 8579 tablet_bootstrap.cc:492] T d50e80cebd8c449d878ee67dc3678f1c P 2e45193c9c9e440e83fdd3d762d478d3: Bootstrap starting.
I20260808 04:44:20.647502 8577 tablet_bootstrap.cc:492] T d50e80cebd8c449d878ee67dc3678f1c P c1e2f18918354999812f66ce99a57b6f: Bootstrap starting.
I20260808 04:44:20.648638 8576 tablet_bootstrap.cc:654] T d50e80cebd8c449d878ee67dc3678f1c P 03d53d118b784bd29011f1fa97d6e69f: Neither blocks nor log segments found. Creating new log.
I20260808 04:44:20.649508 8576 log.cc:824] T d50e80cebd8c449d878ee67dc3678f1c P 03d53d118b784bd29011f1fa97d6e69f: Log is configured to *not* fsync() on all Append() calls
I20260808 04:44:20.649699 8579 tablet_bootstrap.cc:654] T d50e80cebd8c449d878ee67dc3678f1c P 2e45193c9c9e440e83fdd3d762d478d3: Neither blocks nor log segments found. Creating new log.
I20260808 04:44:20.649699 8577 tablet_bootstrap.cc:654] T d50e80cebd8c449d878ee67dc3678f1c P c1e2f18918354999812f66ce99a57b6f: Neither blocks nor log segments found. Creating new log.
I20260808 04:44:20.650570 8579 log.cc:824] T d50e80cebd8c449d878ee67dc3678f1c P 2e45193c9c9e440e83fdd3d762d478d3: Log is configured to *not* fsync() on all Append() calls
I20260808 04:44:20.650570 8577 log.cc:824] T d50e80cebd8c449d878ee67dc3678f1c P c1e2f18918354999812f66ce99a57b6f: Log is configured to *not* fsync() on all Append() calls
I20260808 04:44:20.651821 8576 tablet_bootstrap.cc:492] T d50e80cebd8c449d878ee67dc3678f1c P 03d53d118b784bd29011f1fa97d6e69f: No bootstrap required, opened a new log
I20260808 04:44:20.652045 8576 ts_tablet_manager.cc:1397] T d50e80cebd8c449d878ee67dc3678f1c P 03d53d118b784bd29011f1fa97d6e69f: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260808 04:44:20.652544 8579 tablet_bootstrap.cc:492] T d50e80cebd8c449d878ee67dc3678f1c P 2e45193c9c9e440e83fdd3d762d478d3: No bootstrap required, opened a new log
I20260808 04:44:20.652544 8577 tablet_bootstrap.cc:492] T d50e80cebd8c449d878ee67dc3678f1c P c1e2f18918354999812f66ce99a57b6f: No bootstrap required, opened a new log
I20260808 04:44:20.652732 8577 ts_tablet_manager.cc:1397] T d50e80cebd8c449d878ee67dc3678f1c P c1e2f18918354999812f66ce99a57b6f: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260808 04:44:20.652732 8579 ts_tablet_manager.cc:1397] T d50e80cebd8c449d878ee67dc3678f1c P 2e45193c9c9e440e83fdd3d762d478d3: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260808 04:44:20.655550 8576 raft_consensus.cc:348] T d50e80cebd8c449d878ee67dc3678f1c P 03d53d118b784bd29011f1fa97d6e69f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1e2f18918354999812f66ce99a57b6f" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 46689 } } peers { permanent_uuid: "03d53d118b784bd29011f1fa97d6e69f" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 42501 } } peers { permanent_uuid: "2e45193c9c9e440e83fdd3d762d478d3" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 40747 } }
I20260808 04:44:20.655841 8576 raft_consensus.cc:374] T d50e80cebd8c449d878ee67dc3678f1c P 03d53d118b784bd29011f1fa97d6e69f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:44:20.655906 8576 raft_consensus.cc:729] T d50e80cebd8c449d878ee67dc3678f1c P 03d53d118b784bd29011f1fa97d6e69f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03d53d118b784bd29011f1fa97d6e69f, State: Initialized, Role: FOLLOWER
I20260808 04:44:20.656386 8576 consensus_queue.cc:260] T d50e80cebd8c449d878ee67dc3678f1c P 03d53d118b784bd29011f1fa97d6e69f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1e2f18918354999812f66ce99a57b6f" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 46689 } } peers { permanent_uuid: "03d53d118b784bd29011f1fa97d6e69f" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 42501 } } peers { permanent_uuid: "2e45193c9c9e440e83fdd3d762d478d3" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 40747 } }
I20260808 04:44:20.657534 8576 ts_tablet_manager.cc:1428] T d50e80cebd8c449d878ee67dc3678f1c P 03d53d118b784bd29011f1fa97d6e69f: Time spent starting tablet: real 0.005s user 0.007s sys 0.000s
I20260808 04:44:20.657195 8577 raft_consensus.cc:348] T d50e80cebd8c449d878ee67dc3678f1c P c1e2f18918354999812f66ce99a57b6f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1e2f18918354999812f66ce99a57b6f" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 46689 } } peers { permanent_uuid: "03d53d118b784bd29011f1fa97d6e69f" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 42501 } } peers { permanent_uuid: "2e45193c9c9e440e83fdd3d762d478d3" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 40747 } }
I20260808 04:44:20.657294 8579 raft_consensus.cc:348] T d50e80cebd8c449d878ee67dc3678f1c P 2e45193c9c9e440e83fdd3d762d478d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1e2f18918354999812f66ce99a57b6f" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 46689 } } peers { permanent_uuid: "03d53d118b784bd29011f1fa97d6e69f" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 42501 } } peers { permanent_uuid: "2e45193c9c9e440e83fdd3d762d478d3" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 40747 } }
I20260808 04:44:20.657634 8579 raft_consensus.cc:374] T d50e80cebd8c449d878ee67dc3678f1c P 2e45193c9c9e440e83fdd3d762d478d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:44:20.657624 8577 raft_consensus.cc:374] T d50e80cebd8c449d878ee67dc3678f1c P c1e2f18918354999812f66ce99a57b6f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:44:20.657688 8579 raft_consensus.cc:729] T d50e80cebd8c449d878ee67dc3678f1c P 2e45193c9c9e440e83fdd3d762d478d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e45193c9c9e440e83fdd3d762d478d3, State: Initialized, Role: FOLLOWER
I20260808 04:44:20.658277 8259 heartbeater.cc:503] Master 127.20.240.254:38653 was elected leader, sending a full tablet report...
I20260808 04:44:20.658239 8579 consensus_queue.cc:260] T d50e80cebd8c449d878ee67dc3678f1c P 2e45193c9c9e440e83fdd3d762d478d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1e2f18918354999812f66ce99a57b6f" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 46689 } } peers { permanent_uuid: "03d53d118b784bd29011f1fa97d6e69f" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 42501 } } peers { permanent_uuid: "2e45193c9c9e440e83fdd3d762d478d3" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 40747 } }
I20260808 04:44:20.659443 8579 ts_tablet_manager.cc:1428] T d50e80cebd8c449d878ee67dc3678f1c P 2e45193c9c9e440e83fdd3d762d478d3: Time spent starting tablet: real 0.007s user 0.007s sys 0.000s
I20260808 04:44:20.659924 8558 heartbeater.cc:503] Master 127.20.240.254:38653 was elected leader, sending a full tablet report...
I20260808 04:44:20.657688 8577 raft_consensus.cc:729] T d50e80cebd8c449d878ee67dc3678f1c P c1e2f18918354999812f66ce99a57b6f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c1e2f18918354999812f66ce99a57b6f, State: Initialized, Role: FOLLOWER
I20260808 04:44:20.661676 8577 consensus_queue.cc:260] T d50e80cebd8c449d878ee67dc3678f1c P c1e2f18918354999812f66ce99a57b6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1e2f18918354999812f66ce99a57b6f" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 46689 } } peers { permanent_uuid: "03d53d118b784bd29011f1fa97d6e69f" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 42501 } } peers { permanent_uuid: "2e45193c9c9e440e83fdd3d762d478d3" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 40747 } }
I20260808 04:44:20.662647 8409 heartbeater.cc:503] Master 127.20.240.254:38653 was elected leader, sending a full tablet report...
I20260808 04:44:20.663901 8577 ts_tablet_manager.cc:1428] T d50e80cebd8c449d878ee67dc3678f1c P c1e2f18918354999812f66ce99a57b6f: Time spent starting tablet: real 0.011s user 0.008s sys 0.000s
W20260808 04:44:20.664634 8260 tablet.cc:2369] T d50e80cebd8c449d878ee67dc3678f1c P 03d53d118b784bd29011f1fa97d6e69f: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 04:44:20.762813 8583 raft_consensus.cc:482] T d50e80cebd8c449d878ee67dc3678f1c P 03d53d118b784bd29011f1fa97d6e69f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 04:44:20.763144 8583 raft_consensus.cc:504] T d50e80cebd8c449d878ee67dc3678f1c P 03d53d118b784bd29011f1fa97d6e69f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1e2f18918354999812f66ce99a57b6f" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 46689 } } peers { permanent_uuid: "03d53d118b784bd29011f1fa97d6e69f" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 42501 } } peers { permanent_uuid: "2e45193c9c9e440e83fdd3d762d478d3" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 40747 } }
I20260808 04:44:20.764441 8583 leader_election.cc:288] T d50e80cebd8c449d878ee67dc3678f1c P 03d53d118b784bd29011f1fa97d6e69f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c1e2f18918354999812f66ce99a57b6f (127.20.240.194:46689), 2e45193c9c9e440e83fdd3d762d478d3 (127.20.240.195:40747)
I20260808 04:44:20.769374 8570 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:20.765025 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.240.193:38285 (local address 127.20.240.194:46689)
0808 04:44:20.765246 (+ 221us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:20.765253 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:20.765270 (+ 17us) server_negotiation.cc:407] Connection header received
0808 04:44:20.765455 (+ 185us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:20.765461 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:20.765523 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:20.765615 (+ 92us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 04:44:20.766087 (+ 472us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:20.766748 (+ 661us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:20.768107 (+ 1359us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:20.768595 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:20.768705 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:20.768745 (+ 40us) server_negotiation.cc:1035] Waiting for connection context
0808 04:44:20.769101 (+ 356us) server_negotiation.cc:299] Negotiation successful
0808 04:44:20.769219 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260808 04:44:20.769407 8586 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:20.764778 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.194:46689 (local address 127.20.240.193:38285)
0808 04:44:20.765115 (+ 337us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:20.765135 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0808 04:44:20.765304 (+ 169us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:44:20.765648 (+ 344us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:44:20.765650 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:44:20.765672 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 04:44:20.765896 (+ 224us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:44:20.765905 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:44:20.766883 (+ 978us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:44:20.766887 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:44:20.767943 (+ 1056us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:44:20.767953 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:44:20.768745 (+ 792us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:44:20.768749 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:44:20.768916 (+ 167us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:20.768963 (+ 47us) client_negotiation.cc:769] Sending connection context
0808 04:44:20.769048 (+ 85us) client_negotiation.cc:240] Negotiation successful
0808 04:44:20.769147 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":222,"mutex_wait_us":21,"thread_start_us":122,"threads_started":1}
I20260808 04:44:20.769584 8575 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:20.765354 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.240.193:52395 (local address 127.20.240.195:40747)
0808 04:44:20.765510 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:20.765515 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:20.765766 (+ 251us) server_negotiation.cc:407] Connection header received
0808 04:44:20.765877 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:20.765880 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:20.765939 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:20.766030 (+ 91us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 04:44:20.766407 (+ 377us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:20.767043 (+ 636us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:20.768301 (+ 1258us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:20.768876 (+ 575us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:20.769022 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:20.769079 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0808 04:44:20.769336 (+ 257us) server_negotiation.cc:299] Negotiation successful
0808 04:44:20.769435 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260808 04:44:20.769886 8587 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:20.765283 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.195:40747 (local address 127.20.240.193:52395)
0808 04:44:20.765652 (+ 369us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:20.765667 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 04:44:20.765771 (+ 104us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:44:20.766088 (+ 317us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:44:20.766091 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:44:20.766111 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 04:44:20.766246 (+ 135us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:44:20.766252 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:44:20.767203 (+ 951us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:44:20.767206 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:44:20.768161 (+ 955us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:44:20.768171 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:44:20.769078 (+ 907us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:44:20.769082 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:44:20.769197 (+ 115us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:20.769219 (+ 22us) client_negotiation.cc:769] Sending connection context
0808 04:44:20.769300 (+ 81us) client_negotiation.cc:240] Negotiation successful
0808 04:44:20.769366 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":283,"mutex_wait_us":25,"thread_start_us":141,"threads_started":1}
I20260808 04:44:20.770391 8358 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d50e80cebd8c449d878ee67dc3678f1c" candidate_uuid: "03d53d118b784bd29011f1fa97d6e69f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1e2f18918354999812f66ce99a57b6f" is_pre_election: true
I20260808 04:44:20.770519 8506 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d50e80cebd8c449d878ee67dc3678f1c" candidate_uuid: "03d53d118b784bd29011f1fa97d6e69f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e45193c9c9e440e83fdd3d762d478d3" is_pre_election: true
I20260808 04:44:20.770762 8506 raft_consensus.cc:2454] T d50e80cebd8c449d878ee67dc3678f1c P 2e45193c9c9e440e83fdd3d762d478d3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 03d53d118b784bd29011f1fa97d6e69f in term 0.
I20260808 04:44:20.770762 8358 raft_consensus.cc:2454] T d50e80cebd8c449d878ee67dc3678f1c P c1e2f18918354999812f66ce99a57b6f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 03d53d118b784bd29011f1fa97d6e69f in term 0.
I20260808 04:44:20.771327 8137 leader_election.cc:302] T d50e80cebd8c449d878ee67dc3678f1c P 03d53d118b784bd29011f1fa97d6e69f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03d53d118b784bd29011f1fa97d6e69f, 2e45193c9c9e440e83fdd3d762d478d3; no voters:
I20260808 04:44:20.771675 8583 raft_consensus.cc:2781] T d50e80cebd8c449d878ee67dc3678f1c P 03d53d118b784bd29011f1fa97d6e69f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 04:44:20.771759 8583 raft_consensus.cc:482] T d50e80cebd8c449d878ee67dc3678f1c P 03d53d118b784bd29011f1fa97d6e69f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 04:44:20.771790 8583 raft_consensus.cc:3037] T d50e80cebd8c449d878ee67dc3678f1c P 03d53d118b784bd29011f1fa97d6e69f [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:44:20.773033 8583 raft_consensus.cc:504] T d50e80cebd8c449d878ee67dc3678f1c P 03d53d118b784bd29011f1fa97d6e69f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1e2f18918354999812f66ce99a57b6f" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 46689 } } peers { permanent_uuid: "03d53d118b784bd29011f1fa97d6e69f" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 42501 } } peers { permanent_uuid: "2e45193c9c9e440e83fdd3d762d478d3" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 40747 } }
I20260808 04:44:20.773464 8583 leader_election.cc:288] T d50e80cebd8c449d878ee67dc3678f1c P 03d53d118b784bd29011f1fa97d6e69f [CANDIDATE]: Term 1 election: Requested vote from peers c1e2f18918354999812f66ce99a57b6f (127.20.240.194:46689), 2e45193c9c9e440e83fdd3d762d478d3 (127.20.240.195:40747)
I20260808 04:44:20.773874 8358 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d50e80cebd8c449d878ee67dc3678f1c" candidate_uuid: "03d53d118b784bd29011f1fa97d6e69f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1e2f18918354999812f66ce99a57b6f"
I20260808 04:44:20.774060 8506 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d50e80cebd8c449d878ee67dc3678f1c" candidate_uuid: "03d53d118b784bd29011f1fa97d6e69f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e45193c9c9e440e83fdd3d762d478d3"
I20260808 04:44:20.774061 8358 raft_consensus.cc:3037] T d50e80cebd8c449d878ee67dc3678f1c P c1e2f18918354999812f66ce99a57b6f [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:44:20.774186 8506 raft_consensus.cc:3037] T d50e80cebd8c449d878ee67dc3678f1c P 2e45193c9c9e440e83fdd3d762d478d3 [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:44:20.775398 8506 raft_consensus.cc:2454] T d50e80cebd8c449d878ee67dc3678f1c P 2e45193c9c9e440e83fdd3d762d478d3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 03d53d118b784bd29011f1fa97d6e69f in term 1.
I20260808 04:44:20.775398 8358 raft_consensus.cc:2454] T d50e80cebd8c449d878ee67dc3678f1c P c1e2f18918354999812f66ce99a57b6f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 03d53d118b784bd29011f1fa97d6e69f in term 1.
I20260808 04:44:20.775725 8137 leader_election.cc:302] T d50e80cebd8c449d878ee67dc3678f1c P 03d53d118b784bd29011f1fa97d6e69f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03d53d118b784bd29011f1fa97d6e69f, c1e2f18918354999812f66ce99a57b6f; no voters:
I20260808 04:44:20.775929 8583 raft_consensus.cc:2781] T d50e80cebd8c449d878ee67dc3678f1c P 03d53d118b784bd29011f1fa97d6e69f [term 1 FOLLOWER]: Leader election won for term 1
I20260808 04:44:20.776190 8583 raft_consensus.cc:686] T d50e80cebd8c449d878ee67dc3678f1c P 03d53d118b784bd29011f1fa97d6e69f [term 1 LEADER]: Becoming Leader. State: Replica: 03d53d118b784bd29011f1fa97d6e69f, State: Running, Role: LEADER
I20260808 04:44:20.776538 8583 consensus_queue.cc:237] T d50e80cebd8c449d878ee67dc3678f1c P 03d53d118b784bd29011f1fa97d6e69f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1e2f18918354999812f66ce99a57b6f" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 46689 } } peers { permanent_uuid: "03d53d118b784bd29011f1fa97d6e69f" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 42501 } } peers { permanent_uuid: "2e45193c9c9e440e83fdd3d762d478d3" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 40747 } }
I20260808 04:44:20.779691 8050 catalog_manager.cc:5495] T d50e80cebd8c449d878ee67dc3678f1c P 03d53d118b784bd29011f1fa97d6e69f reported cstate change: term changed from 0 to 1, leader changed from <none> to 03d53d118b784bd29011f1fa97d6e69f (127.20.240.193). New cstate: current_term: 1 leader_uuid: "03d53d118b784bd29011f1fa97d6e69f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1e2f18918354999812f66ce99a57b6f" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 46689 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "03d53d118b784bd29011f1fa97d6e69f" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 42501 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2e45193c9c9e440e83fdd3d762d478d3" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 40747 } health_report { overall_health: UNKNOWN } } }
I20260808 04:44:20.827448 8572 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:20.823581 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35880 (local address 127.20.240.193:42501)
0808 04:44:20.823750 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:20.823756 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:20.823780 (+ 24us) server_negotiation.cc:407] Connection header received
0808 04:44:20.823861 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:20.823863 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:20.823920 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:20.824052 (+ 132us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 04:44:20.824329 (+ 277us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:20.824920 (+ 591us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:20.825852 (+ 932us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:20.826085 (+ 233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:20.826201 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:20.826562 (+ 361us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 04:44:20.827022 (+ 460us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 04:44:20.827159 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0808 04:44:20.827220 (+ 61us) server_negotiation.cc:299] Negotiation successful
0808 04:44:20.827293 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
W20260808 04:44:20.831691 8559 tablet.cc:2369] T d50e80cebd8c449d878ee67dc3678f1c P 2e45193c9c9e440e83fdd3d762d478d3: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 04:44:20.834630 8506 raft_consensus.cc:1261] T d50e80cebd8c449d878ee67dc3678f1c P 2e45193c9c9e440e83fdd3d762d478d3 [term 1 FOLLOWER]: Refusing update from remote peer 03d53d118b784bd29011f1fa97d6e69f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 04:44:20.834630 8358 raft_consensus.cc:1261] T d50e80cebd8c449d878ee67dc3678f1c P c1e2f18918354999812f66ce99a57b6f [term 1 FOLLOWER]: Refusing update from remote peer 03d53d118b784bd29011f1fa97d6e69f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 04:44:20.835498 8588 consensus_queue.cc:1035] T d50e80cebd8c449d878ee67dc3678f1c P 03d53d118b784bd29011f1fa97d6e69f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1e2f18918354999812f66ce99a57b6f" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 46689 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 04:44:20.835747 8583 consensus_queue.cc:1035] T d50e80cebd8c449d878ee67dc3678f1c P 03d53d118b784bd29011f1fa97d6e69f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e45193c9c9e440e83fdd3d762d478d3" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 40747 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 04:44:20.845034 8593 mvcc.cc:205] Tried to move back new op lower bound from 7316128812369915904 to 7316128812143464448. Current Snapshot: MvccSnapshot[applied={T|T < 7316128812369915904}]
I20260808 04:44:20.855145 8048 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41988:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 04:44:20.855366 8048 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41988:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 04:44:20.858333 8048 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2b6464c9fcd74237bf405fc543c7a01e: Sending DeleteTablet for 3 replicas of tablet d50e80cebd8c449d878ee67dc3678f1c
I20260808 04:44:20.859409 8190 tablet_service.cc:1514] Processing DeleteTablet for tablet d50e80cebd8c449d878ee67dc3678f1c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 04:44:20 UTC) from {username='slave'} at 127.0.0.1:35872
I20260808 04:44:20.859467 8337 tablet_service.cc:1514] Processing DeleteTablet for tablet d50e80cebd8c449d878ee67dc3678f1c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 04:44:20 UTC) from {username='slave'} at 127.0.0.1:37524
I20260808 04:44:20.859586 8482 tablet_service.cc:1514] Processing DeleteTablet for tablet d50e80cebd8c449d878ee67dc3678f1c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 04:44:20 UTC) from {username='slave'} at 127.0.0.1:43452
I20260808 04:44:20.860121 8605 tablet_replica.cc:330] T d50e80cebd8c449d878ee67dc3678f1c P 2e45193c9c9e440e83fdd3d762d478d3: stopping tablet replica
I20260808 04:44:20.860498 8605 raft_consensus.cc:2229] T d50e80cebd8c449d878ee67dc3678f1c P 2e45193c9c9e440e83fdd3d762d478d3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 04:44:20.860526 21443 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu with pid 8118
I20260808 04:44:20.861250 8605 raft_consensus.cc:2258] T d50e80cebd8c449d878ee67dc3678f1c P 2e45193c9c9e440e83fdd3d762d478d3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 04:44:20.863119 8605 ts_tablet_manager.cc:1905] T d50e80cebd8c449d878ee67dc3678f1c P 2e45193c9c9e440e83fdd3d762d478d3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 04:44:20.866595 8605 ts_tablet_manager.cc:1918] T d50e80cebd8c449d878ee67dc3678f1c P 2e45193c9c9e440e83fdd3d762d478d3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 04:44:20.866719 8605 log.cc:1196] T d50e80cebd8c449d878ee67dc3678f1c P 2e45193c9c9e440e83fdd3d762d478d3: Deleting WAL directory at /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786164000593138-21443-0/minicluster-data/ts-2/wal/wals/d50e80cebd8c449d878ee67dc3678f1c
I20260808 04:44:20.867057 8605 ts_tablet_manager.cc:1939] T d50e80cebd8c449d878ee67dc3678f1c P 2e45193c9c9e440e83fdd3d762d478d3: Deleting consensus metadata
I20260808 04:44:20.867477 8604 tablet_replica.cc:330] T d50e80cebd8c449d878ee67dc3678f1c P c1e2f18918354999812f66ce99a57b6f: stopping tablet replica
I20260808 04:44:20.867877 8604 raft_consensus.cc:2229] T d50e80cebd8c449d878ee67dc3678f1c P c1e2f18918354999812f66ce99a57b6f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 04:44:20.868263 8604 raft_consensus.cc:2258] T d50e80cebd8c449d878ee67dc3678f1c P c1e2f18918354999812f66ce99a57b6f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 04:44:20.868763 8031 catalog_manager.cc:4841] TS 2e45193c9c9e440e83fdd3d762d478d3 (127.20.240.195:40747): tablet d50e80cebd8c449d878ee67dc3678f1c (table test-table [id=9a1bbecf58984a10951e1fe746bc9a2d]) successfully deleted
I20260808 04:44:20.869848 8604 ts_tablet_manager.cc:1905] T d50e80cebd8c449d878ee67dc3678f1c P c1e2f18918354999812f66ce99a57b6f: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260808 04:44:20.871889 8033 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.20.240.193:42501 (error 108)
I20260808 04:44:20.872217 21443 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu with pid 8263
I20260808 04:44:20.872605 8604 ts_tablet_manager.cc:1918] T d50e80cebd8c449d878ee67dc3678f1c P c1e2f18918354999812f66ce99a57b6f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 04:44:20.873294 8571 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:20.872861 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.193:42501 (local address 127.0.0.1:35886)
0808 04:44:20.873122 (+ 261us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:20.873213 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.240.193:42501: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":180}
W20260808 04:44:20.873443 8033 catalog_manager.cc:4584] TS 03d53d118b784bd29011f1fa97d6e69f (127.20.240.193:42501): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet d50e80cebd8c449d878ee67dc3678f1c: Network error: Client connection negotiation failed: client connection to 127.20.240.193:42501: connect: Connection refused (error 111)
I20260808 04:44:20.879045 21443 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu with pid 8412
I20260808 04:44:20.879678 8571 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:20.879286 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.194:46689 (local address 127.0.0.1:37526)
0808 04:44:20.879511 (+ 225us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:20.879577 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.240.194:46689: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":124}
I20260808 04:44:20.886971 21443 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu with pid 8016
2026-08-08T04:44:20Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/1 (1246 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/2
Loading random data
Initializing database '/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786164000593138-21443-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 04:44:20 dist-test-slave-vxj2 krb5kdc[8609](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 04:44:20 dist-test-slave-vxj2 krb5kdc[8609](info): set up 2 sockets
Aug 08 04:44:20 dist-test-slave-vxj2 krb5kdc[8609](info): commencing operation
krb5kdc: starting...
W20260808 04:44:22.004326 21443 mini_kdc.cc:121] Time spent starting KDC: real 1.093s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786164000593138-21443-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786164000593138-21443-0/krb5kdc/test-user.keytab.
Aug 08 04:44:22 dist-test-slave-vxj2 krb5kdc[8609](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164262, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T04:44:22Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T04:44:22Z Disabled control of system clock
WARNING: no policy specified for kudu/127.20.240.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.240.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.240.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.254.keytab.
Entry for principal kudu/127.20.240.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.254.keytab.
I20260808 04:44:22.142028 21443 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
/tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786164000593138-21443-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786164000593138-21443-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786164000593138-21443-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786164000593138-21443-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.240.254:34573
--webserver_interface=127.20.240.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.254.keytab
--principal=kudu/127.20.240.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.240.212:39671
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.240.254:34573
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786164000593138-21443-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786164000593138-21443-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786164000593138-21443-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 04:44:22.258285 8623 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:44:22.258656 8623 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:44:22.258787 8623 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:44:22.262930 8623 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 04:44:22.263046 8623 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:44:22.263084 8623 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:44:22.263125 8623 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 04:44:22.263161 8623 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 04:44:22.268729 8623 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.240.212:39671
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786164000593138-21443-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786164000593138-21443-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.240.254:34573
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.254.keytab
--principal=kudu/127.20.240.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.240.254:34573
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786164000593138-21443-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.240.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8623
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786164000593138-21443-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 04:05:18 UTC on ccycloud.quasar-drfdgt.root.comops.site
build id 4574101
I20260808 04:44:22.270056 8623 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:44:22.271162 8623 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:44:22.280493 8630 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:44:22.280681 8623 server_base.cc:1034] running on GCE node
W20260808 04:44:22.280542 8633 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:44:22.280508 8629 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:44:22.281572 8623 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:44:22.282862 8623 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:44:22.284065 8623 hybrid_clock.cc:648] HybridClock initialized: now 1786164262284038 us; error 35 us; skew 500 ppm
Aug 08 04:44:22 dist-test-slave-vxj2 krb5kdc[8609](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164262, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.240.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:44:22.291594 8623 init.cc:377] Logged in from keytab as kudu/127.20.240.254@KRBTEST.COM (short username kudu)
I20260808 04:44:22.292900 8623 webserver.cc:460] Webserver started at http://127.20.240.254:45307/ using document root <none> and password file <none>
I20260808 04:44:22.293618 8623 fs_manager.cc:359] Metadata directory not provided
I20260808 04:44:22.293695 8623 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:44:22.293964 8623 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 04:44:22.296277 8623 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786164000593138-21443-0/minicluster-data/master-0/data/instance:
uuid: "2ddc81cdf8924e57b960a2de1bdcefa8"
format_stamp: "Formatted at 2026-08-08 04:44:22 on dist-test-slave-vxj2"
server_key: "9777da1a44960c9fdc09257028abfdb8"
server_key_iv: "390835e057423a192a08475b80f72abf"
server_key_version: "encryptionkey@0"
I20260808 04:44:22.296924 8623 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786164000593138-21443-0/minicluster-data/master-0/wal/instance:
uuid: "2ddc81cdf8924e57b960a2de1bdcefa8"
format_stamp: "Formatted at 2026-08-08 04:44:22 on dist-test-slave-vxj2"
server_key: "9777da1a44960c9fdc09257028abfdb8"
server_key_iv: "390835e057423a192a08475b80f72abf"
server_key_version: "encryptionkey@0"
I20260808 04:44:22.301395 8623 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260808 04:44:22.304163 8641 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:44:22.305776 8623 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 04:44:22.305929 8623 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786164000593138-21443-0/minicluster-data/master-0/data,/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786164000593138-21443-0/minicluster-data/master-0/wal
uuid: "2ddc81cdf8924e57b960a2de1bdcefa8"
format_stamp: "Formatted at 2026-08-08 04:44:22 on dist-test-slave-vxj2"
server_key: "9777da1a44960c9fdc09257028abfdb8"
server_key_iv: "390835e057423a192a08475b80f72abf"
server_key_version: "encryptionkey@0"
I20260808 04:44:22.306068 8623 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786164000593138-21443-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786164000593138-21443-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786164000593138-21443-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:44:22.322582 8623 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:44:22.326156 8623 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:44:22.326388 8623 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:44:22.333941 8623 rpc_server.cc:307] RPC server started. Bound to: 127.20.240.254:34573
I20260808 04:44:22.333969 8700 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.240.254:34573 every 8 connection(s)
I20260808 04:44:22.334941 8623 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786164000593138-21443-0/minicluster-data/master-0/data/info.pb
I20260808 04:44:22.337781 8701 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:44:22.339869 21443 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu as pid 8623
I20260808 04:44:22.340021 21443 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786164000593138-21443-0/minicluster-data/master-0/wal/instance
I20260808 04:44:22.340330 21443 external_mini_cluster.cc:1428] Setting key bd5df0306ebc26b5f6230f5a0281d792
I20260808 04:44:22.345095 8701 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2ddc81cdf8924e57b960a2de1bdcefa8: Bootstrap starting.
I20260808 04:44:22.347622 8701 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2ddc81cdf8924e57b960a2de1bdcefa8: Neither blocks nor log segments found. Creating new log.
I20260808 04:44:22.348603 8701 log.cc:824] T 00000000000000000000000000000000 P 2ddc81cdf8924e57b960a2de1bdcefa8: Log is configured to *not* fsync() on all Append() calls
Aug 08 04:44:22 dist-test-slave-vxj2 krb5kdc[8609](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164262, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.240.254@KRBTEST.COM
I20260808 04:44:22.351151 8701 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2ddc81cdf8924e57b960a2de1bdcefa8: No bootstrap required, opened a new log
I20260808 04:44:22.355484 8701 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2ddc81cdf8924e57b960a2de1bdcefa8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2ddc81cdf8924e57b960a2de1bdcefa8" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 34573 } }
I20260808 04:44:22.355755 8701 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2ddc81cdf8924e57b960a2de1bdcefa8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:44:22.355842 8701 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2ddc81cdf8924e57b960a2de1bdcefa8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ddc81cdf8924e57b960a2de1bdcefa8, State: Initialized, Role: FOLLOWER
I20260808 04:44:22.355868 8704 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:22.342108 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49830 (local address 127.20.240.254:34573)
0808 04:44:22.342613 (+ 505us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:22.342629 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:22.342666 (+ 37us) server_negotiation.cc:407] Connection header received
0808 04:44:22.343420 (+ 754us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:22.343442 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:22.343802 (+ 360us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:22.344174 (+ 372us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:44:22.345090 (+ 916us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:22.346217 (+ 1127us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:22.347142 (+ 925us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:22.347643 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:22.347847 (+ 204us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:22.350760 (+ 2913us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:44:22.350769 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:44:22.350786 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:44:22.350819 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:44:22.352742 (+ 1923us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:44:22.353349 (+ 607us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:44:22.353355 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:44:22.353359 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:44:22.353480 (+ 121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:44:22.353781 (+ 301us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:44:22.353783 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:44:22.353784 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:44:22.354230 (+ 446us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:44:22.354395 (+ 165us) server_negotiation.cc:1035] Waiting for connection context
0808 04:44:22.354693 (+ 298us) server_negotiation.cc:299] Negotiation successful
0808 04:44:22.355030 (+ 337us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":351,"thread_start_us":165,"threads_started":1}
I20260808 04:44:22.356390 8701 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2ddc81cdf8924e57b960a2de1bdcefa8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2ddc81cdf8924e57b960a2de1bdcefa8" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 34573 } }
I20260808 04:44:22.356566 8701 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2ddc81cdf8924e57b960a2de1bdcefa8 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 04:44:22.356634 8701 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2ddc81cdf8924e57b960a2de1bdcefa8 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 04:44:22.356729 8701 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2ddc81cdf8924e57b960a2de1bdcefa8 [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:44:22.357852 8701 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2ddc81cdf8924e57b960a2de1bdcefa8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2ddc81cdf8924e57b960a2de1bdcefa8" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 34573 } }
I20260808 04:44:22.358255 8701 leader_election.cc:302] T 00000000000000000000000000000000 P 2ddc81cdf8924e57b960a2de1bdcefa8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2ddc81cdf8924e57b960a2de1bdcefa8; no voters:
I20260808 04:44:22.358582 8701 leader_election.cc:288] T 00000000000000000000000000000000 P 2ddc81cdf8924e57b960a2de1bdcefa8 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 04:44:22.358706 8706 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2ddc81cdf8924e57b960a2de1bdcefa8 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 04:44:22.358914 8706 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2ddc81cdf8924e57b960a2de1bdcefa8 [term 1 LEADER]: Becoming Leader. State: Replica: 2ddc81cdf8924e57b960a2de1bdcefa8, State: Running, Role: LEADER
I20260808 04:44:22.359308 8706 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2ddc81cdf8924e57b960a2de1bdcefa8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2ddc81cdf8924e57b960a2de1bdcefa8" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 34573 } }
I20260808 04:44:22.359915 8701 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2ddc81cdf8924e57b960a2de1bdcefa8 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 04:44:22.361007 8708 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2ddc81cdf8924e57b960a2de1bdcefa8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2ddc81cdf8924e57b960a2de1bdcefa8. Latest consensus state: current_term: 1 leader_uuid: "2ddc81cdf8924e57b960a2de1bdcefa8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2ddc81cdf8924e57b960a2de1bdcefa8" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 34573 } } }
I20260808 04:44:22.361145 8708 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2ddc81cdf8924e57b960a2de1bdcefa8 [sys.catalog]: This master's current role is: LEADER
I20260808 04:44:22.361600 8715 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 04:44:22.361574 8707 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2ddc81cdf8924e57b960a2de1bdcefa8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2ddc81cdf8924e57b960a2de1bdcefa8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2ddc81cdf8924e57b960a2de1bdcefa8" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 34573 } } }
I20260808 04:44:22.361876 8707 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2ddc81cdf8924e57b960a2de1bdcefa8 [sys.catalog]: This master's current role is: LEADER
I20260808 04:44:22.364796 8715 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 04:44:22.370873 8715 catalog_manager.cc:1347] Generated new cluster ID: 522e8956a7044de3911fe1af9303a901
I20260808 04:44:22.370967 8715 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 04:44:22.381130 8715 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 04:44:22.382501 8715 catalog_manager.cc:1504] Loading token signing keys...
I20260808 04:44:22.393357 8715 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2ddc81cdf8924e57b960a2de1bdcefa8: Generated new TSK 0
I20260808 04:44:22.394146 8715 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.20.240.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.240.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.240.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.193.keytab.
Entry for principal kudu/127.20.240.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.193.keytab.
I20260808 04:44:22.428745 21443 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
/tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786164000593138-21443-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786164000593138-21443-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786164000593138-21443-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786164000593138-21443-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.240.193:0
--local_ip_for_outbound_sockets=127.20.240.193
--webserver_interface=127.20.240.193
--webserver_port=0
--tserver_master_addrs=127.20.240.254:34573
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.193.keytab
--principal=kudu/127.20.240.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.240.212:39671
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786164000593138-21443-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786164000593138-21443-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786164000593138-21443-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 04:44:22.547699 8729 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:44:22.548012 8729 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:44:22.548058 8729 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:44:22.552213 8729 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:44:22.552292 8729 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:44:22.552356 8729 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.240.193
I20260808 04:44:22.557880 8729 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.240.212:39671
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786164000593138-21443-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786164000593138-21443-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.193.keytab
--principal=kudu/127.20.240.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.240.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786164000593138-21443-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.240.193
--webserver_port=0
--tserver_master_addrs=127.20.240.254:34573
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8729
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.240.193
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786164000593138-21443-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 04:05:18 UTC on ccycloud.quasar-drfdgt.root.comops.site
build id 4574101
I20260808 04:44:22.559082 8729 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:44:22.560250 8729 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:44:22.570756 8736 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:44:22.570775 8735 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:44:22.570747 8738 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:44:22.571221 8729 server_base.cc:1034] running on GCE node
I20260808 04:44:22.571702 8729 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:44:22.572397 8729 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:44:22.573565 8729 hybrid_clock.cc:648] HybridClock initialized: now 1786164262573540 us; error 41 us; skew 500 ppm
Aug 08 04:44:22 dist-test-slave-vxj2 krb5kdc[8609](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164262, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.240.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:44:22.576537 8729 init.cc:377] Logged in from keytab as kudu/127.20.240.193@KRBTEST.COM (short username kudu)
I20260808 04:44:22.577524 8729 webserver.cc:460] Webserver started at http://127.20.240.193:41401/ using document root <none> and password file <none>
I20260808 04:44:22.578243 8729 fs_manager.cc:359] Metadata directory not provided
I20260808 04:44:22.578349 8729 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:44:22.578598 8729 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 04:44:22.580761 8729 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786164000593138-21443-0/minicluster-data/ts-0/data/instance:
uuid: "8ab4387d8f5f4c2d953fec5d707f11a5"
format_stamp: "Formatted at 2026-08-08 04:44:22 on dist-test-slave-vxj2"
server_key: "775a90420508e74bcde0981757cef425"
server_key_iv: "b9907abea59155c7aa4882239ff53479"
server_key_version: "encryptionkey@0"
I20260808 04:44:22.581398 8729 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786164000593138-21443-0/minicluster-data/ts-0/wal/instance:
uuid: "8ab4387d8f5f4c2d953fec5d707f11a5"
format_stamp: "Formatted at 2026-08-08 04:44:22 on dist-test-slave-vxj2"
server_key: "775a90420508e74bcde0981757cef425"
server_key_iv: "b9907abea59155c7aa4882239ff53479"
server_key_version: "encryptionkey@0"
I20260808 04:44:22.585449 8729 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260808 04:44:22.588127 8746 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:44:22.589651 8729 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 04:44:22.589828 8729 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786164000593138-21443-0/minicluster-data/ts-0/data,/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786164000593138-21443-0/minicluster-data/ts-0/wal
uuid: "8ab4387d8f5f4c2d953fec5d707f11a5"
format_stamp: "Formatted at 2026-08-08 04:44:22 on dist-test-slave-vxj2"
server_key: "775a90420508e74bcde0981757cef425"
server_key_iv: "b9907abea59155c7aa4882239ff53479"
server_key_version: "encryptionkey@0"
I20260808 04:44:22.589969 8729 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786164000593138-21443-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786164000593138-21443-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786164000593138-21443-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:44:22.616375 8729 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:44:22.620186 8729 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:44:22.620456 8729 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:44:22.621198 8729 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 04:44:22.622198 8729 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 04:44:22.622283 8729 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 04:44:22.622354 8729 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 04:44:22.622399 8729 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 04:44:22.631975 8729 rpc_server.cc:307] RPC server started. Bound to: 127.20.240.193:35009
I20260808 04:44:22.631992 8874 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.240.193:35009 every 8 connection(s)
I20260808 04:44:22.632921 8729 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786164000593138-21443-0/minicluster-data/ts-0/data/info.pb
I20260808 04:44:22.636510 21443 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu as pid 8729
I20260808 04:44:22.636686 21443 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786164000593138-21443-0/minicluster-data/ts-0/wal/instance
I20260808 04:44:22.637027 21443 external_mini_cluster.cc:1428] Setting key 5d70ba682f22cd61e7cab23d7de4de0f
Aug 08 04:44:22 dist-test-slave-vxj2 krb5kdc[8609](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164262, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.240.193@KRBTEST.COM for kudu/127.20.240.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.20.240.194@KRBTEST.COM; defaulting to no policy
I20260808 04:44:22.650070 8704 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:22.634859 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.240.193:51797 (local address 127.20.240.254:34573)
0808 04:44:22.635006 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:22.635010 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:22.635851 (+ 841us) server_negotiation.cc:407] Connection header received
0808 04:44:22.637730 (+ 1879us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:22.637733 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:22.637790 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:22.637906 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:44:22.639397 (+ 1491us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:22.639984 (+ 587us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:22.641283 (+ 1299us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:22.641573 (+ 290us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:22.641708 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:22.645216 (+ 3508us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:44:22.645221 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:44:22.645226 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:44:22.645270 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:44:22.647295 (+ 2025us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:44:22.647952 (+ 657us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:44:22.647957 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:44:22.647961 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:44:22.648071 (+ 110us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:44:22.648485 (+ 414us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:44:22.648490 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:44:22.648492 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:44:22.648801 (+ 309us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:44:22.648953 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0808 04:44:22.649591 (+ 638us) server_negotiation.cc:299] Negotiation successful
0808 04:44:22.649767 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260808 04:44:22.651016 8878 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:22.635202 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:34573 (local address 127.20.240.193:51797)
0808 04:44:22.635682 (+ 480us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:22.635726 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0808 04:44:22.637482 (+ 1756us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:44:22.638099 (+ 617us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:44:22.638107 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:44:22.638639 (+ 532us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:44:22.639224 (+ 585us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:44:22.639241 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:44:22.640137 (+ 896us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:44:22.640148 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:44:22.641085 (+ 937us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:44:22.641096 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:44:22.641765 (+ 669us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:44:22.641770 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:44:22.642034 (+ 264us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:22.642794 (+ 760us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:44:22.642824 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:44:22.644960 (+ 2136us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:44:22.647456 (+ 2496us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:44:22.647462 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:44:22.647476 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:44:22.647824 (+ 348us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:44:22.648206 (+ 382us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:44:22.648209 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:44:22.648210 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:44:22.648365 (+ 155us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:44:22.648974 (+ 609us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:44:22.648980 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:44:22.649330 (+ 350us) client_negotiation.cc:769] Sending connection context
0808 04:44:22.649514 (+ 184us) client_negotiation.cc:240] Negotiation successful
0808 04:44:22.649945 (+ 431us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":287,"thread_start_us":123,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.240.194@KRBTEST.COM" created.
I20260808 04:44:22.652467 8875 heartbeater.cc:347] Connected to a master server at 127.20.240.254:34573
I20260808 04:44:22.652737 8875 heartbeater.cc:464] Registering TS with master...
I20260808 04:44:22.653543 8875 heartbeater.cc:511] Master 127.20.240.254:34573 requested a full tablet report, sending...
I20260808 04:44:22.655166 8663 ts_manager.cc:194] Registered new tserver with Master: 8ab4387d8f5f4c2d953fec5d707f11a5 (127.20.240.193:35009)
I20260808 04:44:22.656410 8663 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.240.193@KRBTEST.COM'} at 127.20.240.193:51797
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.240.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.194.keytab.
Entry for principal kudu/127.20.240.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.194.keytab.
I20260808 04:44:22.669286 21443 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
/tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786164000593138-21443-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786164000593138-21443-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786164000593138-21443-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786164000593138-21443-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.240.194:0
--local_ip_for_outbound_sockets=127.20.240.194
--webserver_interface=127.20.240.194
--webserver_port=0
--tserver_master_addrs=127.20.240.254:34573
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.194.keytab
--principal=kudu/127.20.240.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.240.212:39671
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786164000593138-21443-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786164000593138-21443-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786164000593138-21443-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 04:44:22.783257 8882 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:44:22.783550 8882 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:44:22.783596 8882 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:44:22.787739 8882 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:44:22.787825 8882 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:44:22.787894 8882 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.240.194
I20260808 04:44:22.793853 8882 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.240.212:39671
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786164000593138-21443-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786164000593138-21443-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.194.keytab
--principal=kudu/127.20.240.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.240.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786164000593138-21443-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.240.194
--webserver_port=0
--tserver_master_addrs=127.20.240.254:34573
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8882
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.240.194
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786164000593138-21443-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 04:05:18 UTC on ccycloud.quasar-drfdgt.root.comops.site
build id 4574101
I20260808 04:44:22.795068 8882 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:44:22.796113 8882 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260808 04:44:22.806582 8882 server_base.cc:1034] running on GCE node
W20260808 04:44:22.806512 8888 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:44:22.806512 8890 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:44:22.806497 8887 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:44:22.807356 8882 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:44:22.808086 8882 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:44:22.809289 8882 hybrid_clock.cc:648] HybridClock initialized: now 1786164262809216 us; error 55 us; skew 500 ppm
Aug 08 04:44:22 dist-test-slave-vxj2 krb5kdc[8609](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164262, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.240.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:44:22.812369 8882 init.cc:377] Logged in from keytab as kudu/127.20.240.194@KRBTEST.COM (short username kudu)
I20260808 04:44:22.813346 8882 webserver.cc:460] Webserver started at http://127.20.240.194:42637/ using document root <none> and password file <none>
I20260808 04:44:22.813895 8882 fs_manager.cc:359] Metadata directory not provided
I20260808 04:44:22.813962 8882 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:44:22.814131 8882 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 04:44:22.816329 8882 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786164000593138-21443-0/minicluster-data/ts-1/data/instance:
uuid: "356dc845410747b8b30d54e45e60cd39"
format_stamp: "Formatted at 2026-08-08 04:44:22 on dist-test-slave-vxj2"
server_key: "03a6a3f5b669b0a06a81b33b64d6d34c"
server_key_iv: "02a1b8fcd0b3eec6cfcc57771490fec8"
server_key_version: "encryptionkey@0"
I20260808 04:44:22.816919 8882 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786164000593138-21443-0/minicluster-data/ts-1/wal/instance:
uuid: "356dc845410747b8b30d54e45e60cd39"
format_stamp: "Formatted at 2026-08-08 04:44:22 on dist-test-slave-vxj2"
server_key: "03a6a3f5b669b0a06a81b33b64d6d34c"
server_key_iv: "02a1b8fcd0b3eec6cfcc57771490fec8"
server_key_version: "encryptionkey@0"
I20260808 04:44:22.821041 8882 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.001s
I20260808 04:44:22.823679 8897 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:44:22.825098 8882 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260808 04:44:22.825325 8882 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786164000593138-21443-0/minicluster-data/ts-1/data,/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786164000593138-21443-0/minicluster-data/ts-1/wal
uuid: "356dc845410747b8b30d54e45e60cd39"
format_stamp: "Formatted at 2026-08-08 04:44:22 on dist-test-slave-vxj2"
server_key: "03a6a3f5b669b0a06a81b33b64d6d34c"
server_key_iv: "02a1b8fcd0b3eec6cfcc57771490fec8"
server_key_version: "encryptionkey@0"
I20260808 04:44:22.825470 8882 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786164000593138-21443-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786164000593138-21443-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786164000593138-21443-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:44:22.858503 8882 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:44:22.862242 8882 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:44:22.862471 8882 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:44:22.863137 8882 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 04:44:22.864020 8882 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 04:44:22.864070 8882 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 04:44:22.864112 8882 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 04:44:22.864152 8882 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 04:44:22.873512 8882 rpc_server.cc:307] RPC server started. Bound to: 127.20.240.194:40117
I20260808 04:44:22.873538 9023 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.240.194:40117 every 8 connection(s)
I20260808 04:44:22.874459 8882 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786164000593138-21443-0/minicluster-data/ts-1/data/info.pb
I20260808 04:44:22.877221 21443 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu as pid 8882
I20260808 04:44:22.877378 21443 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786164000593138-21443-0/minicluster-data/ts-1/wal/instance
I20260808 04:44:22.877761 21443 external_mini_cluster.cc:1428] Setting key 298c89df9c439a8a40ab99114efcf966
Aug 08 04:44:22 dist-test-slave-vxj2 krb5kdc[8609](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164262, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.240.194@KRBTEST.COM for kudu/127.20.240.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.20.240.195@KRBTEST.COM; defaulting to no policy
I20260808 04:44:22.890478 8704 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:22.876369 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.240.194:53565 (local address 127.20.240.254:34573)
0808 04:44:22.876556 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:22.876561 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:22.877648 (+ 1087us) server_negotiation.cc:407] Connection header received
0808 04:44:22.879517 (+ 1869us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:22.879521 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:22.879576 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:22.879667 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:44:22.880964 (+ 1297us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:22.881641 (+ 677us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:22.883136 (+ 1495us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:22.883397 (+ 261us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:22.883524 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:22.886490 (+ 2966us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:44:22.886493 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:44:22.886496 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:44:22.886524 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:44:22.888107 (+ 1583us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:44:22.888703 (+ 596us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:44:22.888708 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:44:22.888710 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:44:22.888804 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:44:22.889192 (+ 388us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:44:22.889197 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:44:22.889204 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:44:22.889455 (+ 251us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:44:22.889565 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0808 04:44:22.890139 (+ 574us) server_negotiation.cc:299] Negotiation successful
0808 04:44:22.890294 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260808 04:44:22.891340 9026 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:22.876762 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:34573 (local address 127.20.240.194:53565)
0808 04:44:22.877451 (+ 689us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:22.877518 (+ 67us) client_negotiation.cc:174] Beginning negotiation
0808 04:44:22.879248 (+ 1730us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:44:22.879866 (+ 618us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:44:22.879874 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:44:22.880275 (+ 401us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:44:22.880805 (+ 530us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:44:22.880822 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:44:22.881792 (+ 970us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:44:22.881801 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:44:22.882964 (+ 1163us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:44:22.882977 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:44:22.883585 (+ 608us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:44:22.883589 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:44:22.883826 (+ 237us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:22.884541 (+ 715us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:44:22.884559 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:44:22.886269 (+ 1710us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:44:22.888236 (+ 1967us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:44:22.888243 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:44:22.888262 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:44:22.888590 (+ 328us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:44:22.888903 (+ 313us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:44:22.888906 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:44:22.888908 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:44:22.889070 (+ 162us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:44:22.889576 (+ 506us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:44:22.889584 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:44:22.889878 (+ 294us) client_negotiation.cc:769] Sending connection context
0808 04:44:22.890080 (+ 202us) client_negotiation.cc:240] Negotiation successful
0808 04:44:22.890444 (+ 364us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":389,"thread_start_us":171,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.240.195@KRBTEST.COM" created.
I20260808 04:44:22.892709 9024 heartbeater.cc:347] Connected to a master server at 127.20.240.254:34573
I20260808 04:44:22.893031 9024 heartbeater.cc:464] Registering TS with master...
I20260808 04:44:22.893867 9024 heartbeater.cc:511] Master 127.20.240.254:34573 requested a full tablet report, sending...
I20260808 04:44:22.895349 8663 ts_manager.cc:194] Registered new tserver with Master: 356dc845410747b8b30d54e45e60cd39 (127.20.240.194:40117)
I20260808 04:44:22.896030 8663 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.240.194@KRBTEST.COM'} at 127.20.240.194:53565
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.240.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.195.keytab.
Entry for principal kudu/127.20.240.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.195.keytab.
I20260808 04:44:22.913075 21443 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
/tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786164000593138-21443-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786164000593138-21443-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786164000593138-21443-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786164000593138-21443-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.240.195:0
--local_ip_for_outbound_sockets=127.20.240.195
--webserver_interface=127.20.240.195
--webserver_port=0
--tserver_master_addrs=127.20.240.254:34573
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.195.keytab
--principal=kudu/127.20.240.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.240.212:39671
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786164000593138-21443-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786164000593138-21443-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786164000593138-21443-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 04:44:23.029644 9029 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:44:23.030040 9029 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:44:23.030135 9029 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:44:23.034423 9029 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:44:23.034543 9029 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:44:23.034653 9029 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.240.195
I20260808 04:44:23.040512 9029 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.240.212:39671
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786164000593138-21443-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786164000593138-21443-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.195.keytab
--principal=kudu/127.20.240.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.240.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786164000593138-21443-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.240.195
--webserver_port=0
--tserver_master_addrs=127.20.240.254:34573
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9029
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.240.195
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786164000593138-21443-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 04:05:18 UTC on ccycloud.quasar-drfdgt.root.comops.site
build id 4574101
I20260808 04:44:23.041822 9029 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:44:23.042982 9029 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:44:23.053606 9038 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:44:23.053786 9029 server_base.cc:1034] running on GCE node
W20260808 04:44:23.053606 9035 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:44:23.054052 9034 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:44:23.054555 9029 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:44:23.055332 9029 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:44:23.056533 9029 hybrid_clock.cc:648] HybridClock initialized: now 1786164263056498 us; error 61 us; skew 500 ppm
Aug 08 04:44:23 dist-test-slave-vxj2 krb5kdc[8609](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164263, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.240.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:44:23.059931 9029 init.cc:377] Logged in from keytab as kudu/127.20.240.195@KRBTEST.COM (short username kudu)
I20260808 04:44:23.061246 9029 webserver.cc:460] Webserver started at http://127.20.240.195:35209/ using document root <none> and password file <none>
I20260808 04:44:23.061967 9029 fs_manager.cc:359] Metadata directory not provided
I20260808 04:44:23.062069 9029 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:44:23.062321 9029 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 04:44:23.064637 9029 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786164000593138-21443-0/minicluster-data/ts-2/data/instance:
uuid: "bf43643529704876bfc36cea942c33ca"
format_stamp: "Formatted at 2026-08-08 04:44:23 on dist-test-slave-vxj2"
server_key: "0eb23e13aa54ffc6f06ce8eb7cd4e453"
server_key_iv: "ae837252e065fedacd44f701731842df"
server_key_version: "encryptionkey@0"
I20260808 04:44:23.065376 9029 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786164000593138-21443-0/minicluster-data/ts-2/wal/instance:
uuid: "bf43643529704876bfc36cea942c33ca"
format_stamp: "Formatted at 2026-08-08 04:44:23 on dist-test-slave-vxj2"
server_key: "0eb23e13aa54ffc6f06ce8eb7cd4e453"
server_key_iv: "ae837252e065fedacd44f701731842df"
server_key_version: "encryptionkey@0"
I20260808 04:44:23.070343 9029 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.001s
I20260808 04:44:23.073438 9045 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:44:23.075047 9029 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260808 04:44:23.075222 9029 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786164000593138-21443-0/minicluster-data/ts-2/data,/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786164000593138-21443-0/minicluster-data/ts-2/wal
uuid: "bf43643529704876bfc36cea942c33ca"
format_stamp: "Formatted at 2026-08-08 04:44:23 on dist-test-slave-vxj2"
server_key: "0eb23e13aa54ffc6f06ce8eb7cd4e453"
server_key_iv: "ae837252e065fedacd44f701731842df"
server_key_version: "encryptionkey@0"
I20260808 04:44:23.075367 9029 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786164000593138-21443-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786164000593138-21443-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786164000593138-21443-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:44:23.095373 9029 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:44:23.098747 9029 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:44:23.098984 9029 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:44:23.099624 9029 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 04:44:23.100520 9029 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 04:44:23.100601 9029 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 04:44:23.100670 9029 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 04:44:23.100720 9029 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 04:44:23.110505 9029 rpc_server.cc:307] RPC server started. Bound to: 127.20.240.195:38583
I20260808 04:44:23.110594 9173 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.240.195:38583 every 8 connection(s)
I20260808 04:44:23.111531 9029 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786164000593138-21443-0/minicluster-data/ts-2/data/info.pb
I20260808 04:44:23.121064 21443 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu as pid 9029
I20260808 04:44:23.121279 21443 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786164000593138-21443-0/minicluster-data/ts-2/wal/instance
I20260808 04:44:23.121605 21443 external_mini_cluster.cc:1428] Setting key 24981439807ed5ecda46c2c156fece79
Aug 08 04:44:23 dist-test-slave-vxj2 krb5kdc[8609](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164263, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.240.195@KRBTEST.COM for kudu/127.20.240.254@KRBTEST.COM
I20260808 04:44:23.127566 8704 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:23.113560 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.240.195:51439 (local address 127.20.240.254:34573)
0808 04:44:23.113771 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:23.113775 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:23.114625 (+ 850us) server_negotiation.cc:407] Connection header received
0808 04:44:23.116246 (+ 1621us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:23.116250 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:23.116319 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:23.116410 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:44:23.117808 (+ 1398us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:23.118419 (+ 611us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:23.119727 (+ 1308us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:23.119992 (+ 265us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:23.120124 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:23.123381 (+ 3257us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:44:23.123385 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:44:23.123388 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:44:23.123420 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:44:23.125222 (+ 1802us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:44:23.125839 (+ 617us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:44:23.125842 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:44:23.125843 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:44:23.125932 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:44:23.126341 (+ 409us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:44:23.126343 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:44:23.126345 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:44:23.126571 (+ 226us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:44:23.126660 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0808 04:44:23.127306 (+ 646us) server_negotiation.cc:299] Negotiation successful
0808 04:44:23.127434 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260808 04:44:23.128510 9176 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:23.113889 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:34573 (local address 127.20.240.195:51439)
0808 04:44:23.114425 (+ 536us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:23.114476 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0808 04:44:23.115984 (+ 1508us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:44:23.116611 (+ 627us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:44:23.116618 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:44:23.117035 (+ 417us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:44:23.117617 (+ 582us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:44:23.117633 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:44:23.118568 (+ 935us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:44:23.118578 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:44:23.119582 (+ 1004us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:44:23.119593 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:44:23.120178 (+ 585us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:44:23.120182 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:44:23.120373 (+ 191us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:23.121081 (+ 708us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:44:23.121099 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:44:23.123178 (+ 2079us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:44:23.125360 (+ 2182us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:44:23.125369 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:44:23.125386 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:44:23.125684 (+ 298us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:44:23.126062 (+ 378us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:44:23.126065 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:44:23.126066 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:44:23.126234 (+ 168us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:44:23.126700 (+ 466us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:44:23.126706 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:44:23.127039 (+ 333us) client_negotiation.cc:769] Sending connection context
0808 04:44:23.127229 (+ 190us) client_negotiation.cc:240] Negotiation successful
0808 04:44:23.127538 (+ 309us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":316,"thread_start_us":127,"threads_started":1}
I20260808 04:44:23.129904 9174 heartbeater.cc:347] Connected to a master server at 127.20.240.254:34573
I20260808 04:44:23.130138 9174 heartbeater.cc:464] Registering TS with master...
I20260808 04:44:23.130754 9174 heartbeater.cc:511] Master 127.20.240.254:34573 requested a full tablet report, sending...
I20260808 04:44:23.131848 8663 ts_manager.cc:194] Registered new tserver with Master: bf43643529704876bfc36cea942c33ca (127.20.240.195:38583)
I20260808 04:44:23.132529 8663 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.240.195@KRBTEST.COM'} at 127.20.240.195:51439
I20260808 04:44:23.136307 21443 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 04:44:23.147562 8704 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:23.138572 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49840 (local address 127.20.240.254:34573)
0808 04:44:23.138728 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:23.138734 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:23.138983 (+ 249us) server_negotiation.cc:407] Connection header received
0808 04:44:23.139140 (+ 157us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:23.139151 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:23.139192 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:23.139335 (+ 143us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:44:23.140066 (+ 731us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:23.140599 (+ 533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:23.141529 (+ 930us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:23.141753 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:23.141868 (+ 115us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:23.143597 (+ 1729us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:44:23.143601 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:44:23.143604 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:44:23.143637 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:44:23.145258 (+ 1621us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:44:23.145962 (+ 704us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:44:23.145966 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:44:23.145967 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:44:23.146056 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:44:23.146458 (+ 402us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:44:23.146462 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:44:23.146464 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:44:23.146744 (+ 280us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:44:23.146943 (+ 199us) server_negotiation.cc:1035] Waiting for connection context
0808 04:44:23.147252 (+ 309us) server_negotiation.cc:299] Negotiation successful
0808 04:44:23.147372 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260808 04:44:23.151165 8663 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49840:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 04:44:23.154735 8663 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 04:44:23.172147 9190 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:23.165560 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47934 (local address 127.20.240.195:38583)
0808 04:44:23.166875 (+ 1315us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:23.166888 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:23.166908 (+ 20us) server_negotiation.cc:407] Connection header received
0808 04:44:23.166980 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:23.166984 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:23.167113 (+ 129us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:23.167262 (+ 149us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 04:44:23.167726 (+ 464us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:23.168529 (+ 803us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:23.170623 (+ 2094us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:23.171480 (+ 857us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:23.171609 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:23.171729 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0808 04:44:23.171914 (+ 185us) server_negotiation.cc:299] Negotiation successful
0808 04:44:23.172017 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1198,"thread_start_us":162,"threads_started":1}
I20260808 04:44:23.172140 9188 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:23.165092 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.195:38583 (local address 127.0.0.1:47934)
0808 04:44:23.165981 (+ 889us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:23.165994 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 04:44:23.166078 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:44:23.167240 (+ 1162us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:44:23.167243 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:44:23.167261 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 04:44:23.167591 (+ 330us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:44:23.167597 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:44:23.168667 (+ 1070us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:44:23.168670 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:44:23.170480 (+ 1810us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:44:23.170493 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:44:23.171617 (+ 1124us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:44:23.171621 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:44:23.171754 (+ 133us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:23.171777 (+ 23us) client_negotiation.cc:769] Sending connection context
0808 04:44:23.171879 (+ 102us) client_negotiation.cc:240] Negotiation successful
0808 04:44:23.171971 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":827,"mutex_wait_us":247,"thread_start_us":131,"threads_started":1}
I20260808 04:44:23.172178 9187 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:23.164930 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40018 (local address 127.20.240.193:35009)
0808 04:44:23.166159 (+ 1229us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:23.166166 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:23.166190 (+ 24us) server_negotiation.cc:407] Connection header received
0808 04:44:23.166281 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:23.166285 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:23.166502 (+ 217us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:23.167013 (+ 511us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 04:44:23.167164 (+ 151us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:23.168362 (+ 1198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:23.170662 (+ 2300us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:23.171290 (+ 628us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:23.171709 (+ 419us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:23.171864 (+ 155us) server_negotiation.cc:1035] Waiting for connection context
0808 04:44:23.171922 (+ 58us) server_negotiation.cc:299] Negotiation successful
0808 04:44:23.172023 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1116,"thread_start_us":111,"threads_started":1}
I20260808 04:44:23.172147 9186 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:23.164700 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.193:35009 (local address 127.0.0.1:40018)
0808 04:44:23.165524 (+ 824us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:23.165581 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0808 04:44:23.165736 (+ 155us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:44:23.166669 (+ 933us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:44:23.166672 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:44:23.166692 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 04:44:23.166840 (+ 148us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:44:23.166849 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:44:23.168538 (+ 1689us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:44:23.168543 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:44:23.170480 (+ 1937us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:44:23.170493 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:44:23.171473 (+ 980us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:44:23.171477 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:44:23.171598 (+ 121us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:23.171665 (+ 67us) client_negotiation.cc:769] Sending connection context
0808 04:44:23.171785 (+ 120us) client_negotiation.cc:240] Negotiation successful
0808 04:44:23.171950 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":612,"mutex_wait_us":210,"spinlock_wait_cycles":8960,"thread_start_us":115,"threads_started":1}
I20260808 04:44:23.172739 9185 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:23.164918 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.194:40117 (local address 127.0.0.1:37388)
0808 04:44:23.165521 (+ 603us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:23.165577 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0808 04:44:23.165733 (+ 156us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:44:23.166547 (+ 814us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:44:23.166552 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:44:23.166573 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 04:44:23.166740 (+ 167us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:44:23.166749 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:44:23.168453 (+ 1704us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:44:23.168456 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:44:23.170230 (+ 1774us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:44:23.170240 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:44:23.171399 (+ 1159us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:44:23.171404 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:44:23.171548 (+ 144us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:23.172180 (+ 632us) client_negotiation.cc:769] Sending connection context
0808 04:44:23.172515 (+ 335us) client_negotiation.cc:240] Negotiation successful
0808 04:44:23.172599 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":506,"mutex_wait_us":206,"spinlock_wait_cycles":13440,"thread_start_us":103,"threads_started":1}
I20260808 04:44:23.172819 9189 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:23.165463 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37388 (local address 127.20.240.194:40117)
0808 04:44:23.166049 (+ 586us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:23.166062 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:23.166085 (+ 23us) server_negotiation.cc:407] Connection header received
0808 04:44:23.166166 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:23.166171 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:23.166383 (+ 212us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:23.166562 (+ 179us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 04:44:23.166864 (+ 302us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:23.168269 (+ 1405us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:23.170363 (+ 2094us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:23.171240 (+ 877us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:23.171380 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:23.171535 (+ 155us) server_negotiation.cc:1035] Waiting for connection context
0808 04:44:23.172555 (+ 1020us) server_negotiation.cc:299] Negotiation successful
0808 04:44:23.172665 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":476,"thread_start_us":124,"threads_started":1}
I20260808 04:44:23.175808 9096 tablet_service.cc:1467] Processing CreateTablet for tablet a7602e9671fc4d57b22ec26d98c66e38 (DEFAULT_TABLE table=test-table [id=49317c6db001425484f5671c04917b77]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 04:44:23.176017 8799 tablet_service.cc:1467] Processing CreateTablet for tablet a7602e9671fc4d57b22ec26d98c66e38 (DEFAULT_TABLE table=test-table [id=49317c6db001425484f5671c04917b77]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 04:44:23.176020 8950 tablet_service.cc:1467] Processing CreateTablet for tablet a7602e9671fc4d57b22ec26d98c66e38 (DEFAULT_TABLE table=test-table [id=49317c6db001425484f5671c04917b77]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 04:44:23.177009 9096 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a7602e9671fc4d57b22ec26d98c66e38. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:44:23.177127 8950 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a7602e9671fc4d57b22ec26d98c66e38. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:44:23.177127 8799 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a7602e9671fc4d57b22ec26d98c66e38. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:44:23.184252 9191 tablet_bootstrap.cc:492] T a7602e9671fc4d57b22ec26d98c66e38 P bf43643529704876bfc36cea942c33ca: Bootstrap starting.
I20260808 04:44:23.186058 9192 tablet_bootstrap.cc:492] T a7602e9671fc4d57b22ec26d98c66e38 P 8ab4387d8f5f4c2d953fec5d707f11a5: Bootstrap starting.
I20260808 04:44:23.186990 9191 tablet_bootstrap.cc:654] T a7602e9671fc4d57b22ec26d98c66e38 P bf43643529704876bfc36cea942c33ca: Neither blocks nor log segments found. Creating new log.
I20260808 04:44:23.188467 9191 log.cc:824] T a7602e9671fc4d57b22ec26d98c66e38 P bf43643529704876bfc36cea942c33ca: Log is configured to *not* fsync() on all Append() calls
I20260808 04:44:23.188699 9192 tablet_bootstrap.cc:654] T a7602e9671fc4d57b22ec26d98c66e38 P 8ab4387d8f5f4c2d953fec5d707f11a5: Neither blocks nor log segments found. Creating new log.
I20260808 04:44:23.189266 9193 tablet_bootstrap.cc:492] T a7602e9671fc4d57b22ec26d98c66e38 P 356dc845410747b8b30d54e45e60cd39: Bootstrap starting.
I20260808 04:44:23.190088 9192 log.cc:824] T a7602e9671fc4d57b22ec26d98c66e38 P 8ab4387d8f5f4c2d953fec5d707f11a5: Log is configured to *not* fsync() on all Append() calls
I20260808 04:44:23.190905 9191 tablet_bootstrap.cc:492] T a7602e9671fc4d57b22ec26d98c66e38 P bf43643529704876bfc36cea942c33ca: No bootstrap required, opened a new log
I20260808 04:44:23.191124 9191 ts_tablet_manager.cc:1397] T a7602e9671fc4d57b22ec26d98c66e38 P bf43643529704876bfc36cea942c33ca: Time spent bootstrapping tablet: real 0.007s user 0.000s sys 0.005s
I20260808 04:44:23.191810 9193 tablet_bootstrap.cc:654] T a7602e9671fc4d57b22ec26d98c66e38 P 356dc845410747b8b30d54e45e60cd39: Neither blocks nor log segments found. Creating new log.
I20260808 04:44:23.192425 9192 tablet_bootstrap.cc:492] T a7602e9671fc4d57b22ec26d98c66e38 P 8ab4387d8f5f4c2d953fec5d707f11a5: No bootstrap required, opened a new log
I20260808 04:44:23.192638 9192 ts_tablet_manager.cc:1397] T a7602e9671fc4d57b22ec26d98c66e38 P 8ab4387d8f5f4c2d953fec5d707f11a5: Time spent bootstrapping tablet: real 0.007s user 0.004s sys 0.000s
I20260808 04:44:23.193226 9193 log.cc:824] T a7602e9671fc4d57b22ec26d98c66e38 P 356dc845410747b8b30d54e45e60cd39: Log is configured to *not* fsync() on all Append() calls
I20260808 04:44:23.194809 9191 raft_consensus.cc:348] T a7602e9671fc4d57b22ec26d98c66e38 P bf43643529704876bfc36cea942c33ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ab4387d8f5f4c2d953fec5d707f11a5" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 35009 } } peers { permanent_uuid: "356dc845410747b8b30d54e45e60cd39" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 40117 } } peers { permanent_uuid: "bf43643529704876bfc36cea942c33ca" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 38583 } }
I20260808 04:44:23.195308 9191 raft_consensus.cc:374] T a7602e9671fc4d57b22ec26d98c66e38 P bf43643529704876bfc36cea942c33ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:44:23.195431 9191 raft_consensus.cc:729] T a7602e9671fc4d57b22ec26d98c66e38 P bf43643529704876bfc36cea942c33ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bf43643529704876bfc36cea942c33ca, State: Initialized, Role: FOLLOWER
I20260808 04:44:23.195873 9193 tablet_bootstrap.cc:492] T a7602e9671fc4d57b22ec26d98c66e38 P 356dc845410747b8b30d54e45e60cd39: No bootstrap required, opened a new log
I20260808 04:44:23.196013 9191 consensus_queue.cc:260] T a7602e9671fc4d57b22ec26d98c66e38 P bf43643529704876bfc36cea942c33ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ab4387d8f5f4c2d953fec5d707f11a5" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 35009 } } peers { permanent_uuid: "356dc845410747b8b30d54e45e60cd39" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 40117 } } peers { permanent_uuid: "bf43643529704876bfc36cea942c33ca" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 38583 } }
I20260808 04:44:23.196164 9193 ts_tablet_manager.cc:1397] T a7602e9671fc4d57b22ec26d98c66e38 P 356dc845410747b8b30d54e45e60cd39: Time spent bootstrapping tablet: real 0.007s user 0.006s sys 0.000s
I20260808 04:44:23.196807 9174 heartbeater.cc:503] Master 127.20.240.254:34573 was elected leader, sending a full tablet report...
I20260808 04:44:23.197191 9191 ts_tablet_manager.cc:1428] T a7602e9671fc4d57b22ec26d98c66e38 P bf43643529704876bfc36cea942c33ca: Time spent starting tablet: real 0.006s user 0.007s sys 0.001s
I20260808 04:44:23.198140 9192 raft_consensus.cc:348] T a7602e9671fc4d57b22ec26d98c66e38 P 8ab4387d8f5f4c2d953fec5d707f11a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ab4387d8f5f4c2d953fec5d707f11a5" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 35009 } } peers { permanent_uuid: "356dc845410747b8b30d54e45e60cd39" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 40117 } } peers { permanent_uuid: "bf43643529704876bfc36cea942c33ca" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 38583 } }
I20260808 04:44:23.198459 9192 raft_consensus.cc:374] T a7602e9671fc4d57b22ec26d98c66e38 P 8ab4387d8f5f4c2d953fec5d707f11a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:44:23.198561 9192 raft_consensus.cc:729] T a7602e9671fc4d57b22ec26d98c66e38 P 8ab4387d8f5f4c2d953fec5d707f11a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ab4387d8f5f4c2d953fec5d707f11a5, State: Initialized, Role: FOLLOWER
I20260808 04:44:23.199070 9192 consensus_queue.cc:260] T a7602e9671fc4d57b22ec26d98c66e38 P 8ab4387d8f5f4c2d953fec5d707f11a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ab4387d8f5f4c2d953fec5d707f11a5" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 35009 } } peers { permanent_uuid: "356dc845410747b8b30d54e45e60cd39" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 40117 } } peers { permanent_uuid: "bf43643529704876bfc36cea942c33ca" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 38583 } }
I20260808 04:44:23.199800 8875 heartbeater.cc:503] Master 127.20.240.254:34573 was elected leader, sending a full tablet report...
I20260808 04:44:23.200295 9193 raft_consensus.cc:348] T a7602e9671fc4d57b22ec26d98c66e38 P 356dc845410747b8b30d54e45e60cd39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ab4387d8f5f4c2d953fec5d707f11a5" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 35009 } } peers { permanent_uuid: "356dc845410747b8b30d54e45e60cd39" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 40117 } } peers { permanent_uuid: "bf43643529704876bfc36cea942c33ca" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 38583 } }
I20260808 04:44:23.200647 9193 raft_consensus.cc:374] T a7602e9671fc4d57b22ec26d98c66e38 P 356dc845410747b8b30d54e45e60cd39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:44:23.200755 9193 raft_consensus.cc:729] T a7602e9671fc4d57b22ec26d98c66e38 P 356dc845410747b8b30d54e45e60cd39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 356dc845410747b8b30d54e45e60cd39, State: Initialized, Role: FOLLOWER
I20260808 04:44:23.201295 9192 ts_tablet_manager.cc:1428] T a7602e9671fc4d57b22ec26d98c66e38 P 8ab4387d8f5f4c2d953fec5d707f11a5: Time spent starting tablet: real 0.009s user 0.008s sys 0.000s
I20260808 04:44:23.201326 9193 consensus_queue.cc:260] T a7602e9671fc4d57b22ec26d98c66e38 P 356dc845410747b8b30d54e45e60cd39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ab4387d8f5f4c2d953fec5d707f11a5" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 35009 } } peers { permanent_uuid: "356dc845410747b8b30d54e45e60cd39" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 40117 } } peers { permanent_uuid: "bf43643529704876bfc36cea942c33ca" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 38583 } }
I20260808 04:44:23.202075 9024 heartbeater.cc:503] Master 127.20.240.254:34573 was elected leader, sending a full tablet report...
I20260808 04:44:23.202385 9193 ts_tablet_manager.cc:1428] T a7602e9671fc4d57b22ec26d98c66e38 P 356dc845410747b8b30d54e45e60cd39: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20260808 04:44:23.211611 9199 raft_consensus.cc:482] T a7602e9671fc4d57b22ec26d98c66e38 P 356dc845410747b8b30d54e45e60cd39 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 04:44:23.211828 9199 raft_consensus.cc:504] T a7602e9671fc4d57b22ec26d98c66e38 P 356dc845410747b8b30d54e45e60cd39 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ab4387d8f5f4c2d953fec5d707f11a5" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 35009 } } peers { permanent_uuid: "356dc845410747b8b30d54e45e60cd39" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 40117 } } peers { permanent_uuid: "bf43643529704876bfc36cea942c33ca" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 38583 } }
I20260808 04:44:23.212968 9199 leader_election.cc:288] T a7602e9671fc4d57b22ec26d98c66e38 P 356dc845410747b8b30d54e45e60cd39 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8ab4387d8f5f4c2d953fec5d707f11a5 (127.20.240.193:35009), bf43643529704876bfc36cea942c33ca (127.20.240.195:38583)
I20260808 04:44:23.217583 9190 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:23.213406 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.240.194:49761 (local address 127.20.240.195:38583)
0808 04:44:23.213541 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:23.213551 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:23.213568 (+ 17us) server_negotiation.cc:407] Connection header received
0808 04:44:23.213647 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:23.213649 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:23.213692 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:23.213808 (+ 116us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 04:44:23.214101 (+ 293us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:23.214884 (+ 783us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:23.216222 (+ 1338us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:23.216912 (+ 690us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:23.217061 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:23.217190 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0808 04:44:23.217404 (+ 214us) server_negotiation.cc:299] Negotiation successful
0808 04:44:23.217472 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260808 04:44:23.217595 9026 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:23.213319 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.195:38583 (local address 127.20.240.194:49761)
0808 04:44:23.213434 (+ 115us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:23.213451 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 04:44:23.213554 (+ 103us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:44:23.213818 (+ 264us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:44:23.213821 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:44:23.213840 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 04:44:23.213978 (+ 138us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:44:23.213985 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:44:23.215001 (+ 1016us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:44:23.215005 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:44:23.216066 (+ 1061us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:44:23.216077 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:44:23.217064 (+ 987us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:44:23.217067 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:44:23.217249 (+ 182us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:23.217276 (+ 27us) client_negotiation.cc:769] Sending connection context
0808 04:44:23.217377 (+ 101us) client_negotiation.cc:240] Negotiation successful
0808 04:44:23.217452 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":32}
I20260808 04:44:23.218343 9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a7602e9671fc4d57b22ec26d98c66e38" candidate_uuid: "356dc845410747b8b30d54e45e60cd39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf43643529704876bfc36cea942c33ca" is_pre_election: true
I20260808 04:44:23.218406 9187 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:23.213450 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.240.194:36461 (local address 127.20.240.193:35009)
0808 04:44:23.213587 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:23.213594 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:23.214110 (+ 516us) server_negotiation.cc:407] Connection header received
0808 04:44:23.214271 (+ 161us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:23.214275 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:23.214328 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:23.214415 (+ 87us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 04:44:23.214795 (+ 380us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:23.215540 (+ 745us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:23.217212 (+ 1672us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:23.217873 (+ 661us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:23.217992 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:23.218042 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0808 04:44:23.218218 (+ 176us) server_negotiation.cc:299] Negotiation successful
0808 04:44:23.218293 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260808 04:44:23.218425 9200 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:23.213322 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.193:35009 (local address 127.20.240.194:36461)
0808 04:44:23.214014 (+ 692us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:23.214026 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 04:44:23.214144 (+ 118us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:44:23.214522 (+ 378us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:44:23.214525 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:44:23.214541 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 04:44:23.214664 (+ 123us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:44:23.214669 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:44:23.215689 (+ 1020us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:44:23.215692 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:44:23.217043 (+ 1351us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:44:23.217054 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:44:23.217981 (+ 927us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:44:23.217984 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:44:23.218082 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:23.218112 (+ 30us) client_negotiation.cc:769] Sending connection context
0808 04:44:23.218200 (+ 88us) client_negotiation.cc:240] Negotiation successful
0808 04:44:23.218264 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":630,"mutex_wait_us":314,"thread_start_us":180,"threads_started":1}
I20260808 04:44:23.218734 9120 raft_consensus.cc:2454] T a7602e9671fc4d57b22ec26d98c66e38 P bf43643529704876bfc36cea942c33ca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 356dc845410747b8b30d54e45e60cd39 in term 0.
I20260808 04:44:23.218999 8821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a7602e9671fc4d57b22ec26d98c66e38" candidate_uuid: "356dc845410747b8b30d54e45e60cd39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ab4387d8f5f4c2d953fec5d707f11a5" is_pre_election: true
I20260808 04:44:23.219270 8821 raft_consensus.cc:2454] T a7602e9671fc4d57b22ec26d98c66e38 P 8ab4387d8f5f4c2d953fec5d707f11a5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 356dc845410747b8b30d54e45e60cd39 in term 0.
I20260808 04:44:23.219333 8901 leader_election.cc:302] T a7602e9671fc4d57b22ec26d98c66e38 P 356dc845410747b8b30d54e45e60cd39 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 356dc845410747b8b30d54e45e60cd39, bf43643529704876bfc36cea942c33ca; no voters:
I20260808 04:44:23.219657 9199 raft_consensus.cc:2781] T a7602e9671fc4d57b22ec26d98c66e38 P 356dc845410747b8b30d54e45e60cd39 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 04:44:23.219760 9199 raft_consensus.cc:482] T a7602e9671fc4d57b22ec26d98c66e38 P 356dc845410747b8b30d54e45e60cd39 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 04:44:23.219846 9199 raft_consensus.cc:3037] T a7602e9671fc4d57b22ec26d98c66e38 P 356dc845410747b8b30d54e45e60cd39 [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:44:23.221114 9199 raft_consensus.cc:504] T a7602e9671fc4d57b22ec26d98c66e38 P 356dc845410747b8b30d54e45e60cd39 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ab4387d8f5f4c2d953fec5d707f11a5" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 35009 } } peers { permanent_uuid: "356dc845410747b8b30d54e45e60cd39" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 40117 } } peers { permanent_uuid: "bf43643529704876bfc36cea942c33ca" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 38583 } }
I20260808 04:44:23.221580 9199 leader_election.cc:288] T a7602e9671fc4d57b22ec26d98c66e38 P 356dc845410747b8b30d54e45e60cd39 [CANDIDATE]: Term 1 election: Requested vote from peers 8ab4387d8f5f4c2d953fec5d707f11a5 (127.20.240.193:35009), bf43643529704876bfc36cea942c33ca (127.20.240.195:38583)
I20260808 04:44:23.222008 9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a7602e9671fc4d57b22ec26d98c66e38" candidate_uuid: "356dc845410747b8b30d54e45e60cd39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf43643529704876bfc36cea942c33ca"
I20260808 04:44:23.222060 8821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a7602e9671fc4d57b22ec26d98c66e38" candidate_uuid: "356dc845410747b8b30d54e45e60cd39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ab4387d8f5f4c2d953fec5d707f11a5"
I20260808 04:44:23.222133 9120 raft_consensus.cc:3037] T a7602e9671fc4d57b22ec26d98c66e38 P bf43643529704876bfc36cea942c33ca [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:44:23.222234 8821 raft_consensus.cc:3037] T a7602e9671fc4d57b22ec26d98c66e38 P 8ab4387d8f5f4c2d953fec5d707f11a5 [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:44:23.223400 9120 raft_consensus.cc:2454] T a7602e9671fc4d57b22ec26d98c66e38 P bf43643529704876bfc36cea942c33ca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 356dc845410747b8b30d54e45e60cd39 in term 1.
I20260808 04:44:23.223409 8821 raft_consensus.cc:2454] T a7602e9671fc4d57b22ec26d98c66e38 P 8ab4387d8f5f4c2d953fec5d707f11a5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 356dc845410747b8b30d54e45e60cd39 in term 1.
I20260808 04:44:23.223793 8898 leader_election.cc:302] T a7602e9671fc4d57b22ec26d98c66e38 P 356dc845410747b8b30d54e45e60cd39 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 356dc845410747b8b30d54e45e60cd39, 8ab4387d8f5f4c2d953fec5d707f11a5; no voters:
I20260808 04:44:23.224028 9199 raft_consensus.cc:2781] T a7602e9671fc4d57b22ec26d98c66e38 P 356dc845410747b8b30d54e45e60cd39 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 04:44:23.224345 9199 raft_consensus.cc:686] T a7602e9671fc4d57b22ec26d98c66e38 P 356dc845410747b8b30d54e45e60cd39 [term 1 LEADER]: Becoming Leader. State: Replica: 356dc845410747b8b30d54e45e60cd39, State: Running, Role: LEADER
I20260808 04:44:23.224772 9199 consensus_queue.cc:237] T a7602e9671fc4d57b22ec26d98c66e38 P 356dc845410747b8b30d54e45e60cd39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ab4387d8f5f4c2d953fec5d707f11a5" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 35009 } } peers { permanent_uuid: "356dc845410747b8b30d54e45e60cd39" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 40117 } } peers { permanent_uuid: "bf43643529704876bfc36cea942c33ca" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 38583 } }
I20260808 04:44:23.228559 8663 catalog_manager.cc:5495] T a7602e9671fc4d57b22ec26d98c66e38 P 356dc845410747b8b30d54e45e60cd39 reported cstate change: term changed from 0 to 1, leader changed from <none> to 356dc845410747b8b30d54e45e60cd39 (127.20.240.194). New cstate: current_term: 1 leader_uuid: "356dc845410747b8b30d54e45e60cd39" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ab4387d8f5f4c2d953fec5d707f11a5" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 35009 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "356dc845410747b8b30d54e45e60cd39" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 40117 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bf43643529704876bfc36cea942c33ca" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 38583 } health_report { overall_health: UNKNOWN } } }
I20260808 04:44:23.254088 9189 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:23.249893 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37392 (local address 127.20.240.194:40117)
0808 04:44:23.250098 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:23.250102 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:23.250142 (+ 40us) server_negotiation.cc:407] Connection header received
0808 04:44:23.250358 (+ 216us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:23.250361 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:23.250428 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:23.250534 (+ 106us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 04:44:23.250757 (+ 223us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:23.251341 (+ 584us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:23.252194 (+ 853us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:23.252482 (+ 288us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:23.252589 (+ 107us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:23.252883 (+ 294us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 04:44:23.253393 (+ 510us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 04:44:23.253531 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0808 04:44:23.253827 (+ 296us) server_negotiation.cc:299] Negotiation successful
0808 04:44:23.253882 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260808 04:44:23.260789 9120 raft_consensus.cc:1261] T a7602e9671fc4d57b22ec26d98c66e38 P bf43643529704876bfc36cea942c33ca [term 1 FOLLOWER]: Refusing update from remote peer 356dc845410747b8b30d54e45e60cd39: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 04:44:23.260794 8821 raft_consensus.cc:1261] T a7602e9671fc4d57b22ec26d98c66e38 P 8ab4387d8f5f4c2d953fec5d707f11a5 [term 1 FOLLOWER]: Refusing update from remote peer 356dc845410747b8b30d54e45e60cd39: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 04:44:23.261698 9199 consensus_queue.cc:1035] T a7602e9671fc4d57b22ec26d98c66e38 P 356dc845410747b8b30d54e45e60cd39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf43643529704876bfc36cea942c33ca" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 38583 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 04:44:23.262007 9201 consensus_queue.cc:1035] T a7602e9671fc4d57b22ec26d98c66e38 P 356dc845410747b8b30d54e45e60cd39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ab4387d8f5f4c2d953fec5d707f11a5" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 35009 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 04:44:23.272517 9207 mvcc.cc:205] Tried to move back new op lower bound from 7316128822307172352 to 7316128822172065792. Current Snapshot: MvccSnapshot[applied={T|T < 7316128822307172352}]
I20260808 04:44:23.273316 9205 mvcc.cc:205] Tried to move back new op lower bound from 7316128822307172352 to 7316128822172065792. Current Snapshot: MvccSnapshot[applied={T|T < 7316128822307172352}]
I20260808 04:44:23.280433 8663 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49840:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 04:44:23.280673 8663 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49840:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 04:44:23.283726 8663 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2ddc81cdf8924e57b960a2de1bdcefa8: Sending DeleteTablet for 3 replicas of tablet a7602e9671fc4d57b22ec26d98c66e38
I20260808 04:44:23.284682 8799 tablet_service.cc:1514] Processing DeleteTablet for tablet a7602e9671fc4d57b22ec26d98c66e38 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 04:44:23 UTC) from {username='kudu', principal='kudu/127.20.240.254@KRBTEST.COM'} at 127.0.0.1:40018
I20260808 04:44:23.284686 8950 tablet_service.cc:1514] Processing DeleteTablet for tablet a7602e9671fc4d57b22ec26d98c66e38 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 04:44:23 UTC) from {username='kudu', principal='kudu/127.20.240.254@KRBTEST.COM'} at 127.0.0.1:37388
I20260808 04:44:23.284766 9096 tablet_service.cc:1514] Processing DeleteTablet for tablet a7602e9671fc4d57b22ec26d98c66e38 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 04:44:23 UTC) from {username='kudu', principal='kudu/127.20.240.254@KRBTEST.COM'} at 127.0.0.1:47934
I20260808 04:44:23.285316 9215 tablet_replica.cc:330] T a7602e9671fc4d57b22ec26d98c66e38 P 356dc845410747b8b30d54e45e60cd39: stopping tablet replica
I20260808 04:44:23.285645 9214 tablet_replica.cc:330] T a7602e9671fc4d57b22ec26d98c66e38 P 8ab4387d8f5f4c2d953fec5d707f11a5: stopping tablet replica
I20260808 04:44:23.285702 9215 raft_consensus.cc:2229] T a7602e9671fc4d57b22ec26d98c66e38 P 356dc845410747b8b30d54e45e60cd39 [term 1 LEADER]: Raft consensus shutting down.
I20260808 04:44:23.285912 9216 tablet_replica.cc:330] T a7602e9671fc4d57b22ec26d98c66e38 P bf43643529704876bfc36cea942c33ca: stopping tablet replica
I20260808 04:44:23.286186 21443 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu with pid 8729
I20260808 04:44:23.286221 9215 raft_consensus.cc:2258] T a7602e9671fc4d57b22ec26d98c66e38 P 356dc845410747b8b30d54e45e60cd39 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 04:44:23.286232 9216 raft_consensus.cc:2229] T a7602e9671fc4d57b22ec26d98c66e38 P bf43643529704876bfc36cea942c33ca [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 04:44:23.286545 9216 raft_consensus.cc:2258] T a7602e9671fc4d57b22ec26d98c66e38 P bf43643529704876bfc36cea942c33ca [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 04:44:23.288280 9216 ts_tablet_manager.cc:1905] T a7602e9671fc4d57b22ec26d98c66e38 P bf43643529704876bfc36cea942c33ca: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 04:44:23.289410 9215 ts_tablet_manager.cc:1905] T a7602e9671fc4d57b22ec26d98c66e38 P 356dc845410747b8b30d54e45e60cd39: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 04:44:23.291203 9216 ts_tablet_manager.cc:1918] T a7602e9671fc4d57b22ec26d98c66e38 P bf43643529704876bfc36cea942c33ca: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 04:44:23.291320 9216 log.cc:1196] T a7602e9671fc4d57b22ec26d98c66e38 P bf43643529704876bfc36cea942c33ca: Deleting WAL directory at /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786164000593138-21443-0/minicluster-data/ts-2/wal/wals/a7602e9671fc4d57b22ec26d98c66e38
I20260808 04:44:23.291656 9216 ts_tablet_manager.cc:1939] T a7602e9671fc4d57b22ec26d98c66e38 P bf43643529704876bfc36cea942c33ca: Deleting consensus metadata
I20260808 04:44:23.292316 9215 ts_tablet_manager.cc:1918] T a7602e9671fc4d57b22ec26d98c66e38 P 356dc845410747b8b30d54e45e60cd39: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 04:44:23.292454 9215 log.cc:1196] T a7602e9671fc4d57b22ec26d98c66e38 P 356dc845410747b8b30d54e45e60cd39: Deleting WAL directory at /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786164000593138-21443-0/minicluster-data/ts-1/wal/wals/a7602e9671fc4d57b22ec26d98c66e38
I20260808 04:44:23.292820 9215 ts_tablet_manager.cc:1939] T a7602e9671fc4d57b22ec26d98c66e38 P 356dc845410747b8b30d54e45e60cd39: Deleting consensus metadata
I20260808 04:44:23.293118 8644 catalog_manager.cc:4841] TS bf43643529704876bfc36cea942c33ca (127.20.240.195:38583): tablet a7602e9671fc4d57b22ec26d98c66e38 (table test-table [id=49317c6db001425484f5671c04917b77]) successfully deleted
I20260808 04:44:23.294004 8645 catalog_manager.cc:4841] TS 356dc845410747b8b30d54e45e60cd39 (127.20.240.194:40117): tablet a7602e9671fc4d57b22ec26d98c66e38 (table test-table [id=49317c6db001425484f5671c04917b77]) successfully deleted
W20260808 04:44:23.298894 8642 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.20.240.193:35009 (error 108)
I20260808 04:44:23.299664 21443 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu with pid 8882
I20260808 04:44:23.301457 9185 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:23.299854 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.193:35009 (local address 127.0.0.1:40032)
0808 04:44:23.301249 (+ 1395us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:23.301335 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.240.193:35009: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1259}
W20260808 04:44:23.303378 8642 catalog_manager.cc:4584] TS 8ab4387d8f5f4c2d953fec5d707f11a5 (127.20.240.193:35009): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet a7602e9671fc4d57b22ec26d98c66e38: Network error: Client connection negotiation failed: client connection to 127.20.240.193:35009: connect: Connection refused (error 111)
I20260808 04:44:23.308350 21443 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu with pid 9029
I20260808 04:44:23.315884 21443 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu with pid 8623
2026-08-08T04:44:23Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/2 (2431 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/3
2026-08-08T04:44:23Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T04:44:23Z Disabled control of system clock
I20260808 04:44:23.351963 21443 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
/tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786164000593138-21443-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786164000593138-21443-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786164000593138-21443-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786164000593138-21443-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.240.254:39305
--webserver_interface=127.20.240.254
--webserver_port=0
--builtin_ntp_servers=127.20.240.212:42295
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.240.254:39305
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260808 04:44:23.484333 9222 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:44:23.484642 9222 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:44:23.484679 9222 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:44:23.489789 9222 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 04:44:23.489894 9222 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:44:23.489914 9222 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:44:23.489934 9222 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 04:44:23.489953 9222 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 04:44:23.496383 9222 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.240.212:42295
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786164000593138-21443-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786164000593138-21443-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.240.254:39305
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.240.254:39305
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786164000593138-21443-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.240.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9222
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786164000593138-21443-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 04:05:18 UTC on ccycloud.quasar-drfdgt.root.comops.site
build id 4574101
I20260808 04:44:23.497758 9222 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:44:23.499313 9222 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:44:23.509197 9230 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:44:23.509259 9222 server_base.cc:1034] running on GCE node
W20260808 04:44:23.509186 9231 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:44:23.509186 9233 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:44:23.510159 9222 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:44:23.511345 9222 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:44:23.512570 9222 hybrid_clock.cc:648] HybridClock initialized: now 1786164263512558 us; error 27 us; skew 500 ppm
I20260808 04:44:23.514683 9222 webserver.cc:460] Webserver started at http://127.20.240.254:45037/ using document root <none> and password file <none>
I20260808 04:44:23.515331 9222 fs_manager.cc:359] Metadata directory not provided
I20260808 04:44:23.515439 9222 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:44:23.515681 9222 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 04:44:23.517956 9222 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786164000593138-21443-0/minicluster-data/master-0/data/instance:
uuid: "7a779b5ff763475297a0def69d82568d"
format_stamp: "Formatted at 2026-08-08 04:44:23 on dist-test-slave-vxj2"
server_key: "5194a0a07bb109edc0aa324fed9b3395"
server_key_iv: "e9441ea136d333d5a21500ae6b33436d"
server_key_version: "encryptionkey@0"
I20260808 04:44:23.518581 9222 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786164000593138-21443-0/minicluster-data/master-0/wal/instance:
uuid: "7a779b5ff763475297a0def69d82568d"
format_stamp: "Formatted at 2026-08-08 04:44:23 on dist-test-slave-vxj2"
server_key: "5194a0a07bb109edc0aa324fed9b3395"
server_key_iv: "e9441ea136d333d5a21500ae6b33436d"
server_key_version: "encryptionkey@0"
I20260808 04:44:23.522755 9222 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260808 04:44:23.525540 9239 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:44:23.527004 9222 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260808 04:44:23.527166 9222 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786164000593138-21443-0/minicluster-data/master-0/data,/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786164000593138-21443-0/minicluster-data/master-0/wal
uuid: "7a779b5ff763475297a0def69d82568d"
format_stamp: "Formatted at 2026-08-08 04:44:23 on dist-test-slave-vxj2"
server_key: "5194a0a07bb109edc0aa324fed9b3395"
server_key_iv: "e9441ea136d333d5a21500ae6b33436d"
server_key_version: "encryptionkey@0"
I20260808 04:44:23.527299 9222 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786164000593138-21443-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786164000593138-21443-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786164000593138-21443-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:44:23.548115 9222 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:44:23.548882 9222 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:44:23.549098 9222 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:44:23.556622 9222 rpc_server.cc:307] RPC server started. Bound to: 127.20.240.254:39305
I20260808 04:44:23.556706 9295 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.240.254:39305 every 8 connection(s)
I20260808 04:44:23.557706 9222 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786164000593138-21443-0/minicluster-data/master-0/data/info.pb
I20260808 04:44:23.561434 9296 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:44:23.562507 21443 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu as pid 9222
I20260808 04:44:23.562618 21443 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786164000593138-21443-0/minicluster-data/master-0/wal/instance
I20260808 04:44:23.562970 21443 external_mini_cluster.cc:1428] Setting key 7bbe8a8a519b23c7ea801865c7b119bf
I20260808 04:44:23.568449 9296 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7a779b5ff763475297a0def69d82568d: Bootstrap starting.
I20260808 04:44:23.571022 9296 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7a779b5ff763475297a0def69d82568d: Neither blocks nor log segments found. Creating new log.
I20260808 04:44:23.571940 9296 log.cc:824] T 00000000000000000000000000000000 P 7a779b5ff763475297a0def69d82568d: Log is configured to *not* fsync() on all Append() calls
I20260808 04:44:23.572576 9299 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:23.564563 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37000 (local address 127.20.240.254:39305)
0808 04:44:23.565402 (+ 839us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:23.565434 (+ 32us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:23.565474 (+ 40us) server_negotiation.cc:407] Connection header received
0808 04:44:23.566127 (+ 653us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:23.566144 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:23.566568 (+ 424us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:23.566899 (+ 331us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:44:23.567340 (+ 441us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:23.568281 (+ 941us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:23.569254 (+ 973us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:23.569728 (+ 474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:23.569894 (+ 166us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:23.570789 (+ 895us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:44:23.570794 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:44:23.570807 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 04:44:23.571217 (+ 410us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:44:23.571288 (+ 71us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 04:44:23.571309 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:44:23.571413 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0808 04:44:23.571529 (+ 116us) server_negotiation.cc:299] Negotiation successful
0808 04:44:23.571793 (+ 264us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":404,"thread_start_us":196,"threads_started":1}
I20260808 04:44:23.574409 9296 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7a779b5ff763475297a0def69d82568d: No bootstrap required, opened a new log
I20260808 04:44:23.578562 9296 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7a779b5ff763475297a0def69d82568d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7a779b5ff763475297a0def69d82568d" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 39305 } }
I20260808 04:44:23.578831 9296 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7a779b5ff763475297a0def69d82568d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:44:23.578871 9296 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7a779b5ff763475297a0def69d82568d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a779b5ff763475297a0def69d82568d, State: Initialized, Role: FOLLOWER
I20260808 04:44:23.579319 9296 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7a779b5ff763475297a0def69d82568d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7a779b5ff763475297a0def69d82568d" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 39305 } }
I20260808 04:44:23.579455 9296 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7a779b5ff763475297a0def69d82568d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 04:44:23.579510 9296 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7a779b5ff763475297a0def69d82568d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 04:44:23.579591 9296 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7a779b5ff763475297a0def69d82568d [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:44:23.580749 9296 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7a779b5ff763475297a0def69d82568d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7a779b5ff763475297a0def69d82568d" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 39305 } }
I20260808 04:44:23.581238 9296 leader_election.cc:302] T 00000000000000000000000000000000 P 7a779b5ff763475297a0def69d82568d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7a779b5ff763475297a0def69d82568d; no voters:
I20260808 04:44:23.581606 9296 leader_election.cc:288] T 00000000000000000000000000000000 P 7a779b5ff763475297a0def69d82568d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 04:44:23.581763 9301 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7a779b5ff763475297a0def69d82568d [term 1 FOLLOWER]: Leader election won for term 1
I20260808 04:44:23.582000 9301 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7a779b5ff763475297a0def69d82568d [term 1 LEADER]: Becoming Leader. State: Replica: 7a779b5ff763475297a0def69d82568d, State: Running, Role: LEADER
I20260808 04:44:23.582355 9301 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7a779b5ff763475297a0def69d82568d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7a779b5ff763475297a0def69d82568d" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 39305 } }
I20260808 04:44:23.583033 9296 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7a779b5ff763475297a0def69d82568d [sys.catalog]: configured and running, proceeding with master startup.
I20260808 04:44:23.584141 9302 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7a779b5ff763475297a0def69d82568d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7a779b5ff763475297a0def69d82568d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7a779b5ff763475297a0def69d82568d" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 39305 } } }
I20260808 04:44:23.584116 9304 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7a779b5ff763475297a0def69d82568d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7a779b5ff763475297a0def69d82568d. Latest consensus state: current_term: 1 leader_uuid: "7a779b5ff763475297a0def69d82568d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7a779b5ff763475297a0def69d82568d" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 39305 } } }
I20260808 04:44:23.584412 9304 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7a779b5ff763475297a0def69d82568d [sys.catalog]: This master's current role is: LEADER
I20260808 04:44:23.584671 9302 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7a779b5ff763475297a0def69d82568d [sys.catalog]: This master's current role is: LEADER
I20260808 04:44:23.585476 9313 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 04:44:23.588690 9313 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 04:44:23.595047 9313 catalog_manager.cc:1347] Generated new cluster ID: 9ac1f0215b82458e86bba8ddeff2d1a3
I20260808 04:44:23.595216 9313 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 04:44:23.609145 9313 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 04:44:23.610348 9313 catalog_manager.cc:1504] Loading token signing keys...
I20260808 04:44:23.618960 9313 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 7a779b5ff763475297a0def69d82568d: Generated new TSK 0
I20260808 04:44:23.619784 9313 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 04:44:23.626746 21443 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
/tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786164000593138-21443-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786164000593138-21443-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786164000593138-21443-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786164000593138-21443-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.240.193:0
--local_ip_for_outbound_sockets=127.20.240.193
--webserver_interface=127.20.240.193
--webserver_port=0
--tserver_master_addrs=127.20.240.254:39305
--builtin_ntp_servers=127.20.240.212:42295
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260808 04:44:23.752286 9323 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:44:23.752610 9323 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:44:23.752660 9323 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:44:23.757104 9323 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:44:23.757205 9323 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:44:23.757316 9323 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.240.193
I20260808 04:44:23.762246 9323 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.240.212:42295
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786164000593138-21443-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786164000593138-21443-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.240.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786164000593138-21443-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.240.193
--webserver_port=0
--tserver_master_addrs=127.20.240.254:39305
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9323
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.240.193
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786164000593138-21443-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 04:05:18 UTC on ccycloud.quasar-drfdgt.root.comops.site
build id 4574101
I20260808 04:44:23.763456 9323 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:44:23.765031 9323 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:44:23.775669 9331 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:44:23.775669 9329 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:44:23.775717 9328 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:44:23.776010 9323 server_base.cc:1034] running on GCE node
I20260808 04:44:23.776664 9323 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:44:23.777510 9323 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:44:23.778733 9323 hybrid_clock.cc:648] HybridClock initialized: now 1786164263778693 us; error 53 us; skew 500 ppm
I20260808 04:44:23.781123 9323 webserver.cc:460] Webserver started at http://127.20.240.193:38069/ using document root <none> and password file <none>
I20260808 04:44:23.781827 9323 fs_manager.cc:359] Metadata directory not provided
I20260808 04:44:23.781929 9323 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:44:23.782176 9323 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 04:44:23.784832 9323 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786164000593138-21443-0/minicluster-data/ts-0/data/instance:
uuid: "c0fa7ebf84564decb05a60f5c484a16d"
format_stamp: "Formatted at 2026-08-08 04:44:23 on dist-test-slave-vxj2"
server_key: "c89a439d36a94efb2c952a982f421e13"
server_key_iv: "949ff64eb44e908f22f318eeaa216b97"
server_key_version: "encryptionkey@0"
I20260808 04:44:23.785642 9323 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786164000593138-21443-0/minicluster-data/ts-0/wal/instance:
uuid: "c0fa7ebf84564decb05a60f5c484a16d"
format_stamp: "Formatted at 2026-08-08 04:44:23 on dist-test-slave-vxj2"
server_key: "c89a439d36a94efb2c952a982f421e13"
server_key_iv: "949ff64eb44e908f22f318eeaa216b97"
server_key_version: "encryptionkey@0"
I20260808 04:44:23.790208 9323 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260808 04:44:23.792886 9337 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:44:23.794251 9323 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 04:44:23.794405 9323 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786164000593138-21443-0/minicluster-data/ts-0/data,/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786164000593138-21443-0/minicluster-data/ts-0/wal
uuid: "c0fa7ebf84564decb05a60f5c484a16d"
format_stamp: "Formatted at 2026-08-08 04:44:23 on dist-test-slave-vxj2"
server_key: "c89a439d36a94efb2c952a982f421e13"
server_key_iv: "949ff64eb44e908f22f318eeaa216b97"
server_key_version: "encryptionkey@0"
I20260808 04:44:23.794538 9323 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786164000593138-21443-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786164000593138-21443-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786164000593138-21443-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:44:23.818476 9323 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:44:23.819281 9323 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:44:23.819517 9323 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:44:23.820197 9323 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 04:44:23.821297 9323 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 04:44:23.821377 9323 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 04:44:23.821458 9323 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 04:44:23.821512 9323 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 04:44:23.831439 9323 rpc_server.cc:307] RPC server started. Bound to: 127.20.240.193:44263
I20260808 04:44:23.831504 9461 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.240.193:44263 every 8 connection(s)
I20260808 04:44:23.832538 9323 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786164000593138-21443-0/minicluster-data/ts-0/data/info.pb
I20260808 04:44:23.834671 21443 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu as pid 9323
I20260808 04:44:23.834815 21443 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786164000593138-21443-0/minicluster-data/ts-0/wal/instance
I20260808 04:44:23.835114 21443 external_mini_cluster.cc:1428] Setting key e2b069b71c8364d106bf00b205683439
I20260808 04:44:23.837278 21443 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
/tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786164000593138-21443-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786164000593138-21443-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786164000593138-21443-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786164000593138-21443-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.240.194:0
--local_ip_for_outbound_sockets=127.20.240.194
--webserver_interface=127.20.240.194
--webserver_port=0
--tserver_master_addrs=127.20.240.254:39305
--builtin_ntp_servers=127.20.240.212:42295
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260808 04:44:23.843871 9299 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:23.834686 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.240.193:38089 (local address 127.20.240.254:39305)
0808 04:44:23.834927 (+ 241us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:23.834933 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:23.836169 (+ 1236us) server_negotiation.cc:407] Connection header received
0808 04:44:23.837694 (+ 1525us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:23.837697 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:23.837777 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:23.837885 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:44:23.839007 (+ 1122us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:23.839911 (+ 904us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:23.841730 (+ 1819us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:23.842010 (+ 280us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:23.842126 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:23.843326 (+ 1200us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:44:23.843330 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:44:23.843333 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 04:44:23.843359 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:44:23.843384 (+ 25us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 04:44:23.843392 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:44:23.843474 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0808 04:44:23.843647 (+ 173us) server_negotiation.cc:299] Negotiation successful
0808 04:44:23.843718 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":136}
I20260808 04:44:23.844966 9464 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:23.835228 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:39305 (local address 127.20.240.193:38089)
0808 04:44:23.835997 (+ 769us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:23.836055 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0808 04:44:23.837477 (+ 1422us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:44:23.838066 (+ 589us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:44:23.838074 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:44:23.838158 (+ 84us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:44:23.838838 (+ 680us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:44:23.838856 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:44:23.840119 (+ 1263us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:44:23.840123 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:44:23.841584 (+ 1461us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:44:23.841595 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:44:23.842192 (+ 597us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:44:23.842197 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:44:23.842383 (+ 186us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:23.843043 (+ 660us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 04:44:23.843045 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:44:23.843088 (+ 43us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 04:44:23.843161 (+ 73us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:44:23.843477 (+ 316us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:44:23.843490 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:44:23.843496 (+ 6us) client_negotiation.cc:769] Sending connection context
0808 04:44:23.843637 (+ 141us) client_negotiation.cc:240] Negotiation successful
0808 04:44:23.844175 (+ 538us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":299,"thread_start_us":144,"threads_started":1}
I20260808 04:44:23.846563 9462 heartbeater.cc:347] Connected to a master server at 127.20.240.254:39305
I20260808 04:44:23.846828 9462 heartbeater.cc:464] Registering TS with master...
I20260808 04:44:23.847445 9462 heartbeater.cc:511] Master 127.20.240.254:39305 requested a full tablet report, sending...
I20260808 04:44:23.849143 9257 ts_manager.cc:194] Registered new tserver with Master: c0fa7ebf84564decb05a60f5c484a16d (127.20.240.193:44263)
I20260808 04:44:23.850416 9257 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.20.240.193:38089
W20260808 04:44:23.955965 9466 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:44:23.956380 9466 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:44:23.956467 9466 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:44:23.960650 9466 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:44:23.960753 9466 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:44:23.960858 9466 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.240.194
I20260808 04:44:23.965883 9466 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.240.212:42295
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786164000593138-21443-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786164000593138-21443-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.240.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786164000593138-21443-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.240.194
--webserver_port=0
--tserver_master_addrs=127.20.240.254:39305
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9466
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.240.194
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786164000593138-21443-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 04:05:18 UTC on ccycloud.quasar-drfdgt.root.comops.site
build id 4574101
I20260808 04:44:23.967095 9466 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:44:23.968529 9466 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:44:23.978345 9474 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:44:23.978405 9466 server_base.cc:1034] running on GCE node
W20260808 04:44:23.978394 9471 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:44:23.978353 9472 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:44:23.979103 9466 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:44:23.979815 9466 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:44:23.981031 9466 hybrid_clock.cc:648] HybridClock initialized: now 1786164263980991 us; error 52 us; skew 500 ppm
I20260808 04:44:23.983172 9466 webserver.cc:460] Webserver started at http://127.20.240.194:35811/ using document root <none> and password file <none>
I20260808 04:44:23.983902 9466 fs_manager.cc:359] Metadata directory not provided
I20260808 04:44:23.984001 9466 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:44:23.984256 9466 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 04:44:23.986555 9466 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786164000593138-21443-0/minicluster-data/ts-1/data/instance:
uuid: "22bc41169ee2441590c89f26139293c7"
format_stamp: "Formatted at 2026-08-08 04:44:23 on dist-test-slave-vxj2"
server_key: "4e515ccc1fd4c80a2f9c3e537b7962b3"
server_key_iv: "e0fcae1bf891bd38f1bc137633347083"
server_key_version: "encryptionkey@0"
I20260808 04:44:23.987149 9466 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786164000593138-21443-0/minicluster-data/ts-1/wal/instance:
uuid: "22bc41169ee2441590c89f26139293c7"
format_stamp: "Formatted at 2026-08-08 04:44:23 on dist-test-slave-vxj2"
server_key: "4e515ccc1fd4c80a2f9c3e537b7962b3"
server_key_iv: "e0fcae1bf891bd38f1bc137633347083"
server_key_version: "encryptionkey@0"
I20260808 04:44:23.991187 9466 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260808 04:44:23.993893 9481 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:44:23.995355 9466 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 04:44:23.995504 9466 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786164000593138-21443-0/minicluster-data/ts-1/data,/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786164000593138-21443-0/minicluster-data/ts-1/wal
uuid: "22bc41169ee2441590c89f26139293c7"
format_stamp: "Formatted at 2026-08-08 04:44:23 on dist-test-slave-vxj2"
server_key: "4e515ccc1fd4c80a2f9c3e537b7962b3"
server_key_iv: "e0fcae1bf891bd38f1bc137633347083"
server_key_version: "encryptionkey@0"
I20260808 04:44:23.995630 9466 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786164000593138-21443-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786164000593138-21443-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786164000593138-21443-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:44:24.019416 9466 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:44:24.020192 9466 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:44:24.020416 9466 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:44:24.021081 9466 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 04:44:24.022127 9466 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 04:44:24.022203 9466 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 04:44:24.022279 9466 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 04:44:24.022311 9466 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 04:44:24.032528 9466 rpc_server.cc:307] RPC server started. Bound to: 127.20.240.194:33025
I20260808 04:44:24.032557 9604 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.240.194:33025 every 8 connection(s)
I20260808 04:44:24.033578 9466 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786164000593138-21443-0/minicluster-data/ts-1/data/info.pb
I20260808 04:44:24.035606 21443 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu as pid 9466
I20260808 04:44:24.035844 21443 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786164000593138-21443-0/minicluster-data/ts-1/wal/instance
I20260808 04:44:24.036168 21443 external_mini_cluster.cc:1428] Setting key 647b76e635fee22005b6147951534899
I20260808 04:44:24.038266 21443 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
/tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786164000593138-21443-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786164000593138-21443-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786164000593138-21443-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786164000593138-21443-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.240.195:0
--local_ip_for_outbound_sockets=127.20.240.195
--webserver_interface=127.20.240.195
--webserver_port=0
--tserver_master_addrs=127.20.240.254:39305
--builtin_ntp_servers=127.20.240.212:42295
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260808 04:44:24.043598 9299 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:24.035586 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.240.194:47061 (local address 127.20.240.254:39305)
0808 04:44:24.035767 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:24.035772 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:24.036983 (+ 1211us) server_negotiation.cc:407] Connection header received
0808 04:44:24.038570 (+ 1587us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:24.038574 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:24.038632 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:24.038715 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:44:24.039632 (+ 917us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:24.040174 (+ 542us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:24.041540 (+ 1366us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:24.041758 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:24.041874 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:24.043062 (+ 1188us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:44:24.043066 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:44:24.043069 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 04:44:24.043084 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:44:24.043113 (+ 29us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 04:44:24.043121 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:44:24.043198 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0808 04:44:24.043371 (+ 173us) server_negotiation.cc:299] Negotiation successful
0808 04:44:24.043447 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260808 04:44:24.044514 9607 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:24.036071 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:39305 (local address 127.20.240.194:47061)
0808 04:44:24.036843 (+ 772us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:24.036896 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0808 04:44:24.038254 (+ 1358us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:44:24.038888 (+ 634us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:44:24.038896 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:44:24.038981 (+ 85us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:44:24.039489 (+ 508us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:44:24.039503 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:44:24.040318 (+ 815us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:44:24.040322 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:44:24.041333 (+ 1011us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:44:24.041365 (+ 32us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:44:24.041934 (+ 569us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:44:24.041939 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:44:24.042112 (+ 173us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:24.042771 (+ 659us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 04:44:24.042772 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:44:24.042816 (+ 44us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 04:44:24.042884 (+ 68us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:44:24.043212 (+ 328us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:44:24.043225 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:44:24.043237 (+ 12us) client_negotiation.cc:769] Sending connection context
0808 04:44:24.043369 (+ 132us) client_negotiation.cc:240] Negotiation successful
0808 04:44:24.043676 (+ 307us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":321,"thread_start_us":178,"threads_started":1}
I20260808 04:44:24.045809 9605 heartbeater.cc:347] Connected to a master server at 127.20.240.254:39305
I20260808 04:44:24.046113 9605 heartbeater.cc:464] Registering TS with master...
I20260808 04:44:24.046700 9605 heartbeater.cc:511] Master 127.20.240.254:39305 requested a full tablet report, sending...
I20260808 04:44:24.047888 9257 ts_manager.cc:194] Registered new tserver with Master: 22bc41169ee2441590c89f26139293c7 (127.20.240.194:33025)
I20260808 04:44:24.048832 9257 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.20.240.194:47061
W20260808 04:44:24.157823 9608 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:44:24.158115 9608 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:44:24.158156 9608 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:44:24.162294 9608 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:44:24.162365 9608 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:44:24.162422 9608 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.240.195
I20260808 04:44:24.167416 9608 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.240.212:42295
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786164000593138-21443-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786164000593138-21443-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.240.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786164000593138-21443-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.240.195
--webserver_port=0
--tserver_master_addrs=127.20.240.254:39305
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9608
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.240.195
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786164000593138-21443-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 04:05:18 UTC on ccycloud.quasar-drfdgt.root.comops.site
build id 4574101
I20260808 04:44:24.168609 9608 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:44:24.170069 9608 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:44:24.180280 9617 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:44:24.180280 9615 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:44:24.180322 9614 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:44:24.180575 9608 server_base.cc:1034] running on GCE node
I20260808 04:44:24.181242 9608 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:44:24.182027 9608 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:44:24.183223 9608 hybrid_clock.cc:648] HybridClock initialized: now 1786164264183212 us; error 28 us; skew 500 ppm
I20260808 04:44:24.185607 9608 webserver.cc:460] Webserver started at http://127.20.240.195:37971/ using document root <none> and password file <none>
I20260808 04:44:24.186232 9608 fs_manager.cc:359] Metadata directory not provided
I20260808 04:44:24.186331 9608 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:44:24.186592 9608 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 04:44:24.188757 9608 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786164000593138-21443-0/minicluster-data/ts-2/data/instance:
uuid: "c67bb8e36b054f66b039b8caff200c26"
format_stamp: "Formatted at 2026-08-08 04:44:24 on dist-test-slave-vxj2"
server_key: "f399a350d0a7d0e96a647d6135e65f90"
server_key_iv: "4e1ccb2be24203f29450f38482ebae11"
server_key_version: "encryptionkey@0"
I20260808 04:44:24.189429 9608 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786164000593138-21443-0/minicluster-data/ts-2/wal/instance:
uuid: "c67bb8e36b054f66b039b8caff200c26"
format_stamp: "Formatted at 2026-08-08 04:44:24 on dist-test-slave-vxj2"
server_key: "f399a350d0a7d0e96a647d6135e65f90"
server_key_iv: "4e1ccb2be24203f29450f38482ebae11"
server_key_version: "encryptionkey@0"
I20260808 04:44:24.193348 9608 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260808 04:44:24.195935 9625 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:44:24.197638 9608 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 04:44:24.197762 9608 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786164000593138-21443-0/minicluster-data/ts-2/data,/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786164000593138-21443-0/minicluster-data/ts-2/wal
uuid: "c67bb8e36b054f66b039b8caff200c26"
format_stamp: "Formatted at 2026-08-08 04:44:24 on dist-test-slave-vxj2"
server_key: "f399a350d0a7d0e96a647d6135e65f90"
server_key_iv: "4e1ccb2be24203f29450f38482ebae11"
server_key_version: "encryptionkey@0"
I20260808 04:44:24.197880 9608 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786164000593138-21443-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786164000593138-21443-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786164000593138-21443-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:44:24.223536 9608 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:44:24.224323 9608 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:44:24.224542 9608 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:44:24.225267 9608 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 04:44:24.226323 9608 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 04:44:24.226401 9608 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 04:44:24.226507 9608 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 04:44:24.226562 9608 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 04:44:24.236474 9608 rpc_server.cc:307] RPC server started. Bound to: 127.20.240.195:35139
I20260808 04:44:24.236507 9745 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.240.195:35139 every 8 connection(s)
I20260808 04:44:24.237548 9608 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786164000593138-21443-0/minicluster-data/ts-2/data/info.pb
I20260808 04:44:24.246042 21443 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu as pid 9608
I20260808 04:44:24.246170 21443 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786164000593138-21443-0/minicluster-data/ts-2/wal/instance
I20260808 04:44:24.246497 21443 external_mini_cluster.cc:1428] Setting key d9b3897afa8dfac3404e574b1fcc75ba
I20260808 04:44:24.247143 9299 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:24.239514 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.240.195:48423 (local address 127.20.240.254:39305)
0808 04:44:24.239656 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:24.239659 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:24.240761 (+ 1102us) server_negotiation.cc:407] Connection header received
0808 04:44:24.242317 (+ 1556us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:24.242321 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:24.242383 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:24.242495 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:44:24.243401 (+ 906us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:24.243945 (+ 544us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:24.245091 (+ 1146us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:24.245350 (+ 259us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:24.245464 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:24.246651 (+ 1187us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:44:24.246655 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:44:24.246658 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 04:44:24.246676 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:44:24.246694 (+ 18us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 04:44:24.246702 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:44:24.246780 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0808 04:44:24.246934 (+ 154us) server_negotiation.cc:299] Negotiation successful
0808 04:44:24.246998 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260808 04:44:24.247998 9749 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:24.239887 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:39305 (local address 127.20.240.195:48423)
0808 04:44:24.240590 (+ 703us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:24.240633 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0808 04:44:24.242090 (+ 1457us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:44:24.242675 (+ 585us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:44:24.242682 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:44:24.242768 (+ 86us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:44:24.243254 (+ 486us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:44:24.243266 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:44:24.244087 (+ 821us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:44:24.244091 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:44:24.244965 (+ 874us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:44:24.244974 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:44:24.245529 (+ 555us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:44:24.245535 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:44:24.245687 (+ 152us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:24.246367 (+ 680us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 04:44:24.246368 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:44:24.246414 (+ 46us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 04:44:24.246490 (+ 76us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:44:24.246781 (+ 291us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:44:24.246794 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:44:24.246801 (+ 7us) client_negotiation.cc:769] Sending connection context
0808 04:44:24.246934 (+ 133us) client_negotiation.cc:240] Negotiation successful
0808 04:44:24.247216 (+ 282us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":309,"thread_start_us":110,"threads_started":1}
I20260808 04:44:24.249015 9747 heartbeater.cc:347] Connected to a master server at 127.20.240.254:39305
I20260808 04:44:24.249292 9747 heartbeater.cc:464] Registering TS with master...
I20260808 04:44:24.249764 9747 heartbeater.cc:511] Master 127.20.240.254:39305 requested a full tablet report, sending...
I20260808 04:44:24.250749 9256 ts_manager.cc:194] Registered new tserver with Master: c67bb8e36b054f66b039b8caff200c26 (127.20.240.195:35139)
I20260808 04:44:24.251330 9256 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.20.240.195:48423
I20260808 04:44:24.260596 21443 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 04:44:24.266777 9299 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:24.262609 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37016 (local address 127.20.240.254:39305)
0808 04:44:24.262759 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:24.262764 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:24.262951 (+ 187us) server_negotiation.cc:407] Connection header received
0808 04:44:24.263036 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:24.263038 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:24.263093 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:24.263168 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:44:24.263389 (+ 221us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:24.263972 (+ 583us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:24.264916 (+ 944us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:24.265229 (+ 313us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:24.265323 (+ 94us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:24.266215 (+ 892us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:44:24.266218 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:44:24.266220 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 04:44:24.266234 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:44:24.266255 (+ 21us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 04:44:24.266263 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:44:24.266390 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0808 04:44:24.266533 (+ 143us) server_negotiation.cc:299] Negotiation successful
0808 04:44:24.266572 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260808 04:44:24.270267 9256 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37016:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 04:44:24.273473 9256 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 04:44:24.288832 9759 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:24.282734 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.195:35139 (local address 127.0.0.1:33076)
0808 04:44:24.283156 (+ 422us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:24.283210 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0808 04:44:24.283407 (+ 197us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:44:24.284493 (+ 1086us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:44:24.284501 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:44:24.284528 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 04:44:24.284721 (+ 193us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:44:24.284757 (+ 36us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:44:24.285993 (+ 1236us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:44:24.285998 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:44:24.287110 (+ 1112us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:44:24.287121 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:44:24.288227 (+ 1106us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:44:24.288231 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:44:24.288341 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:24.288382 (+ 41us) client_negotiation.cc:769] Sending connection context
0808 04:44:24.288507 (+ 125us) client_negotiation.cc:240] Negotiation successful
0808 04:44:24.288639 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":226,"thread_start_us":138,"threads_started":1}
I20260808 04:44:24.288842 9760 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:24.282954 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33076 (local address 127.20.240.195:35139)
0808 04:44:24.283704 (+ 750us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:24.283718 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:24.283748 (+ 30us) server_negotiation.cc:407] Connection header received
0808 04:44:24.283841 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:24.283846 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:24.284071 (+ 225us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:24.284226 (+ 155us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 04:44:24.284905 (+ 679us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:24.285881 (+ 976us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:24.287264 (+ 1383us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:24.288103 (+ 839us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:24.288223 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:24.288410 (+ 187us) server_negotiation.cc:1035] Waiting for connection context
0808 04:44:24.288550 (+ 140us) server_negotiation.cc:299] Negotiation successful
0808 04:44:24.288661 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":641,"thread_start_us":180,"threads_started":1}
I20260808 04:44:24.289381 9764 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:24.283198 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.193:44263 (local address 127.0.0.1:39356)
0808 04:44:24.283830 (+ 632us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:24.283844 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 04:44:24.283940 (+ 96us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:44:24.284794 (+ 854us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:44:24.284800 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:44:24.284823 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 04:44:24.284919 (+ 96us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:44:24.284924 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:44:24.286676 (+ 1752us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:44:24.286680 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:44:24.287833 (+ 1153us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:44:24.287844 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:44:24.288943 (+ 1099us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:44:24.288946 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:44:24.289059 (+ 113us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:24.289083 (+ 24us) client_negotiation.cc:769] Sending connection context
0808 04:44:24.289129 (+ 46us) client_negotiation.cc:240] Negotiation successful
0808 04:44:24.289229 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":561,"mutex_wait_us":19,"thread_start_us":96,"threads_started":1}
I20260808 04:44:24.289252 9761 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:24.283525 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.194:33025 (local address 127.0.0.1:40022)
0808 04:44:24.283890 (+ 365us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:24.283902 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 04:44:24.283985 (+ 83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:44:24.285044 (+ 1059us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:44:24.285047 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:44:24.285066 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 04:44:24.285189 (+ 123us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:44:24.285199 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:44:24.286705 (+ 1506us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:44:24.286711 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:44:24.287804 (+ 1093us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:44:24.287814 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:44:24.288791 (+ 977us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:44:24.288795 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:44:24.288890 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:24.288931 (+ 41us) client_negotiation.cc:769] Sending connection context
0808 04:44:24.288990 (+ 59us) client_negotiation.cc:240] Negotiation successful
0808 04:44:24.289078 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":300,"mutex_wait_us":25,"thread_start_us":84,"threads_started":1}
I20260808 04:44:24.289857 9766 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:24.284152 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40022 (local address 127.20.240.194:33025)
0808 04:44:24.284601 (+ 449us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:24.284614 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:24.284640 (+ 26us) server_negotiation.cc:407] Connection header received
0808 04:44:24.284717 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:24.284724 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:24.284891 (+ 167us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:24.285064 (+ 173us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 04:44:24.285319 (+ 255us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:24.286552 (+ 1233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:24.287941 (+ 1389us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:24.288659 (+ 718us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:24.289404 (+ 745us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:24.289540 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0808 04:44:24.289591 (+ 51us) server_negotiation.cc:299] Negotiation successful
0808 04:44:24.289682 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":360,"thread_start_us":143,"threads_started":1}
I20260808 04:44:24.289856 9765 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:24.283639 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39356 (local address 127.20.240.193:44263)
0808 04:44:24.284246 (+ 607us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:24.284260 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:24.284288 (+ 28us) server_negotiation.cc:407] Connection header received
0808 04:44:24.284411 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:24.284416 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:24.284595 (+ 179us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:24.284797 (+ 202us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 04:44:24.285359 (+ 562us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:24.286541 (+ 1182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:24.287979 (+ 1438us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:24.288797 (+ 818us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:24.289363 (+ 566us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:24.289537 (+ 174us) server_negotiation.cc:1035] Waiting for connection context
0808 04:44:24.289591 (+ 54us) server_negotiation.cc:299] Negotiation successful
0808 04:44:24.289682 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":504,"thread_start_us":115,"threads_started":1}
I20260808 04:44:24.292335 9675 tablet_service.cc:1467] Processing CreateTablet for tablet 55c7ed62350540cc8f4fdd4daa84f49a (DEFAULT_TABLE table=test-table [id=5b43a8295c074f72a428827f0e3b3fb8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 04:44:24.292534 9390 tablet_service.cc:1467] Processing CreateTablet for tablet 55c7ed62350540cc8f4fdd4daa84f49a (DEFAULT_TABLE table=test-table [id=5b43a8295c074f72a428827f0e3b3fb8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 04:44:24.293466 9390 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 55c7ed62350540cc8f4fdd4daa84f49a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:44:24.293484 9675 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 55c7ed62350540cc8f4fdd4daa84f49a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:44:24.293715 9535 tablet_service.cc:1467] Processing CreateTablet for tablet 55c7ed62350540cc8f4fdd4daa84f49a (DEFAULT_TABLE table=test-table [id=5b43a8295c074f72a428827f0e3b3fb8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 04:44:24.294693 9535 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 55c7ed62350540cc8f4fdd4daa84f49a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:44:24.300211 9767 tablet_bootstrap.cc:492] T 55c7ed62350540cc8f4fdd4daa84f49a P c0fa7ebf84564decb05a60f5c484a16d: Bootstrap starting.
I20260808 04:44:24.301214 9768 tablet_bootstrap.cc:492] T 55c7ed62350540cc8f4fdd4daa84f49a P c67bb8e36b054f66b039b8caff200c26: Bootstrap starting.
I20260808 04:44:24.302680 9767 tablet_bootstrap.cc:654] T 55c7ed62350540cc8f4fdd4daa84f49a P c0fa7ebf84564decb05a60f5c484a16d: Neither blocks nor log segments found. Creating new log.
I20260808 04:44:24.302934 9769 tablet_bootstrap.cc:492] T 55c7ed62350540cc8f4fdd4daa84f49a P 22bc41169ee2441590c89f26139293c7: Bootstrap starting.
I20260808 04:44:24.303534 9768 tablet_bootstrap.cc:654] T 55c7ed62350540cc8f4fdd4daa84f49a P c67bb8e36b054f66b039b8caff200c26: Neither blocks nor log segments found. Creating new log.
I20260808 04:44:24.303730 9767 log.cc:824] T 55c7ed62350540cc8f4fdd4daa84f49a P c0fa7ebf84564decb05a60f5c484a16d: Log is configured to *not* fsync() on all Append() calls
I20260808 04:44:24.304371 9768 log.cc:824] T 55c7ed62350540cc8f4fdd4daa84f49a P c67bb8e36b054f66b039b8caff200c26: Log is configured to *not* fsync() on all Append() calls
I20260808 04:44:24.305018 9769 tablet_bootstrap.cc:654] T 55c7ed62350540cc8f4fdd4daa84f49a P 22bc41169ee2441590c89f26139293c7: Neither blocks nor log segments found. Creating new log.
I20260808 04:44:24.305850 9769 log.cc:824] T 55c7ed62350540cc8f4fdd4daa84f49a P 22bc41169ee2441590c89f26139293c7: Log is configured to *not* fsync() on all Append() calls
I20260808 04:44:24.306564 9767 tablet_bootstrap.cc:492] T 55c7ed62350540cc8f4fdd4daa84f49a P c0fa7ebf84564decb05a60f5c484a16d: No bootstrap required, opened a new log
I20260808 04:44:24.306773 9768 tablet_bootstrap.cc:492] T 55c7ed62350540cc8f4fdd4daa84f49a P c67bb8e36b054f66b039b8caff200c26: No bootstrap required, opened a new log
I20260808 04:44:24.306787 9767 ts_tablet_manager.cc:1397] T 55c7ed62350540cc8f4fdd4daa84f49a P c0fa7ebf84564decb05a60f5c484a16d: Time spent bootstrapping tablet: real 0.007s user 0.001s sys 0.004s
I20260808 04:44:24.306967 9768 ts_tablet_manager.cc:1397] T 55c7ed62350540cc8f4fdd4daa84f49a P c67bb8e36b054f66b039b8caff200c26: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260808 04:44:24.307860 9769 tablet_bootstrap.cc:492] T 55c7ed62350540cc8f4fdd4daa84f49a P 22bc41169ee2441590c89f26139293c7: No bootstrap required, opened a new log
I20260808 04:44:24.308089 9769 ts_tablet_manager.cc:1397] T 55c7ed62350540cc8f4fdd4daa84f49a P 22bc41169ee2441590c89f26139293c7: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260808 04:44:24.310240 9768 raft_consensus.cc:348] T 55c7ed62350540cc8f4fdd4daa84f49a P c67bb8e36b054f66b039b8caff200c26 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c67bb8e36b054f66b039b8caff200c26" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 35139 } } peers { permanent_uuid: "22bc41169ee2441590c89f26139293c7" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 33025 } } peers { permanent_uuid: "c0fa7ebf84564decb05a60f5c484a16d" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 44263 } }
I20260808 04:44:24.310482 9768 raft_consensus.cc:374] T 55c7ed62350540cc8f4fdd4daa84f49a P c67bb8e36b054f66b039b8caff200c26 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:44:24.310552 9768 raft_consensus.cc:729] T 55c7ed62350540cc8f4fdd4daa84f49a P c67bb8e36b054f66b039b8caff200c26 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c67bb8e36b054f66b039b8caff200c26, State: Initialized, Role: FOLLOWER
I20260808 04:44:24.311008 9768 consensus_queue.cc:260] T 55c7ed62350540cc8f4fdd4daa84f49a P c67bb8e36b054f66b039b8caff200c26 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c67bb8e36b054f66b039b8caff200c26" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 35139 } } peers { permanent_uuid: "22bc41169ee2441590c89f26139293c7" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 33025 } } peers { permanent_uuid: "c0fa7ebf84564decb05a60f5c484a16d" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 44263 } }
I20260808 04:44:24.311103 9767 raft_consensus.cc:348] T 55c7ed62350540cc8f4fdd4daa84f49a P c0fa7ebf84564decb05a60f5c484a16d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c67bb8e36b054f66b039b8caff200c26" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 35139 } } peers { permanent_uuid: "22bc41169ee2441590c89f26139293c7" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 33025 } } peers { permanent_uuid: "c0fa7ebf84564decb05a60f5c484a16d" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 44263 } }
I20260808 04:44:24.311408 9767 raft_consensus.cc:374] T 55c7ed62350540cc8f4fdd4daa84f49a P c0fa7ebf84564decb05a60f5c484a16d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:44:24.311527 9767 raft_consensus.cc:729] T 55c7ed62350540cc8f4fdd4daa84f49a P c0fa7ebf84564decb05a60f5c484a16d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0fa7ebf84564decb05a60f5c484a16d, State: Initialized, Role: FOLLOWER
I20260808 04:44:24.311661 9747 heartbeater.cc:503] Master 127.20.240.254:39305 was elected leader, sending a full tablet report...
I20260808 04:44:24.312077 9768 ts_tablet_manager.cc:1428] T 55c7ed62350540cc8f4fdd4daa84f49a P c67bb8e36b054f66b039b8caff200c26: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20260808 04:44:24.312206 9769 raft_consensus.cc:348] T 55c7ed62350540cc8f4fdd4daa84f49a P 22bc41169ee2441590c89f26139293c7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c67bb8e36b054f66b039b8caff200c26" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 35139 } } peers { permanent_uuid: "22bc41169ee2441590c89f26139293c7" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 33025 } } peers { permanent_uuid: "c0fa7ebf84564decb05a60f5c484a16d" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 44263 } }
I20260808 04:44:24.312469 9769 raft_consensus.cc:374] T 55c7ed62350540cc8f4fdd4daa84f49a P 22bc41169ee2441590c89f26139293c7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:44:24.312561 9769 raft_consensus.cc:729] T 55c7ed62350540cc8f4fdd4daa84f49a P 22bc41169ee2441590c89f26139293c7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22bc41169ee2441590c89f26139293c7, State: Initialized, Role: FOLLOWER
I20260808 04:44:24.312848 9767 consensus_queue.cc:260] T 55c7ed62350540cc8f4fdd4daa84f49a P c0fa7ebf84564decb05a60f5c484a16d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c67bb8e36b054f66b039b8caff200c26" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 35139 } } peers { permanent_uuid: "22bc41169ee2441590c89f26139293c7" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 33025 } } peers { permanent_uuid: "c0fa7ebf84564decb05a60f5c484a16d" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 44263 } }
I20260808 04:44:24.313053 9769 consensus_queue.cc:260] T 55c7ed62350540cc8f4fdd4daa84f49a P 22bc41169ee2441590c89f26139293c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c67bb8e36b054f66b039b8caff200c26" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 35139 } } peers { permanent_uuid: "22bc41169ee2441590c89f26139293c7" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 33025 } } peers { permanent_uuid: "c0fa7ebf84564decb05a60f5c484a16d" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 44263 } }
I20260808 04:44:24.313585 9462 heartbeater.cc:503] Master 127.20.240.254:39305 was elected leader, sending a full tablet report...
I20260808 04:44:24.313922 9767 ts_tablet_manager.cc:1428] T 55c7ed62350540cc8f4fdd4daa84f49a P c0fa7ebf84564decb05a60f5c484a16d: Time spent starting tablet: real 0.007s user 0.006s sys 0.001s
I20260808 04:44:24.314025 9769 ts_tablet_manager.cc:1428] T 55c7ed62350540cc8f4fdd4daa84f49a P 22bc41169ee2441590c89f26139293c7: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20260808 04:44:24.314316 9605 heartbeater.cc:503] Master 127.20.240.254:39305 was elected leader, sending a full tablet report...
W20260808 04:44:24.333951 9463 tablet.cc:2369] T 55c7ed62350540cc8f4fdd4daa84f49a P c0fa7ebf84564decb05a60f5c484a16d: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 04:44:24.433887 9775 raft_consensus.cc:482] T 55c7ed62350540cc8f4fdd4daa84f49a P c0fa7ebf84564decb05a60f5c484a16d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 04:44:24.434183 9775 raft_consensus.cc:504] T 55c7ed62350540cc8f4fdd4daa84f49a P c0fa7ebf84564decb05a60f5c484a16d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c67bb8e36b054f66b039b8caff200c26" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 35139 } } peers { permanent_uuid: "22bc41169ee2441590c89f26139293c7" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 33025 } } peers { permanent_uuid: "c0fa7ebf84564decb05a60f5c484a16d" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 44263 } }
I20260808 04:44:24.435500 9775 leader_election.cc:288] T 55c7ed62350540cc8f4fdd4daa84f49a P c0fa7ebf84564decb05a60f5c484a16d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c67bb8e36b054f66b039b8caff200c26 (127.20.240.195:35139), 22bc41169ee2441590c89f26139293c7 (127.20.240.194:33025)
I20260808 04:44:24.440996 9760 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:24.435999 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.240.193:45485 (local address 127.20.240.195:35139)
0808 04:44:24.436171 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:24.436176 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:24.436195 (+ 19us) server_negotiation.cc:407] Connection header received
0808 04:44:24.436389 (+ 194us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:24.436393 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:24.436450 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:24.436550 (+ 100us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 04:44:24.436916 (+ 366us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:24.437746 (+ 830us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:24.439594 (+ 1848us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:24.440250 (+ 656us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:24.440355 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:24.440393 (+ 38us) server_negotiation.cc:1035] Waiting for connection context
0808 04:44:24.440768 (+ 375us) server_negotiation.cc:299] Negotiation successful
0808 04:44:24.440844 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260808 04:44:24.440980 9766 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:24.436344 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.240.193:45405 (local address 127.20.240.194:33025)
0808 04:44:24.436479 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:24.436485 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:24.436662 (+ 177us) server_negotiation.cc:407] Connection header received
0808 04:44:24.436771 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:24.436773 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:24.436813 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:24.436907 (+ 94us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 04:44:24.437181 (+ 274us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:24.437893 (+ 712us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:24.439593 (+ 1700us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:24.440198 (+ 605us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:24.440342 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:24.440394 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0808 04:44:24.440768 (+ 374us) server_negotiation.cc:299] Negotiation successful
0808 04:44:24.440844 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260808 04:44:24.441027 9777 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:24.435802 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.195:35139 (local address 127.20.240.193:45485)
0808 04:44:24.436088 (+ 286us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:24.436105 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 04:44:24.436206 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:44:24.436577 (+ 371us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:44:24.436582 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:44:24.436608 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 04:44:24.436780 (+ 172us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:44:24.436787 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:44:24.437862 (+ 1075us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:44:24.437865 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:44:24.439428 (+ 1563us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:44:24.439440 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:44:24.440376 (+ 936us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:44:24.440380 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:44:24.440574 (+ 194us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:24.440647 (+ 73us) client_negotiation.cc:769] Sending connection context
0808 04:44:24.440729 (+ 82us) client_negotiation.cc:240] Negotiation successful
0808 04:44:24.440833 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":202,"mutex_wait_us":153,"spinlock_wait_cycles":24832,"thread_start_us":120,"threads_started":1}
I20260808 04:44:24.441027 9778 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:24.436198 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.194:33025 (local address 127.20.240.193:45405)
0808 04:44:24.436557 (+ 359us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:24.436570 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 04:44:24.436680 (+ 110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:44:24.436940 (+ 260us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:44:24.436942 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:44:24.436957 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 04:44:24.437049 (+ 92us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:44:24.437053 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:44:24.437995 (+ 942us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:44:24.437998 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:44:24.439430 (+ 1432us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:44:24.439440 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:44:24.440375 (+ 935us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:44:24.440380 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:44:24.440595 (+ 215us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:24.440655 (+ 60us) client_negotiation.cc:769] Sending connection context
0808 04:44:24.440729 (+ 74us) client_negotiation.cc:240] Negotiation successful
0808 04:44:24.440833 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":261,"mutex_wait_us":201,"spinlock_wait_cycles":3200,"thread_start_us":120,"threads_started":1}
I20260808 04:44:24.441879 9697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "55c7ed62350540cc8f4fdd4daa84f49a" candidate_uuid: "c0fa7ebf84564decb05a60f5c484a16d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c67bb8e36b054f66b039b8caff200c26" is_pre_election: true
I20260808 04:44:24.442077 9555 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "55c7ed62350540cc8f4fdd4daa84f49a" candidate_uuid: "c0fa7ebf84564decb05a60f5c484a16d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22bc41169ee2441590c89f26139293c7" is_pre_election: true
I20260808 04:44:24.442277 9697 raft_consensus.cc:2454] T 55c7ed62350540cc8f4fdd4daa84f49a P c67bb8e36b054f66b039b8caff200c26 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0fa7ebf84564decb05a60f5c484a16d in term 0.
I20260808 04:44:24.442353 9555 raft_consensus.cc:2454] T 55c7ed62350540cc8f4fdd4daa84f49a P 22bc41169ee2441590c89f26139293c7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0fa7ebf84564decb05a60f5c484a16d in term 0.
I20260808 04:44:24.442873 9338 leader_election.cc:302] T 55c7ed62350540cc8f4fdd4daa84f49a P c0fa7ebf84564decb05a60f5c484a16d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c0fa7ebf84564decb05a60f5c484a16d, c67bb8e36b054f66b039b8caff200c26; no voters:
I20260808 04:44:24.443174 9775 raft_consensus.cc:2781] T 55c7ed62350540cc8f4fdd4daa84f49a P c0fa7ebf84564decb05a60f5c484a16d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 04:44:24.443272 9775 raft_consensus.cc:482] T 55c7ed62350540cc8f4fdd4daa84f49a P c0fa7ebf84564decb05a60f5c484a16d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 04:44:24.443305 9775 raft_consensus.cc:3037] T 55c7ed62350540cc8f4fdd4daa84f49a P c0fa7ebf84564decb05a60f5c484a16d [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:44:24.444466 9775 raft_consensus.cc:504] T 55c7ed62350540cc8f4fdd4daa84f49a P c0fa7ebf84564decb05a60f5c484a16d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c67bb8e36b054f66b039b8caff200c26" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 35139 } } peers { permanent_uuid: "22bc41169ee2441590c89f26139293c7" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 33025 } } peers { permanent_uuid: "c0fa7ebf84564decb05a60f5c484a16d" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 44263 } }
I20260808 04:44:24.444835 9775 leader_election.cc:288] T 55c7ed62350540cc8f4fdd4daa84f49a P c0fa7ebf84564decb05a60f5c484a16d [CANDIDATE]: Term 1 election: Requested vote from peers c67bb8e36b054f66b039b8caff200c26 (127.20.240.195:35139), 22bc41169ee2441590c89f26139293c7 (127.20.240.194:33025)
I20260808 04:44:24.445250 9697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "55c7ed62350540cc8f4fdd4daa84f49a" candidate_uuid: "c0fa7ebf84564decb05a60f5c484a16d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c67bb8e36b054f66b039b8caff200c26"
I20260808 04:44:24.445313 9555 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "55c7ed62350540cc8f4fdd4daa84f49a" candidate_uuid: "c0fa7ebf84564decb05a60f5c484a16d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22bc41169ee2441590c89f26139293c7"
I20260808 04:44:24.445365 9697 raft_consensus.cc:3037] T 55c7ed62350540cc8f4fdd4daa84f49a P c67bb8e36b054f66b039b8caff200c26 [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:44:24.445519 9555 raft_consensus.cc:3037] T 55c7ed62350540cc8f4fdd4daa84f49a P 22bc41169ee2441590c89f26139293c7 [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:44:24.446511 9697 raft_consensus.cc:2454] T 55c7ed62350540cc8f4fdd4daa84f49a P c67bb8e36b054f66b039b8caff200c26 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0fa7ebf84564decb05a60f5c484a16d in term 1.
I20260808 04:44:24.446653 9555 raft_consensus.cc:2454] T 55c7ed62350540cc8f4fdd4daa84f49a P 22bc41169ee2441590c89f26139293c7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0fa7ebf84564decb05a60f5c484a16d in term 1.
I20260808 04:44:24.446884 9338 leader_election.cc:302] T 55c7ed62350540cc8f4fdd4daa84f49a P c0fa7ebf84564decb05a60f5c484a16d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c0fa7ebf84564decb05a60f5c484a16d, c67bb8e36b054f66b039b8caff200c26; no voters:
I20260808 04:44:24.447062 9775 raft_consensus.cc:2781] T 55c7ed62350540cc8f4fdd4daa84f49a P c0fa7ebf84564decb05a60f5c484a16d [term 1 FOLLOWER]: Leader election won for term 1
I20260808 04:44:24.447306 9775 raft_consensus.cc:686] T 55c7ed62350540cc8f4fdd4daa84f49a P c0fa7ebf84564decb05a60f5c484a16d [term 1 LEADER]: Becoming Leader. State: Replica: c0fa7ebf84564decb05a60f5c484a16d, State: Running, Role: LEADER
I20260808 04:44:24.447659 9775 consensus_queue.cc:237] T 55c7ed62350540cc8f4fdd4daa84f49a P c0fa7ebf84564decb05a60f5c484a16d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c67bb8e36b054f66b039b8caff200c26" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 35139 } } peers { permanent_uuid: "22bc41169ee2441590c89f26139293c7" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 33025 } } peers { permanent_uuid: "c0fa7ebf84564decb05a60f5c484a16d" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 44263 } }
I20260808 04:44:24.451293 9256 catalog_manager.cc:5495] T 55c7ed62350540cc8f4fdd4daa84f49a P c0fa7ebf84564decb05a60f5c484a16d reported cstate change: term changed from 0 to 1, leader changed from <none> to c0fa7ebf84564decb05a60f5c484a16d (127.20.240.193). New cstate: current_term: 1 leader_uuid: "c0fa7ebf84564decb05a60f5c484a16d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c67bb8e36b054f66b039b8caff200c26" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 35139 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "22bc41169ee2441590c89f26139293c7" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 33025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c0fa7ebf84564decb05a60f5c484a16d" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 44263 } health_report { overall_health: HEALTHY } } }
I20260808 04:44:24.481842 9765 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:24.478056 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38060 (local address 127.20.240.193:44263)
0808 04:44:24.478205 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:24.478212 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:24.478228 (+ 16us) server_negotiation.cc:407] Connection header received
0808 04:44:24.478330 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:24.478333 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:24.478388 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:24.478508 (+ 120us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 04:44:24.478864 (+ 356us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:24.479383 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:24.480273 (+ 890us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:24.480493 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:24.480607 (+ 114us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:24.480930 (+ 323us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 04:44:24.481385 (+ 455us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 04:44:24.481553 (+ 168us) server_negotiation.cc:1035] Waiting for connection context
0808 04:44:24.481644 (+ 91us) server_negotiation.cc:299] Negotiation successful
0808 04:44:24.481684 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260808 04:44:24.488168 9697 raft_consensus.cc:1261] T 55c7ed62350540cc8f4fdd4daa84f49a P c67bb8e36b054f66b039b8caff200c26 [term 1 FOLLOWER]: Refusing update from remote peer c0fa7ebf84564decb05a60f5c484a16d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 04:44:24.488169 9555 raft_consensus.cc:1261] T 55c7ed62350540cc8f4fdd4daa84f49a P 22bc41169ee2441590c89f26139293c7 [term 1 FOLLOWER]: Refusing update from remote peer c0fa7ebf84564decb05a60f5c484a16d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260808 04:44:24.488580 9748 tablet.cc:2369] T 55c7ed62350540cc8f4fdd4daa84f49a P c67bb8e36b054f66b039b8caff200c26: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 04:44:24.488996 9775 consensus_queue.cc:1035] T 55c7ed62350540cc8f4fdd4daa84f49a P c0fa7ebf84564decb05a60f5c484a16d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c67bb8e36b054f66b039b8caff200c26" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 35139 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 04:44:24.489357 9779 consensus_queue.cc:1035] T 55c7ed62350540cc8f4fdd4daa84f49a P c0fa7ebf84564decb05a60f5c484a16d [LEADER]: Connected to new peer: Peer: permanent_uuid: "22bc41169ee2441590c89f26139293c7" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 04:44:24.499698 9784 mvcc.cc:205] Tried to move back new op lower bound from 7316128827336056832 to 7316128827180732416. Current Snapshot: MvccSnapshot[applied={T|T < 7316128827336056832}]
I20260808 04:44:24.499958 9783 mvcc.cc:205] Tried to move back new op lower bound from 7316128827336056832 to 7316128827180732416. Current Snapshot: MvccSnapshot[applied={T|T < 7316128827336056832}]
I20260808 04:44:24.507589 9257 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37016:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 04:44:24.507771 9257 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37016:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 04:44:24.510459 9257 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 7a779b5ff763475297a0def69d82568d: Sending DeleteTablet for 3 replicas of tablet 55c7ed62350540cc8f4fdd4daa84f49a
I20260808 04:44:24.511430 9390 tablet_service.cc:1514] Processing DeleteTablet for tablet 55c7ed62350540cc8f4fdd4daa84f49a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 04:44:24 UTC) from {username='slave'} at 127.0.0.1:39356
I20260808 04:44:24.511471 9535 tablet_service.cc:1514] Processing DeleteTablet for tablet 55c7ed62350540cc8f4fdd4daa84f49a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 04:44:24 UTC) from {username='slave'} at 127.0.0.1:40022
I20260808 04:44:24.511468 9675 tablet_service.cc:1514] Processing DeleteTablet for tablet 55c7ed62350540cc8f4fdd4daa84f49a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 04:44:24 UTC) from {username='slave'} at 127.0.0.1:33076
I20260808 04:44:24.512009 9794 tablet_replica.cc:330] T 55c7ed62350540cc8f4fdd4daa84f49a P c0fa7ebf84564decb05a60f5c484a16d: stopping tablet replica
I20260808 04:44:24.512194 9796 tablet_replica.cc:330] T 55c7ed62350540cc8f4fdd4daa84f49a P c67bb8e36b054f66b039b8caff200c26: stopping tablet replica
I20260808 04:44:24.512634 9796 raft_consensus.cc:2229] T 55c7ed62350540cc8f4fdd4daa84f49a P c67bb8e36b054f66b039b8caff200c26 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 04:44:24.512717 21443 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu with pid 9323
I20260808 04:44:24.513100 9796 raft_consensus.cc:2258] T 55c7ed62350540cc8f4fdd4daa84f49a P c67bb8e36b054f66b039b8caff200c26 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 04:44:24.516680 9796 ts_tablet_manager.cc:1905] T 55c7ed62350540cc8f4fdd4daa84f49a P c67bb8e36b054f66b039b8caff200c26: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 04:44:24.517402 9795 tablet_replica.cc:330] T 55c7ed62350540cc8f4fdd4daa84f49a P 22bc41169ee2441590c89f26139293c7: stopping tablet replica
I20260808 04:44:24.517742 9795 raft_consensus.cc:2229] T 55c7ed62350540cc8f4fdd4daa84f49a P 22bc41169ee2441590c89f26139293c7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 04:44:24.518085 9795 raft_consensus.cc:2258] T 55c7ed62350540cc8f4fdd4daa84f49a P 22bc41169ee2441590c89f26139293c7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 04:44:24.519433 9795 ts_tablet_manager.cc:1905] T 55c7ed62350540cc8f4fdd4daa84f49a P 22bc41169ee2441590c89f26139293c7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 04:44:24.521071 9796 ts_tablet_manager.cc:1918] T 55c7ed62350540cc8f4fdd4daa84f49a P c67bb8e36b054f66b039b8caff200c26: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 04:44:24.521229 9796 log.cc:1196] T 55c7ed62350540cc8f4fdd4daa84f49a P c67bb8e36b054f66b039b8caff200c26: Deleting WAL directory at /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786164000593138-21443-0/minicluster-data/ts-2/wal/wals/55c7ed62350540cc8f4fdd4daa84f49a
I20260808 04:44:24.521636 9796 ts_tablet_manager.cc:1939] T 55c7ed62350540cc8f4fdd4daa84f49a P c67bb8e36b054f66b039b8caff200c26: Deleting consensus metadata
I20260808 04:44:24.521906 9795 ts_tablet_manager.cc:1918] T 55c7ed62350540cc8f4fdd4daa84f49a P 22bc41169ee2441590c89f26139293c7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 04:44:24.522019 9795 log.cc:1196] T 55c7ed62350540cc8f4fdd4daa84f49a P 22bc41169ee2441590c89f26139293c7: Deleting WAL directory at /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786164000593138-21443-0/minicluster-data/ts-1/wal/wals/55c7ed62350540cc8f4fdd4daa84f49a
I20260808 04:44:24.522305 9795 ts_tablet_manager.cc:1939] T 55c7ed62350540cc8f4fdd4daa84f49a P 22bc41169ee2441590c89f26139293c7: Deleting consensus metadata
I20260808 04:44:24.523259 9240 catalog_manager.cc:4841] TS c67bb8e36b054f66b039b8caff200c26 (127.20.240.195:35139): tablet 55c7ed62350540cc8f4fdd4daa84f49a (table test-table [id=5b43a8295c074f72a428827f0e3b3fb8]) successfully deleted
I20260808 04:44:24.523535 9240 catalog_manager.cc:4841] TS 22bc41169ee2441590c89f26139293c7 (127.20.240.194:33025): tablet 55c7ed62350540cc8f4fdd4daa84f49a (table test-table [id=5b43a8295c074f72a428827f0e3b3fb8]) successfully deleted
W20260808 04:44:24.523602 9242 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.20.240.193:44263 (error 108)
I20260808 04:44:24.523874 21443 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu with pid 9466
I20260808 04:44:24.525815 9759 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:24.525099 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.193:44263 (local address 127.0.0.1:38072)
0808 04:44:24.525599 (+ 500us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:24.525699 (+ 100us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.240.193:44263: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":386}
W20260808 04:44:24.526033 9242 catalog_manager.cc:4584] TS c0fa7ebf84564decb05a60f5c484a16d (127.20.240.193:44263): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 55c7ed62350540cc8f4fdd4daa84f49a: Network error: Client connection negotiation failed: client connection to 127.20.240.193:44263: connect: Connection refused (error 111)
I20260808 04:44:24.533053 21443 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu with pid 9608
I20260808 04:44:24.540674 21443 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu with pid 9222
2026-08-08T04:44:24Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/3 (1222 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/4
Loading random data
Initializing database '/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786164000593138-21443-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 04:44:24 dist-test-slave-vxj2 krb5kdc[9800](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 04:44:24 dist-test-slave-vxj2 krb5kdc[9800](info): set up 2 sockets
Aug 08 04:44:24 dist-test-slave-vxj2 krb5kdc[9800](info): commencing operation
krb5kdc: starting...
W20260808 04:44:25.635967 21443 mini_kdc.cc:121] Time spent starting KDC: real 1.071s user 0.004s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786164000593138-21443-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786164000593138-21443-0/krb5kdc/test-user.keytab.
Aug 08 04:44:25 dist-test-slave-vxj2 krb5kdc[9800](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164265, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T04:44:25Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T04:44:25Z Disabled control of system clock
WARNING: no policy specified for kudu/127.20.240.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.240.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.240.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.254.keytab.
Entry for principal kudu/127.20.240.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.254.keytab.
I20260808 04:44:25.768816 21443 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
/tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786164000593138-21443-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786164000593138-21443-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786164000593138-21443-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786164000593138-21443-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.240.254:44513
--webserver_interface=127.20.240.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.254.keytab
--principal=kudu/127.20.240.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.240.212:38859
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.240.254:44513
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786164000593138-21443-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786164000593138-21443-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786164000593138-21443-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 04:44:25.882903 9813 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:44:25.883219 9813 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:44:25.883260 9813 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:44:25.887300 9813 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 04:44:25.887363 9813 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:44:25.887383 9813 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:44:25.887400 9813 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 04:44:25.887415 9813 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 04:44:25.892859 9813 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.240.212:38859
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786164000593138-21443-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786164000593138-21443-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.240.254:44513
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.254.keytab
--principal=kudu/127.20.240.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.240.254:44513
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786164000593138-21443-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.240.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9813
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786164000593138-21443-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 04:05:18 UTC on ccycloud.quasar-drfdgt.root.comops.site
build id 4574101
I20260808 04:44:25.894066 9813 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:44:25.895063 9813 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:44:25.904119 9818 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:44:25.904131 9819 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:44:25.904119 9821 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:44:25.904603 9813 server_base.cc:1034] running on GCE node
I20260808 04:44:25.905578 9813 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:44:25.906808 9813 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:44:25.908034 9813 hybrid_clock.cc:648] HybridClock initialized: now 1786164265908023 us; error 33 us; skew 500 ppm
Aug 08 04:44:25 dist-test-slave-vxj2 krb5kdc[9800](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164265, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.240.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:44:25.911208 9813 init.cc:377] Logged in from keytab as kudu/127.20.240.254@KRBTEST.COM (short username kudu)
I20260808 04:44:25.912220 9813 webserver.cc:460] Webserver started at http://127.20.240.254:35609/ using document root <none> and password file <none>
I20260808 04:44:25.912825 9813 fs_manager.cc:359] Metadata directory not provided
I20260808 04:44:25.912923 9813 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:44:25.913252 9813 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 04:44:25.915539 9813 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786164000593138-21443-0/minicluster-data/master-0/data/instance:
uuid: "21b7de9d22114a569213c6946f8e62e8"
format_stamp: "Formatted at 2026-08-08 04:44:25 on dist-test-slave-vxj2"
server_key: "27cec01565aff99fe605ed5690fd87c2"
server_key_iv: "46761d1b0ea584f29a6b51f330bcf572"
server_key_version: "encryptionkey@0"
I20260808 04:44:25.916141 9813 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786164000593138-21443-0/minicluster-data/master-0/wal/instance:
uuid: "21b7de9d22114a569213c6946f8e62e8"
format_stamp: "Formatted at 2026-08-08 04:44:25 on dist-test-slave-vxj2"
server_key: "27cec01565aff99fe605ed5690fd87c2"
server_key_iv: "46761d1b0ea584f29a6b51f330bcf572"
server_key_version: "encryptionkey@0"
I20260808 04:44:25.920043 9813 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.004s
I20260808 04:44:25.922652 9829 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:44:25.923842 9813 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260808 04:44:25.924003 9813 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786164000593138-21443-0/minicluster-data/master-0/data,/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786164000593138-21443-0/minicluster-data/master-0/wal
uuid: "21b7de9d22114a569213c6946f8e62e8"
format_stamp: "Formatted at 2026-08-08 04:44:25 on dist-test-slave-vxj2"
server_key: "27cec01565aff99fe605ed5690fd87c2"
server_key_iv: "46761d1b0ea584f29a6b51f330bcf572"
server_key_version: "encryptionkey@0"
I20260808 04:44:25.924131 9813 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786164000593138-21443-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786164000593138-21443-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786164000593138-21443-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:44:25.934419 9813 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:44:25.937422 9813 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:44:25.937641 9813 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:44:25.945123 9813 rpc_server.cc:307] RPC server started. Bound to: 127.20.240.254:44513
I20260808 04:44:25.945186 9884 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.240.254:44513 every 8 connection(s)
I20260808 04:44:25.946225 9813 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786164000593138-21443-0/minicluster-data/master-0/data/info.pb
I20260808 04:44:25.949416 9885 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:44:25.955744 9885 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 21b7de9d22114a569213c6946f8e62e8: Bootstrap starting.
I20260808 04:44:25.956220 21443 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu as pid 9813
I20260808 04:44:25.956372 21443 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786164000593138-21443-0/minicluster-data/master-0/wal/instance
I20260808 04:44:25.956669 21443 external_mini_cluster.cc:1428] Setting key 0de4ea3f4f85d3b5cc2fc77cbad7ade8
I20260808 04:44:25.958938 9885 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 21b7de9d22114a569213c6946f8e62e8: Neither blocks nor log segments found. Creating new log.
I20260808 04:44:25.959935 9885 log.cc:824] T 00000000000000000000000000000000 P 21b7de9d22114a569213c6946f8e62e8: Log is configured to *not* fsync() on all Append() calls
I20260808 04:44:25.962193 9885 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 21b7de9d22114a569213c6946f8e62e8: No bootstrap required, opened a new log
I20260808 04:44:25.965955 9885 raft_consensus.cc:348] T 00000000000000000000000000000000 P 21b7de9d22114a569213c6946f8e62e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "21b7de9d22114a569213c6946f8e62e8" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 44513 } }
I20260808 04:44:25.966387 9885 raft_consensus.cc:374] T 00000000000000000000000000000000 P 21b7de9d22114a569213c6946f8e62e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:44:25.966497 9885 raft_consensus.cc:729] T 00000000000000000000000000000000 P 21b7de9d22114a569213c6946f8e62e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21b7de9d22114a569213c6946f8e62e8, State: Initialized, Role: FOLLOWER
Aug 08 04:44:25 dist-test-slave-vxj2 krb5kdc[9800](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164265, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.240.254@KRBTEST.COM
I20260808 04:44:25.967162 9885 consensus_queue.cc:260] T 00000000000000000000000000000000 P 21b7de9d22114a569213c6946f8e62e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "21b7de9d22114a569213c6946f8e62e8" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 44513 } }
I20260808 04:44:25.967346 9885 raft_consensus.cc:388] T 00000000000000000000000000000000 P 21b7de9d22114a569213c6946f8e62e8 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 04:44:25.967458 9885 raft_consensus.cc:482] T 00000000000000000000000000000000 P 21b7de9d22114a569213c6946f8e62e8 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 04:44:25.967567 9885 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 21b7de9d22114a569213c6946f8e62e8 [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:44:25.968663 9885 raft_consensus.cc:504] T 00000000000000000000000000000000 P 21b7de9d22114a569213c6946f8e62e8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "21b7de9d22114a569213c6946f8e62e8" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 44513 } }
I20260808 04:44:25.969063 9885 leader_election.cc:302] T 00000000000000000000000000000000 P 21b7de9d22114a569213c6946f8e62e8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 21b7de9d22114a569213c6946f8e62e8; no voters:
I20260808 04:44:25.969477 9885 leader_election.cc:288] T 00000000000000000000000000000000 P 21b7de9d22114a569213c6946f8e62e8 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 04:44:25.969640 9890 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 21b7de9d22114a569213c6946f8e62e8 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 04:44:25.969935 9890 raft_consensus.cc:686] T 00000000000000000000000000000000 P 21b7de9d22114a569213c6946f8e62e8 [term 1 LEADER]: Becoming Leader. State: Replica: 21b7de9d22114a569213c6946f8e62e8, State: Running, Role: LEADER
I20260808 04:44:25.970381 9890 consensus_queue.cc:237] T 00000000000000000000000000000000 P 21b7de9d22114a569213c6946f8e62e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "21b7de9d22114a569213c6946f8e62e8" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 44513 } }
I20260808 04:44:25.970923 9885 sys_catalog.cc:564] T 00000000000000000000000000000000 P 21b7de9d22114a569213c6946f8e62e8 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 04:44:25.972838 9894 sys_catalog.cc:455] T 00000000000000000000000000000000 P 21b7de9d22114a569213c6946f8e62e8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "21b7de9d22114a569213c6946f8e62e8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "21b7de9d22114a569213c6946f8e62e8" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 44513 } } }
I20260808 04:44:25.973007 9894 sys_catalog.cc:458] T 00000000000000000000000000000000 P 21b7de9d22114a569213c6946f8e62e8 [sys.catalog]: This master's current role is: LEADER
I20260808 04:44:25.973489 9893 sys_catalog.cc:455] T 00000000000000000000000000000000 P 21b7de9d22114a569213c6946f8e62e8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 21b7de9d22114a569213c6946f8e62e8. Latest consensus state: current_term: 1 leader_uuid: "21b7de9d22114a569213c6946f8e62e8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "21b7de9d22114a569213c6946f8e62e8" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 44513 } } }
I20260808 04:44:25.973994 9893 sys_catalog.cc:458] T 00000000000000000000000000000000 P 21b7de9d22114a569213c6946f8e62e8 [sys.catalog]: This master's current role is: LEADER
I20260808 04:44:25.974920 9888 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:25.958203 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51162 (local address 127.20.240.254:44513)
0808 04:44:25.958693 (+ 490us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:25.958716 (+ 23us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:25.958766 (+ 50us) server_negotiation.cc:407] Connection header received
0808 04:44:25.959750 (+ 984us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:25.959777 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:25.960243 (+ 466us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:25.960683 (+ 440us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:44:25.961680 (+ 997us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:25.962910 (+ 1230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:25.963971 (+ 1061us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:25.964531 (+ 560us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:25.964726 (+ 195us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:25.968077 (+ 3351us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:44:25.968083 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:44:25.968097 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:44:25.968130 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:44:25.970461 (+ 2331us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:44:25.971071 (+ 610us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:44:25.971077 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:44:25.971084 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:44:25.971241 (+ 157us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:44:25.971621 (+ 380us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:44:25.971624 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:44:25.971626 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:44:25.972199 (+ 573us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:44:25.972433 (+ 234us) server_negotiation.cc:1035] Waiting for connection context
0808 04:44:25.973430 (+ 997us) server_negotiation.cc:299] Negotiation successful
0808 04:44:25.973782 (+ 352us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":325,"thread_start_us":131,"threads_started":1}
W20260808 04:44:25.976482 9909 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 21b7de9d22114a569213c6946f8e62e8: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 04:44:25.976585 9909 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 04:44:25.976680 9907 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 04:44:25.977641 9907 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 04:44:25.983294 9907 catalog_manager.cc:1347] Generated new cluster ID: 31521f3cd6414f18a52a10b7c9a786a7
I20260808 04:44:25.983378 9907 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 04:44:26.016121 9907 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 04:44:26.017573 9907 catalog_manager.cc:1504] Loading token signing keys...
I20260808 04:44:26.023396 9907 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 21b7de9d22114a569213c6946f8e62e8: Generated new TSK 0
I20260808 04:44:26.024202 9907 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.20.240.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.240.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.240.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.193.keytab.
Entry for principal kudu/127.20.240.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.193.keytab.
I20260808 04:44:26.061931 21443 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
/tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786164000593138-21443-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786164000593138-21443-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786164000593138-21443-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786164000593138-21443-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.240.193:0
--local_ip_for_outbound_sockets=127.20.240.193
--webserver_interface=127.20.240.193
--webserver_port=0
--tserver_master_addrs=127.20.240.254:44513
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.193.keytab
--principal=kudu/127.20.240.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.240.212:38859
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786164000593138-21443-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786164000593138-21443-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786164000593138-21443-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 04:44:26.179334 9916 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:44:26.179608 9916 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:44:26.179654 9916 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:44:26.183750 9916 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:44:26.183817 9916 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:44:26.183979 9916 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.240.193
I20260808 04:44:26.189611 9916 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.240.212:38859
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786164000593138-21443-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786164000593138-21443-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.193.keytab
--principal=kudu/127.20.240.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.240.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786164000593138-21443-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.240.193
--webserver_port=0
--tserver_master_addrs=127.20.240.254:44513
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9916
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.240.193
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786164000593138-21443-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 04:05:18 UTC on ccycloud.quasar-drfdgt.root.comops.site
build id 4574101
I20260808 04:44:26.190692 9916 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:44:26.191727 9916 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:44:26.201761 9924 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:44:26.201817 9921 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:44:26.201761 9922 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:44:26.202036 9916 server_base.cc:1034] running on GCE node
I20260808 04:44:26.202579 9916 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:44:26.203243 9916 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:44:26.204445 9916 hybrid_clock.cc:648] HybridClock initialized: now 1786164266204434 us; error 43 us; skew 500 ppm
Aug 08 04:44:26 dist-test-slave-vxj2 krb5kdc[9800](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164266, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.240.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:44:26.207381 9916 init.cc:377] Logged in from keytab as kudu/127.20.240.193@KRBTEST.COM (short username kudu)
I20260808 04:44:26.208375 9916 webserver.cc:460] Webserver started at http://127.20.240.193:39585/ using document root <none> and password file <none>
I20260808 04:44:26.208976 9916 fs_manager.cc:359] Metadata directory not provided
I20260808 04:44:26.209072 9916 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:44:26.209359 9916 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 04:44:26.211653 9916 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786164000593138-21443-0/minicluster-data/ts-0/data/instance:
uuid: "2ce239838b36428cac6697cb0a3aec83"
format_stamp: "Formatted at 2026-08-08 04:44:26 on dist-test-slave-vxj2"
server_key: "68479e0c7ff2f2fd5911111d3a1b8525"
server_key_iv: "96769dad68523dbcbaadf31cf37169ef"
server_key_version: "encryptionkey@0"
I20260808 04:44:26.212265 9916 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786164000593138-21443-0/minicluster-data/ts-0/wal/instance:
uuid: "2ce239838b36428cac6697cb0a3aec83"
format_stamp: "Formatted at 2026-08-08 04:44:26 on dist-test-slave-vxj2"
server_key: "68479e0c7ff2f2fd5911111d3a1b8525"
server_key_iv: "96769dad68523dbcbaadf31cf37169ef"
server_key_version: "encryptionkey@0"
I20260808 04:44:26.216337 9916 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.004s
I20260808 04:44:26.219115 9931 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:44:26.220522 9916 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260808 04:44:26.220679 9916 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786164000593138-21443-0/minicluster-data/ts-0/data,/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786164000593138-21443-0/minicluster-data/ts-0/wal
uuid: "2ce239838b36428cac6697cb0a3aec83"
format_stamp: "Formatted at 2026-08-08 04:44:26 on dist-test-slave-vxj2"
server_key: "68479e0c7ff2f2fd5911111d3a1b8525"
server_key_iv: "96769dad68523dbcbaadf31cf37169ef"
server_key_version: "encryptionkey@0"
I20260808 04:44:26.220815 9916 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786164000593138-21443-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786164000593138-21443-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786164000593138-21443-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:44:26.239140 9916 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:44:26.242751 9916 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:44:26.243027 9916 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:44:26.243719 9916 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 04:44:26.244647 9916 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 04:44:26.244725 9916 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 04:44:26.244805 9916 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 04:44:26.244849 9916 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 04:44:26.254377 9916 rpc_server.cc:307] RPC server started. Bound to: 127.20.240.193:45215
I20260808 04:44:26.254401 10052 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.240.193:45215 every 8 connection(s)
I20260808 04:44:26.255322 9916 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786164000593138-21443-0/minicluster-data/ts-0/data/info.pb
I20260808 04:44:26.259742 21443 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu as pid 9916
I20260808 04:44:26.259896 21443 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786164000593138-21443-0/minicluster-data/ts-0/wal/instance
I20260808 04:44:26.260250 21443 external_mini_cluster.cc:1428] Setting key 426db42655d8d8d7733b3b371031af0f
Aug 08 04:44:26 dist-test-slave-vxj2 krb5kdc[9800](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164266, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.240.193@KRBTEST.COM for kudu/127.20.240.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.20.240.194@KRBTEST.COM; defaulting to no policy
I20260808 04:44:26.272171 9888 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:26.257457 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.240.193:56491 (local address 127.20.240.254:44513)
0808 04:44:26.257630 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:26.257634 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:26.258510 (+ 876us) server_negotiation.cc:407] Connection header received
0808 04:44:26.260145 (+ 1635us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:26.260148 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:26.260205 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:26.260285 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:44:26.261616 (+ 1331us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:26.262368 (+ 752us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:26.263732 (+ 1364us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:26.264048 (+ 316us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:26.264136 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:26.267551 (+ 3415us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:44:26.267557 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:44:26.267564 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:44:26.267605 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:44:26.269465 (+ 1860us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:44:26.270097 (+ 632us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:44:26.270103 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:44:26.270107 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:44:26.270210 (+ 103us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:44:26.270722 (+ 512us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:44:26.270726 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:44:26.270728 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:44:26.270993 (+ 265us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:44:26.271107 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0808 04:44:26.271909 (+ 802us) server_negotiation.cc:299] Negotiation successful
0808 04:44:26.272040 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260808 04:44:26.273106 10055 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:26.257834 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:44513 (local address 127.20.240.193:56491)
0808 04:44:26.258344 (+ 510us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:26.258388 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0808 04:44:26.259888 (+ 1500us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:44:26.260505 (+ 617us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:44:26.260514 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:44:26.260921 (+ 407us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:44:26.261499 (+ 578us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:44:26.261514 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:44:26.262508 (+ 994us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:44:26.262511 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:44:26.263587 (+ 1076us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:44:26.263603 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:44:26.264227 (+ 624us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:44:26.264233 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:44:26.264486 (+ 253us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:26.265350 (+ 864us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:44:26.265368 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:44:26.267343 (+ 1975us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:44:26.269605 (+ 2262us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:44:26.269610 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:44:26.269625 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:44:26.269955 (+ 330us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:44:26.270323 (+ 368us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:44:26.270326 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:44:26.270327 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:44:26.270588 (+ 261us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:44:26.271133 (+ 545us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:44:26.271179 (+ 46us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:44:26.271493 (+ 314us) client_negotiation.cc:769] Sending connection context
0808 04:44:26.271769 (+ 276us) client_negotiation.cc:240] Negotiation successful
0808 04:44:26.272121 (+ 352us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":303,"thread_start_us":141,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.240.194@KRBTEST.COM" created.
I20260808 04:44:26.274748 10053 heartbeater.cc:347] Connected to a master server at 127.20.240.254:44513
I20260808 04:44:26.275039 10053 heartbeater.cc:464] Registering TS with master...
I20260808 04:44:26.275588 10053 heartbeater.cc:511] Master 127.20.240.254:44513 requested a full tablet report, sending...
I20260808 04:44:26.277426 9847 ts_manager.cc:194] Registered new tserver with Master: 2ce239838b36428cac6697cb0a3aec83 (127.20.240.193:45215)
I20260808 04:44:26.278658 9847 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.240.193@KRBTEST.COM'} at 127.20.240.193:56491
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.240.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.194.keytab.
Entry for principal kudu/127.20.240.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.194.keytab.
I20260808 04:44:26.293936 21443 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
/tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786164000593138-21443-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786164000593138-21443-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786164000593138-21443-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786164000593138-21443-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.240.194:0
--local_ip_for_outbound_sockets=127.20.240.194
--webserver_interface=127.20.240.194
--webserver_port=0
--tserver_master_addrs=127.20.240.254:44513
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.194.keytab
--principal=kudu/127.20.240.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.240.212:38859
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786164000593138-21443-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786164000593138-21443-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786164000593138-21443-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 04:44:26.414737 10058 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:44:26.415040 10058 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:44:26.415086 10058 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:44:26.419348 10058 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:44:26.419423 10058 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:44:26.419528 10058 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.240.194
I20260808 04:44:26.425410 10058 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.240.212:38859
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786164000593138-21443-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786164000593138-21443-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.194.keytab
--principal=kudu/127.20.240.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.240.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786164000593138-21443-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.240.194
--webserver_port=0
--tserver_master_addrs=127.20.240.254:44513
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10058
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.240.194
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786164000593138-21443-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 04:05:18 UTC on ccycloud.quasar-drfdgt.root.comops.site
build id 4574101
I20260808 04:44:26.426666 10058 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:44:26.427791 10058 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:44:26.437841 10063 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:44:26.437834 10068 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:44:26.438000 10058 server_base.cc:1034] running on GCE node
W20260808 04:44:26.437834 10064 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:44:26.438548 10058 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:44:26.439248 10058 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:44:26.440457 10058 hybrid_clock.cc:648] HybridClock initialized: now 1786164266440429 us; error 38 us; skew 500 ppm
Aug 08 04:44:26 dist-test-slave-vxj2 krb5kdc[9800](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164266, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.240.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:44:26.443480 10058 init.cc:377] Logged in from keytab as kudu/127.20.240.194@KRBTEST.COM (short username kudu)
I20260808 04:44:26.444412 10058 webserver.cc:460] Webserver started at http://127.20.240.194:33409/ using document root <none> and password file <none>
I20260808 04:44:26.444991 10058 fs_manager.cc:359] Metadata directory not provided
I20260808 04:44:26.445086 10058 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:44:26.445360 10058 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 04:44:26.447489 10058 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786164000593138-21443-0/minicluster-data/ts-1/data/instance:
uuid: "7d92e85d3e924393b59d6c248eae35bb"
format_stamp: "Formatted at 2026-08-08 04:44:26 on dist-test-slave-vxj2"
server_key: "f34abbae4bf7a2063c493ff0f6780d1a"
server_key_iv: "a2657ddd21fb908d3bb1ca670d06d8b5"
server_key_version: "encryptionkey@0"
I20260808 04:44:26.448076 10058 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786164000593138-21443-0/minicluster-data/ts-1/wal/instance:
uuid: "7d92e85d3e924393b59d6c248eae35bb"
format_stamp: "Formatted at 2026-08-08 04:44:26 on dist-test-slave-vxj2"
server_key: "f34abbae4bf7a2063c493ff0f6780d1a"
server_key_iv: "a2657ddd21fb908d3bb1ca670d06d8b5"
server_key_version: "encryptionkey@0"
I20260808 04:44:26.451959 10058 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260808 04:44:26.454545 10076 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:44:26.455812 10058 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260808 04:44:26.455962 10058 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786164000593138-21443-0/minicluster-data/ts-1/data,/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786164000593138-21443-0/minicluster-data/ts-1/wal
uuid: "7d92e85d3e924393b59d6c248eae35bb"
format_stamp: "Formatted at 2026-08-08 04:44:26 on dist-test-slave-vxj2"
server_key: "f34abbae4bf7a2063c493ff0f6780d1a"
server_key_iv: "a2657ddd21fb908d3bb1ca670d06d8b5"
server_key_version: "encryptionkey@0"
I20260808 04:44:26.456081 10058 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786164000593138-21443-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786164000593138-21443-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786164000593138-21443-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:44:26.473392 10058 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:44:26.476692 10058 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:44:26.476922 10058 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:44:26.477655 10058 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 04:44:26.478549 10058 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 04:44:26.478621 10058 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 04:44:26.478689 10058 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 04:44:26.478739 10058 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 04:44:26.487948 10058 rpc_server.cc:307] RPC server started. Bound to: 127.20.240.194:34407
I20260808 04:44:26.487968 10200 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.240.194:34407 every 8 connection(s)
I20260808 04:44:26.488921 10058 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786164000593138-21443-0/minicluster-data/ts-1/data/info.pb
I20260808 04:44:26.491523 21443 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu as pid 10058
I20260808 04:44:26.491684 21443 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786164000593138-21443-0/minicluster-data/ts-1/wal/instance
I20260808 04:44:26.492157 21443 external_mini_cluster.cc:1428] Setting key d960918461dd882c166315dadc522730
Aug 08 04:44:26 dist-test-slave-vxj2 krb5kdc[9800](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164266, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.240.194@KRBTEST.COM for kudu/127.20.240.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.20.240.195@KRBTEST.COM; defaulting to no policy
I20260808 04:44:26.505502 9888 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:26.490924 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.240.194:45821 (local address 127.20.240.254:44513)
0808 04:44:26.491115 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:26.491119 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:26.492011 (+ 892us) server_negotiation.cc:407] Connection header received
0808 04:44:26.493961 (+ 1950us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:26.493964 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:26.494011 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:26.494108 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:44:26.495919 (+ 1811us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:26.496460 (+ 541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:26.497830 (+ 1370us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:26.498234 (+ 404us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:26.498358 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:26.501572 (+ 3214us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:44:26.501575 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:44:26.501577 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:44:26.501603 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:44:26.503073 (+ 1470us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:44:26.503749 (+ 676us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:44:26.503755 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:44:26.503762 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:44:26.503839 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:44:26.504228 (+ 389us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:44:26.504230 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:44:26.504231 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:44:26.504483 (+ 252us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:44:26.504593 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0808 04:44:26.505254 (+ 661us) server_negotiation.cc:299] Negotiation successful
0808 04:44:26.505373 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260808 04:44:26.506445 10203 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:26.491240 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:44513 (local address 127.20.240.194:45821)
0808 04:44:26.491813 (+ 573us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:26.491880 (+ 67us) client_negotiation.cc:174] Beginning negotiation
0808 04:44:26.493663 (+ 1783us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:44:26.494332 (+ 669us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:44:26.494343 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:44:26.494945 (+ 602us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:44:26.495746 (+ 801us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:44:26.495770 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:44:26.496596 (+ 826us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:44:26.496599 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:44:26.497707 (+ 1108us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:44:26.497717 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:44:26.498401 (+ 684us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:44:26.498404 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:44:26.498573 (+ 169us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:26.499283 (+ 710us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:44:26.499309 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:44:26.501385 (+ 2076us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:44:26.503205 (+ 1820us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:44:26.503214 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:44:26.503232 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:44:26.503619 (+ 387us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:44:26.503977 (+ 358us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:44:26.503982 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:44:26.503983 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:44:26.504137 (+ 154us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:44:26.504626 (+ 489us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:44:26.504632 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:44:26.504957 (+ 325us) client_negotiation.cc:769] Sending connection context
0808 04:44:26.505119 (+ 162us) client_negotiation.cc:240] Negotiation successful
0808 04:44:26.505498 (+ 379us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":314,"thread_start_us":130,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.240.195@KRBTEST.COM" created.
I20260808 04:44:26.507675 10201 heartbeater.cc:347] Connected to a master server at 127.20.240.254:44513
I20260808 04:44:26.507931 10201 heartbeater.cc:464] Registering TS with master...
I20260808 04:44:26.508459 10201 heartbeater.cc:511] Master 127.20.240.254:44513 requested a full tablet report, sending...
I20260808 04:44:26.509734 9847 ts_manager.cc:194] Registered new tserver with Master: 7d92e85d3e924393b59d6c248eae35bb (127.20.240.194:34407)
I20260808 04:44:26.510612 9847 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.240.194@KRBTEST.COM'} at 127.20.240.194:45821
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.240.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.195.keytab.
Entry for principal kudu/127.20.240.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.195.keytab.
I20260808 04:44:26.524559 21443 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
/tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786164000593138-21443-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786164000593138-21443-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786164000593138-21443-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786164000593138-21443-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.240.195:0
--local_ip_for_outbound_sockets=127.20.240.195
--webserver_interface=127.20.240.195
--webserver_port=0
--tserver_master_addrs=127.20.240.254:44513
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.195.keytab
--principal=kudu/127.20.240.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.240.212:38859
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786164000593138-21443-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786164000593138-21443-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786164000593138-21443-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 04:44:26.644261 10206 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:44:26.644551 10206 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:44:26.644599 10206 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:44:26.648840 10206 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:44:26.648918 10206 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:44:26.648980 10206 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.240.195
I20260808 04:44:26.654636 10206 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.240.212:38859
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786164000593138-21443-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786164000593138-21443-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.195.keytab
--principal=kudu/127.20.240.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.240.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786164000593138-21443-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.240.195
--webserver_port=0
--tserver_master_addrs=127.20.240.254:44513
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10206
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.240.195
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786164000593138-21443-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 04:05:18 UTC on ccycloud.quasar-drfdgt.root.comops.site
build id 4574101
I20260808 04:44:26.655733 10206 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:44:26.656752 10206 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:44:26.667879 10213 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:44:26.667881 10215 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:44:26.667896 10212 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:44:26.668345 10206 server_base.cc:1034] running on GCE node
I20260808 04:44:26.668864 10206 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:44:26.669713 10206 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:44:26.671020 10206 hybrid_clock.cc:648] HybridClock initialized: now 1786164266671000 us; error 34 us; skew 500 ppm
Aug 08 04:44:26 dist-test-slave-vxj2 krb5kdc[9800](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164266, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.240.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:44:26.674322 10206 init.cc:377] Logged in from keytab as kudu/127.20.240.195@KRBTEST.COM (short username kudu)
I20260808 04:44:26.675405 10206 webserver.cc:460] Webserver started at http://127.20.240.195:40941/ using document root <none> and password file <none>
I20260808 04:44:26.676100 10206 fs_manager.cc:359] Metadata directory not provided
I20260808 04:44:26.676206 10206 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:44:26.676458 10206 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 04:44:26.678694 10206 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786164000593138-21443-0/minicluster-data/ts-2/data/instance:
uuid: "c59bfc412fae4c048efc0ec4ae51bd8c"
format_stamp: "Formatted at 2026-08-08 04:44:26 on dist-test-slave-vxj2"
server_key: "e25b92035825170247fd58183e040e5f"
server_key_iv: "c2d251ed287b8b7f7b8350b4bcc52000"
server_key_version: "encryptionkey@0"
I20260808 04:44:26.679308 10206 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786164000593138-21443-0/minicluster-data/ts-2/wal/instance:
uuid: "c59bfc412fae4c048efc0ec4ae51bd8c"
format_stamp: "Formatted at 2026-08-08 04:44:26 on dist-test-slave-vxj2"
server_key: "e25b92035825170247fd58183e040e5f"
server_key_iv: "c2d251ed287b8b7f7b8350b4bcc52000"
server_key_version: "encryptionkey@0"
I20260808 04:44:26.684321 10206 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260808 04:44:26.686935 10222 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:44:26.688206 10206 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 04:44:26.688356 10206 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786164000593138-21443-0/minicluster-data/ts-2/data,/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786164000593138-21443-0/minicluster-data/ts-2/wal
uuid: "c59bfc412fae4c048efc0ec4ae51bd8c"
format_stamp: "Formatted at 2026-08-08 04:44:26 on dist-test-slave-vxj2"
server_key: "e25b92035825170247fd58183e040e5f"
server_key_iv: "c2d251ed287b8b7f7b8350b4bcc52000"
server_key_version: "encryptionkey@0"
I20260808 04:44:26.688483 10206 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786164000593138-21443-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786164000593138-21443-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786164000593138-21443-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:44:26.702836 10206 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:44:26.706605 10206 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:44:26.706873 10206 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:44:26.707566 10206 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 04:44:26.708531 10206 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 04:44:26.708616 10206 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 04:44:26.708694 10206 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 04:44:26.708760 10206 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 04:44:26.719513 10206 rpc_server.cc:307] RPC server started. Bound to: 127.20.240.195:40783
I20260808 04:44:26.719545 10345 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.240.195:40783 every 8 connection(s)
I20260808 04:44:26.720674 10206 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786164000593138-21443-0/minicluster-data/ts-2/data/info.pb
I20260808 04:44:26.722118 21443 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu as pid 10206
I20260808 04:44:26.722254 21443 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786164000593138-21443-0/minicluster-data/ts-2/wal/instance
I20260808 04:44:26.722621 21443 external_mini_cluster.cc:1428] Setting key c871b829720f3d286dd77232142e2475
Aug 08 04:44:26 dist-test-slave-vxj2 krb5kdc[9800](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164266, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.240.195@KRBTEST.COM for kudu/127.20.240.254@KRBTEST.COM
I20260808 04:44:26.737771 9888 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:26.723833 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.240.195:54427 (local address 127.20.240.254:44513)
0808 04:44:26.724086 (+ 253us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:26.724093 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:26.725088 (+ 995us) server_negotiation.cc:407] Connection header received
0808 04:44:26.726806 (+ 1718us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:26.726810 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:26.726879 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:26.726974 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:44:26.728345 (+ 1371us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:26.728947 (+ 602us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:26.730272 (+ 1325us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:26.730560 (+ 288us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:26.730693 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:26.733567 (+ 2874us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:44:26.733570 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:44:26.733573 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:44:26.733600 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:44:26.735030 (+ 1430us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:44:26.735665 (+ 635us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:44:26.735674 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:44:26.735675 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:44:26.735844 (+ 169us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:44:26.736344 (+ 500us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:44:26.736347 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:44:26.736350 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:44:26.736625 (+ 275us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:44:26.736755 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0808 04:44:26.737489 (+ 734us) server_negotiation.cc:299] Negotiation successful
0808 04:44:26.737635 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
I20260808 04:44:26.738673 10348 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:26.724310 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:44513 (local address 127.20.240.195:54427)
0808 04:44:26.724918 (+ 608us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:26.724986 (+ 68us) client_negotiation.cc:174] Beginning negotiation
0808 04:44:26.726576 (+ 1590us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:44:26.727210 (+ 634us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:44:26.727227 (+ 17us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:44:26.727645 (+ 418us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:44:26.728170 (+ 525us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:44:26.728184 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:44:26.729088 (+ 904us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:44:26.729092 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:44:26.730128 (+ 1036us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:44:26.730138 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:44:26.730740 (+ 602us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:44:26.730744 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:44:26.730984 (+ 240us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:26.731673 (+ 689us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:44:26.731691 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:44:26.733384 (+ 1693us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:44:26.735173 (+ 1789us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:44:26.735179 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:44:26.735192 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:44:26.735514 (+ 322us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:44:26.735982 (+ 468us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:44:26.735988 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:44:26.735990 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:44:26.736191 (+ 201us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:44:26.736763 (+ 572us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:44:26.736769 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:44:26.737112 (+ 343us) client_negotiation.cc:769] Sending connection context
0808 04:44:26.737395 (+ 283us) client_negotiation.cc:240] Negotiation successful
0808 04:44:26.737770 (+ 375us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":355,"thread_start_us":153,"threads_started":1}
I20260808 04:44:26.739954 10346 heartbeater.cc:347] Connected to a master server at 127.20.240.254:44513
I20260808 04:44:26.740216 10346 heartbeater.cc:464] Registering TS with master...
I20260808 04:44:26.740759 10346 heartbeater.cc:511] Master 127.20.240.254:44513 requested a full tablet report, sending...
I20260808 04:44:26.741825 9847 ts_manager.cc:194] Registered new tserver with Master: c59bfc412fae4c048efc0ec4ae51bd8c (127.20.240.195:40783)
I20260808 04:44:26.742460 9847 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.240.195@KRBTEST.COM'} at 127.20.240.195:54427
I20260808 04:44:26.749693 21443 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 04:44:26.759989 9888 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:26.752006 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51178 (local address 127.20.240.254:44513)
0808 04:44:26.752229 (+ 223us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:26.752235 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:26.752380 (+ 145us) server_negotiation.cc:407] Connection header received
0808 04:44:26.752564 (+ 184us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:26.752566 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:26.752611 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:26.752698 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:44:26.753533 (+ 835us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:26.754063 (+ 530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:26.754978 (+ 915us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:26.755194 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:26.755309 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:26.756755 (+ 1446us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:44:26.756759 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:44:26.756762 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:44:26.756796 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:44:26.758157 (+ 1361us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:44:26.758608 (+ 451us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:44:26.758611 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:44:26.758613 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:44:26.758699 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:44:26.759008 (+ 309us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:44:26.759013 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:44:26.759014 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:44:26.759256 (+ 242us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:44:26.759412 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0808 04:44:26.759665 (+ 253us) server_negotiation.cc:299] Negotiation successful
0808 04:44:26.759789 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":118}
I20260808 04:44:26.763414 9847 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51178:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 04:44:26.767053 9847 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 04:44:26.784129 10358 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:26.777878 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.193:45215 (local address 127.0.0.1:49222)
0808 04:44:26.778625 (+ 747us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:26.778640 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 04:44:26.778720 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:44:26.779298 (+ 578us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:44:26.779301 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:44:26.779315 (+ 14us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 04:44:26.779648 (+ 333us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:44:26.779654 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:44:26.780851 (+ 1197us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:44:26.780855 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:44:26.782250 (+ 1395us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:44:26.782262 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:44:26.783484 (+ 1222us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:44:26.783491 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:44:26.783632 (+ 141us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:26.783676 (+ 44us) client_negotiation.cc:769] Sending connection context
0808 04:44:26.783798 (+ 122us) client_negotiation.cc:240] Negotiation successful
0808 04:44:26.783938 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":670,"mutex_wait_us":227,"thread_start_us":110,"threads_started":1}
I20260808 04:44:26.784358 10360 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:26.777297 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36476 (local address 127.20.240.195:40783)
0808 04:44:26.777726 (+ 429us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:26.777743 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:26.778272 (+ 529us) server_negotiation.cc:407] Connection header received
0808 04:44:26.778671 (+ 399us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:26.778681 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:26.778916 (+ 235us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:26.779025 (+ 109us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 04:44:26.779616 (+ 591us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:26.780946 (+ 1330us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:26.782726 (+ 1780us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:26.783658 (+ 932us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:26.783838 (+ 180us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:26.783970 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0808 04:44:26.784090 (+ 120us) server_negotiation.cc:299] Negotiation successful
0808 04:44:26.784193 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":311,"thread_start_us":127,"threads_started":1}
I20260808 04:44:26.784507 10363 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:26.777989 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52724 (local address 127.20.240.194:34407)
0808 04:44:26.778466 (+ 477us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:26.778479 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:26.778847 (+ 368us) server_negotiation.cc:407] Connection header received
0808 04:44:26.778940 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:26.778948 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:26.779143 (+ 195us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:26.779309 (+ 166us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 04:44:26.779616 (+ 307us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:26.781195 (+ 1579us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:26.782778 (+ 1583us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:26.783430 (+ 652us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:26.783564 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:26.783706 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0808 04:44:26.784243 (+ 537us) server_negotiation.cc:299] Negotiation successful
0808 04:44:26.784368 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":377,"thread_start_us":150,"threads_started":1}
I20260808 04:44:26.784168 10362 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:26.777667 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.194:34407 (local address 127.0.0.1:52724)
0808 04:44:26.778575 (+ 908us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:26.778591 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 04:44:26.778696 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:44:26.779396 (+ 700us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:44:26.779398 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:44:26.779411 (+ 13us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 04:44:26.779471 (+ 60us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:44:26.779480 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:44:26.781359 (+ 1879us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:44:26.781362 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:44:26.782624 (+ 1262us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:44:26.782636 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:44:26.783778 (+ 1142us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:44:26.783785 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:44:26.783893 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:26.783918 (+ 25us) client_negotiation.cc:769] Sending connection context
0808 04:44:26.783990 (+ 72us) client_negotiation.cc:240] Negotiation successful
0808 04:44:26.784051 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":830,"mutex_wait_us":3,"thread_start_us":126,"threads_started":1}
I20260808 04:44:26.784922 10364 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:26.778159 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49222 (local address 127.20.240.193:45215)
0808 04:44:26.778893 (+ 734us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:26.778900 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:26.778920 (+ 20us) server_negotiation.cc:407] Connection header received
0808 04:44:26.778986 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:26.778991 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:26.779149 (+ 158us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:26.779309 (+ 160us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 04:44:26.779800 (+ 491us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:26.780611 (+ 811us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:26.782400 (+ 1789us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:26.783324 (+ 924us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:26.783477 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:26.783637 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0808 04:44:26.784615 (+ 978us) server_negotiation.cc:299] Negotiation successful
0808 04:44:26.784737 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":620,"thread_start_us":128,"threads_started":1}
I20260808 04:44:26.785346 10361 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:26.777096 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.195:40783 (local address 127.0.0.1:36476)
0808 04:44:26.778101 (+ 1005us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:26.778166 (+ 65us) client_negotiation.cc:174] Beginning negotiation
0808 04:44:26.778448 (+ 282us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:44:26.779203 (+ 755us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:44:26.779207 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:44:26.779228 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 04:44:26.779438 (+ 210us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:44:26.779447 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:44:26.781114 (+ 1667us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:44:26.781117 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:44:26.782578 (+ 1461us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:44:26.782591 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:44:26.783815 (+ 1224us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:44:26.783819 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:44:26.783933 (+ 114us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:26.783957 (+ 24us) client_negotiation.cc:769] Sending connection context
0808 04:44:26.784051 (+ 94us) client_negotiation.cc:240] Negotiation successful
0808 04:44:26.784136 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":806,"mutex_wait_us":13,"thread_start_us":125,"threads_started":1}
I20260808 04:44:26.788403 10128 tablet_service.cc:1467] Processing CreateTablet for tablet 84d59be1d52a4792ae939e549df59cae (DEFAULT_TABLE table=test-table [id=0e4b5a2e1b2843c4a32f5bbd93da382a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 04:44:26.788391 9981 tablet_service.cc:1467] Processing CreateTablet for tablet 84d59be1d52a4792ae939e549df59cae (DEFAULT_TABLE table=test-table [id=0e4b5a2e1b2843c4a32f5bbd93da382a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 04:44:26.788548 10272 tablet_service.cc:1467] Processing CreateTablet for tablet 84d59be1d52a4792ae939e549df59cae (DEFAULT_TABLE table=test-table [id=0e4b5a2e1b2843c4a32f5bbd93da382a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 04:44:26.789666 10272 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 84d59be1d52a4792ae939e549df59cae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:44:26.789669 9981 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 84d59be1d52a4792ae939e549df59cae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:44:26.789669 10128 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 84d59be1d52a4792ae939e549df59cae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:44:26.797266 10365 tablet_bootstrap.cc:492] T 84d59be1d52a4792ae939e549df59cae P c59bfc412fae4c048efc0ec4ae51bd8c: Bootstrap starting.
I20260808 04:44:26.798030 10366 tablet_bootstrap.cc:492] T 84d59be1d52a4792ae939e549df59cae P 2ce239838b36428cac6697cb0a3aec83: Bootstrap starting.
I20260808 04:44:26.800179 10366 tablet_bootstrap.cc:654] T 84d59be1d52a4792ae939e549df59cae P 2ce239838b36428cac6697cb0a3aec83: Neither blocks nor log segments found. Creating new log.
I20260808 04:44:26.800539 10365 tablet_bootstrap.cc:654] T 84d59be1d52a4792ae939e549df59cae P c59bfc412fae4c048efc0ec4ae51bd8c: Neither blocks nor log segments found. Creating new log.
I20260808 04:44:26.801064 10366 log.cc:824] T 84d59be1d52a4792ae939e549df59cae P 2ce239838b36428cac6697cb0a3aec83: Log is configured to *not* fsync() on all Append() calls
I20260808 04:44:26.801678 10367 tablet_bootstrap.cc:492] T 84d59be1d52a4792ae939e549df59cae P 7d92e85d3e924393b59d6c248eae35bb: Bootstrap starting.
I20260808 04:44:26.801928 10365 log.cc:824] T 84d59be1d52a4792ae939e549df59cae P c59bfc412fae4c048efc0ec4ae51bd8c: Log is configured to *not* fsync() on all Append() calls
I20260808 04:44:26.803682 10366 tablet_bootstrap.cc:492] T 84d59be1d52a4792ae939e549df59cae P 2ce239838b36428cac6697cb0a3aec83: No bootstrap required, opened a new log
I20260808 04:44:26.803946 10366 ts_tablet_manager.cc:1397] T 84d59be1d52a4792ae939e549df59cae P 2ce239838b36428cac6697cb0a3aec83: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260808 04:44:26.804008 10367 tablet_bootstrap.cc:654] T 84d59be1d52a4792ae939e549df59cae P 7d92e85d3e924393b59d6c248eae35bb: Neither blocks nor log segments found. Creating new log.
I20260808 04:44:26.804216 10365 tablet_bootstrap.cc:492] T 84d59be1d52a4792ae939e549df59cae P c59bfc412fae4c048efc0ec4ae51bd8c: No bootstrap required, opened a new log
I20260808 04:44:26.804431 10365 ts_tablet_manager.cc:1397] T 84d59be1d52a4792ae939e549df59cae P c59bfc412fae4c048efc0ec4ae51bd8c: Time spent bootstrapping tablet: real 0.007s user 0.005s sys 0.000s
I20260808 04:44:26.805421 10367 log.cc:824] T 84d59be1d52a4792ae939e549df59cae P 7d92e85d3e924393b59d6c248eae35bb: Log is configured to *not* fsync() on all Append() calls
I20260808 04:44:26.807530 10367 tablet_bootstrap.cc:492] T 84d59be1d52a4792ae939e549df59cae P 7d92e85d3e924393b59d6c248eae35bb: No bootstrap required, opened a new log
I20260808 04:44:26.807758 10367 ts_tablet_manager.cc:1397] T 84d59be1d52a4792ae939e549df59cae P 7d92e85d3e924393b59d6c248eae35bb: Time spent bootstrapping tablet: real 0.006s user 0.006s sys 0.000s
I20260808 04:44:26.808996 10365 raft_consensus.cc:348] T 84d59be1d52a4792ae939e549df59cae P c59bfc412fae4c048efc0ec4ae51bd8c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59bfc412fae4c048efc0ec4ae51bd8c" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 40783 } } peers { permanent_uuid: "2ce239838b36428cac6697cb0a3aec83" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 45215 } } peers { permanent_uuid: "7d92e85d3e924393b59d6c248eae35bb" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 34407 } }
I20260808 04:44:26.809185 10366 raft_consensus.cc:348] T 84d59be1d52a4792ae939e549df59cae P 2ce239838b36428cac6697cb0a3aec83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59bfc412fae4c048efc0ec4ae51bd8c" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 40783 } } peers { permanent_uuid: "2ce239838b36428cac6697cb0a3aec83" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 45215 } } peers { permanent_uuid: "7d92e85d3e924393b59d6c248eae35bb" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 34407 } }
I20260808 04:44:26.809520 10365 raft_consensus.cc:374] T 84d59be1d52a4792ae939e549df59cae P c59bfc412fae4c048efc0ec4ae51bd8c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:44:26.809612 10366 raft_consensus.cc:374] T 84d59be1d52a4792ae939e549df59cae P 2ce239838b36428cac6697cb0a3aec83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:44:26.809623 10365 raft_consensus.cc:729] T 84d59be1d52a4792ae939e549df59cae P c59bfc412fae4c048efc0ec4ae51bd8c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59bfc412fae4c048efc0ec4ae51bd8c, State: Initialized, Role: FOLLOWER
I20260808 04:44:26.809681 10366 raft_consensus.cc:729] T 84d59be1d52a4792ae939e549df59cae P 2ce239838b36428cac6697cb0a3aec83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ce239838b36428cac6697cb0a3aec83, State: Initialized, Role: FOLLOWER
I20260808 04:44:26.810158 10365 consensus_queue.cc:260] T 84d59be1d52a4792ae939e549df59cae P c59bfc412fae4c048efc0ec4ae51bd8c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59bfc412fae4c048efc0ec4ae51bd8c" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 40783 } } peers { permanent_uuid: "2ce239838b36428cac6697cb0a3aec83" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 45215 } } peers { permanent_uuid: "7d92e85d3e924393b59d6c248eae35bb" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 34407 } }
I20260808 04:44:26.810158 10366 consensus_queue.cc:260] T 84d59be1d52a4792ae939e549df59cae P 2ce239838b36428cac6697cb0a3aec83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59bfc412fae4c048efc0ec4ae51bd8c" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 40783 } } peers { permanent_uuid: "2ce239838b36428cac6697cb0a3aec83" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 45215 } } peers { permanent_uuid: "7d92e85d3e924393b59d6c248eae35bb" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 34407 } }
I20260808 04:44:26.811187 10346 heartbeater.cc:503] Master 127.20.240.254:44513 was elected leader, sending a full tablet report...
I20260808 04:44:26.811187 10053 heartbeater.cc:503] Master 127.20.240.254:44513 was elected leader, sending a full tablet report...
I20260808 04:44:26.811316 10365 ts_tablet_manager.cc:1428] T 84d59be1d52a4792ae939e549df59cae P c59bfc412fae4c048efc0ec4ae51bd8c: Time spent starting tablet: real 0.007s user 0.008s sys 0.000s
I20260808 04:44:26.811316 10366 ts_tablet_manager.cc:1428] T 84d59be1d52a4792ae939e549df59cae P 2ce239838b36428cac6697cb0a3aec83: Time spent starting tablet: real 0.007s user 0.008s sys 0.000s
I20260808 04:44:26.811966 10367 raft_consensus.cc:348] T 84d59be1d52a4792ae939e549df59cae P 7d92e85d3e924393b59d6c248eae35bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59bfc412fae4c048efc0ec4ae51bd8c" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 40783 } } peers { permanent_uuid: "2ce239838b36428cac6697cb0a3aec83" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 45215 } } peers { permanent_uuid: "7d92e85d3e924393b59d6c248eae35bb" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 34407 } }
I20260808 04:44:26.812227 10367 raft_consensus.cc:374] T 84d59be1d52a4792ae939e549df59cae P 7d92e85d3e924393b59d6c248eae35bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:44:26.812302 10367 raft_consensus.cc:729] T 84d59be1d52a4792ae939e549df59cae P 7d92e85d3e924393b59d6c248eae35bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d92e85d3e924393b59d6c248eae35bb, State: Initialized, Role: FOLLOWER
I20260808 04:44:26.812803 10367 consensus_queue.cc:260] T 84d59be1d52a4792ae939e549df59cae P 7d92e85d3e924393b59d6c248eae35bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59bfc412fae4c048efc0ec4ae51bd8c" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 40783 } } peers { permanent_uuid: "2ce239838b36428cac6697cb0a3aec83" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 45215 } } peers { permanent_uuid: "7d92e85d3e924393b59d6c248eae35bb" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 34407 } }
I20260808 04:44:26.813521 10201 heartbeater.cc:503] Master 127.20.240.254:44513 was elected leader, sending a full tablet report...
I20260808 04:44:26.813930 10367 ts_tablet_manager.cc:1428] T 84d59be1d52a4792ae939e549df59cae P 7d92e85d3e924393b59d6c248eae35bb: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20260808 04:44:26.923938 10373 raft_consensus.cc:482] T 84d59be1d52a4792ae939e549df59cae P 2ce239838b36428cac6697cb0a3aec83 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 04:44:26.924220 10373 raft_consensus.cc:504] T 84d59be1d52a4792ae939e549df59cae P 2ce239838b36428cac6697cb0a3aec83 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59bfc412fae4c048efc0ec4ae51bd8c" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 40783 } } peers { permanent_uuid: "2ce239838b36428cac6697cb0a3aec83" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 45215 } } peers { permanent_uuid: "7d92e85d3e924393b59d6c248eae35bb" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 34407 } }
I20260808 04:44:26.925539 10373 leader_election.cc:288] T 84d59be1d52a4792ae939e549df59cae P 2ce239838b36428cac6697cb0a3aec83 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59bfc412fae4c048efc0ec4ae51bd8c (127.20.240.195:40783), 7d92e85d3e924393b59d6c248eae35bb (127.20.240.194:34407)
I20260808 04:44:26.930305 10360 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:26.925926 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.240.193:51989 (local address 127.20.240.195:40783)
0808 04:44:26.926067 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:26.926073 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:26.926389 (+ 316us) server_negotiation.cc:407] Connection header received
0808 04:44:26.926512 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:26.926515 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:26.926579 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:26.926673 (+ 94us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 04:44:26.927088 (+ 415us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:26.927703 (+ 615us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:26.928923 (+ 1220us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:26.929635 (+ 712us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:26.929779 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:26.929845 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0808 04:44:26.930055 (+ 210us) server_negotiation.cc:299] Negotiation successful
0808 04:44:26.930161 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260808 04:44:26.930433 10375 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:26.925896 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.194:34407 (local address 127.20.240.193:35643)
0808 04:44:26.926369 (+ 473us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:26.926388 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0808 04:44:26.926529 (+ 141us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:44:26.926837 (+ 308us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:44:26.926840 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:44:26.926862 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 04:44:26.927026 (+ 164us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:44:26.927037 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:44:26.927887 (+ 850us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:44:26.927890 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:44:26.928936 (+ 1046us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:44:26.928948 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:44:26.929983 (+ 1035us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:44:26.929987 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:44:26.930083 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:26.930103 (+ 20us) client_negotiation.cc:769] Sending connection context
0808 04:44:26.930174 (+ 71us) client_negotiation.cc:240] Negotiation successful
0808 04:44:26.930247 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":375,"mutex_wait_us":25,"thread_start_us":120,"threads_started":1}
I20260808 04:44:26.930452 10363 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:26.926123 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.240.193:35643 (local address 127.20.240.194:34407)
0808 04:44:26.926279 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:26.926285 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:26.926501 (+ 216us) server_negotiation.cc:407] Connection header received
0808 04:44:26.926653 (+ 152us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:26.926657 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:26.926711 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:26.926795 (+ 84us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 04:44:26.927139 (+ 344us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:26.927721 (+ 582us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:26.929128 (+ 1407us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:26.929744 (+ 616us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:26.929875 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:26.929924 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0808 04:44:26.930219 (+ 295us) server_negotiation.cc:299] Negotiation successful
0808 04:44:26.930309 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260808 04:44:26.930759 10376 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:26.925773 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.195:40783 (local address 127.20.240.193:51989)
0808 04:44:26.926257 (+ 484us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:26.926272 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 04:44:26.926402 (+ 130us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:44:26.926684 (+ 282us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:44:26.926687 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:44:26.926704 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 04:44:26.926958 (+ 254us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:44:26.926966 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:44:26.927796 (+ 830us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:44:26.927801 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:44:26.928769 (+ 968us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:44:26.928779 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:44:26.929786 (+ 1007us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:44:26.929793 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:44:26.929898 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:26.929923 (+ 25us) client_negotiation.cc:769] Sending connection context
0808 04:44:26.930550 (+ 627us) client_negotiation.cc:240] Negotiation successful
0808 04:44:26.930641 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":404,"mutex_wait_us":32,"thread_start_us":158,"threads_started":1}
I20260808 04:44:26.931504 10294 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "84d59be1d52a4792ae939e549df59cae" candidate_uuid: "2ce239838b36428cac6697cb0a3aec83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59bfc412fae4c048efc0ec4ae51bd8c" is_pre_election: true
I20260808 04:44:26.931660 10149 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "84d59be1d52a4792ae939e549df59cae" candidate_uuid: "2ce239838b36428cac6697cb0a3aec83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d92e85d3e924393b59d6c248eae35bb" is_pre_election: true
I20260808 04:44:26.931896 10294 raft_consensus.cc:2454] T 84d59be1d52a4792ae939e549df59cae P c59bfc412fae4c048efc0ec4ae51bd8c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ce239838b36428cac6697cb0a3aec83 in term 0.
I20260808 04:44:26.932003 10149 raft_consensus.cc:2454] T 84d59be1d52a4792ae939e549df59cae P 7d92e85d3e924393b59d6c248eae35bb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ce239838b36428cac6697cb0a3aec83 in term 0.
I20260808 04:44:26.932550 9933 leader_election.cc:302] T 84d59be1d52a4792ae939e549df59cae P 2ce239838b36428cac6697cb0a3aec83 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 2ce239838b36428cac6697cb0a3aec83, 7d92e85d3e924393b59d6c248eae35bb, c59bfc412fae4c048efc0ec4ae51bd8c; no voters:
I20260808 04:44:26.932852 10373 raft_consensus.cc:2781] T 84d59be1d52a4792ae939e549df59cae P 2ce239838b36428cac6697cb0a3aec83 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 04:44:26.932943 10373 raft_consensus.cc:482] T 84d59be1d52a4792ae939e549df59cae P 2ce239838b36428cac6697cb0a3aec83 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 04:44:26.932976 10373 raft_consensus.cc:3037] T 84d59be1d52a4792ae939e549df59cae P 2ce239838b36428cac6697cb0a3aec83 [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:44:26.934120 10373 raft_consensus.cc:504] T 84d59be1d52a4792ae939e549df59cae P 2ce239838b36428cac6697cb0a3aec83 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59bfc412fae4c048efc0ec4ae51bd8c" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 40783 } } peers { permanent_uuid: "2ce239838b36428cac6697cb0a3aec83" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 45215 } } peers { permanent_uuid: "7d92e85d3e924393b59d6c248eae35bb" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 34407 } }
I20260808 04:44:26.934552 10373 leader_election.cc:288] T 84d59be1d52a4792ae939e549df59cae P 2ce239838b36428cac6697cb0a3aec83 [CANDIDATE]: Term 1 election: Requested vote from peers c59bfc412fae4c048efc0ec4ae51bd8c (127.20.240.195:40783), 7d92e85d3e924393b59d6c248eae35bb (127.20.240.194:34407)
I20260808 04:44:26.934969 10294 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "84d59be1d52a4792ae939e549df59cae" candidate_uuid: "2ce239838b36428cac6697cb0a3aec83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59bfc412fae4c048efc0ec4ae51bd8c"
I20260808 04:44:26.935058 10149 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "84d59be1d52a4792ae939e549df59cae" candidate_uuid: "2ce239838b36428cac6697cb0a3aec83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d92e85d3e924393b59d6c248eae35bb"
I20260808 04:44:26.935133 10294 raft_consensus.cc:3037] T 84d59be1d52a4792ae939e549df59cae P c59bfc412fae4c048efc0ec4ae51bd8c [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:44:26.935216 10149 raft_consensus.cc:3037] T 84d59be1d52a4792ae939e549df59cae P 7d92e85d3e924393b59d6c248eae35bb [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:44:26.936290 10294 raft_consensus.cc:2454] T 84d59be1d52a4792ae939e549df59cae P c59bfc412fae4c048efc0ec4ae51bd8c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ce239838b36428cac6697cb0a3aec83 in term 1.
I20260808 04:44:26.936316 10149 raft_consensus.cc:2454] T 84d59be1d52a4792ae939e549df59cae P 7d92e85d3e924393b59d6c248eae35bb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ce239838b36428cac6697cb0a3aec83 in term 1.
I20260808 04:44:26.936653 9933 leader_election.cc:302] T 84d59be1d52a4792ae939e549df59cae P 2ce239838b36428cac6697cb0a3aec83 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ce239838b36428cac6697cb0a3aec83, c59bfc412fae4c048efc0ec4ae51bd8c; no voters:
I20260808 04:44:26.936877 10373 raft_consensus.cc:2781] T 84d59be1d52a4792ae939e549df59cae P 2ce239838b36428cac6697cb0a3aec83 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 04:44:26.937130 10373 raft_consensus.cc:686] T 84d59be1d52a4792ae939e549df59cae P 2ce239838b36428cac6697cb0a3aec83 [term 1 LEADER]: Becoming Leader. State: Replica: 2ce239838b36428cac6697cb0a3aec83, State: Running, Role: LEADER
I20260808 04:44:26.937587 10373 consensus_queue.cc:237] T 84d59be1d52a4792ae939e549df59cae P 2ce239838b36428cac6697cb0a3aec83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59bfc412fae4c048efc0ec4ae51bd8c" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 40783 } } peers { permanent_uuid: "2ce239838b36428cac6697cb0a3aec83" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 45215 } } peers { permanent_uuid: "7d92e85d3e924393b59d6c248eae35bb" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 34407 } }
I20260808 04:44:26.941011 9847 catalog_manager.cc:5495] T 84d59be1d52a4792ae939e549df59cae P 2ce239838b36428cac6697cb0a3aec83 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2ce239838b36428cac6697cb0a3aec83 (127.20.240.193). New cstate: current_term: 1 leader_uuid: "2ce239838b36428cac6697cb0a3aec83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59bfc412fae4c048efc0ec4ae51bd8c" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 40783 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2ce239838b36428cac6697cb0a3aec83" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 45215 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7d92e85d3e924393b59d6c248eae35bb" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 34407 } health_report { overall_health: UNKNOWN } } }
W20260808 04:44:26.972188 10347 tablet.cc:2369] T 84d59be1d52a4792ae939e549df59cae P c59bfc412fae4c048efc0ec4ae51bd8c: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 04:44:26.976686 10364 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:26.972990 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49226 (local address 127.20.240.193:45215)
0808 04:44:26.973249 (+ 259us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:26.973255 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:26.973274 (+ 19us) server_negotiation.cc:407] Connection header received
0808 04:44:26.973366 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:26.973368 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:26.973434 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:26.973540 (+ 106us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 04:44:26.973791 (+ 251us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:26.974348 (+ 557us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:26.975236 (+ 888us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:26.975459 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:26.975548 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:26.975828 (+ 280us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 04:44:26.976259 (+ 431us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 04:44:26.976351 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0808 04:44:26.976438 (+ 87us) server_negotiation.cc:299] Negotiation successful
0808 04:44:26.976492 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":88}
I20260808 04:44:26.983484 10294 raft_consensus.cc:1261] T 84d59be1d52a4792ae939e549df59cae P c59bfc412fae4c048efc0ec4ae51bd8c [term 1 FOLLOWER]: Refusing update from remote peer 2ce239838b36428cac6697cb0a3aec83: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 04:44:26.983484 10149 raft_consensus.cc:1261] T 84d59be1d52a4792ae939e549df59cae P 7d92e85d3e924393b59d6c248eae35bb [term 1 FOLLOWER]: Refusing update from remote peer 2ce239838b36428cac6697cb0a3aec83: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 04:44:26.984336 10377 consensus_queue.cc:1035] T 84d59be1d52a4792ae939e549df59cae P 2ce239838b36428cac6697cb0a3aec83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d92e85d3e924393b59d6c248eae35bb" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 34407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 04:44:26.984607 10373 consensus_queue.cc:1035] T 84d59be1d52a4792ae939e549df59cae P 2ce239838b36428cac6697cb0a3aec83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c59bfc412fae4c048efc0ec4ae51bd8c" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 40783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260808 04:44:26.990119 10202 tablet.cc:2369] T 84d59be1d52a4792ae939e549df59cae P 7d92e85d3e924393b59d6c248eae35bb: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 04:44:26.993383 10380 mvcc.cc:205] Tried to move back new op lower bound from 7316128837556432896 to 7316128837379575808. Current Snapshot: MvccSnapshot[applied={T|T < 7316128837556432896}]
I20260808 04:44:26.994979 10382 mvcc.cc:205] Tried to move back new op lower bound from 7316128837556432896 to 7316128837379575808. Current Snapshot: MvccSnapshot[applied={T|T < 7316128837556432896}]
I20260808 04:44:26.996311 10381 mvcc.cc:205] Tried to move back new op lower bound from 7316128837556432896 to 7316128837379575808. Current Snapshot: MvccSnapshot[applied={T|T < 7316128837556432896}]
I20260808 04:44:27.003598 9846 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51178:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 04:44:27.003823 9846 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51178:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 04:44:27.006745 9846 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 21b7de9d22114a569213c6946f8e62e8: Sending DeleteTablet for 3 replicas of tablet 84d59be1d52a4792ae939e549df59cae
I20260808 04:44:27.007694 10272 tablet_service.cc:1514] Processing DeleteTablet for tablet 84d59be1d52a4792ae939e549df59cae with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 04:44:26 UTC) from {username='kudu', principal='kudu/127.20.240.254@KRBTEST.COM'} at 127.0.0.1:36476
I20260808 04:44:27.008008 10128 tablet_service.cc:1514] Processing DeleteTablet for tablet 84d59be1d52a4792ae939e549df59cae with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 04:44:26 UTC) from {username='kudu', principal='kudu/127.20.240.254@KRBTEST.COM'} at 127.0.0.1:52724
I20260808 04:44:27.008313 10389 tablet_replica.cc:330] T 84d59be1d52a4792ae939e549df59cae P c59bfc412fae4c048efc0ec4ae51bd8c: stopping tablet replica
I20260808 04:44:27.008275 9981 tablet_service.cc:1514] Processing DeleteTablet for tablet 84d59be1d52a4792ae939e549df59cae with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 04:44:26 UTC) from {username='kudu', principal='kudu/127.20.240.254@KRBTEST.COM'} at 127.0.0.1:49222
I20260808 04:44:27.008711 10389 raft_consensus.cc:2229] T 84d59be1d52a4792ae939e549df59cae P c59bfc412fae4c048efc0ec4ae51bd8c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 04:44:27.009044 10390 tablet_replica.cc:330] T 84d59be1d52a4792ae939e549df59cae P 7d92e85d3e924393b59d6c248eae35bb: stopping tablet replica
I20260808 04:44:27.009078 10389 raft_consensus.cc:2258] T 84d59be1d52a4792ae939e549df59cae P c59bfc412fae4c048efc0ec4ae51bd8c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 04:44:27.009617 10390 raft_consensus.cc:2229] T 84d59be1d52a4792ae939e549df59cae P 7d92e85d3e924393b59d6c248eae35bb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 04:44:27.009783 21443 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu with pid 9916
I20260808 04:44:27.011204 10390 raft_consensus.cc:2258] T 84d59be1d52a4792ae939e549df59cae P 7d92e85d3e924393b59d6c248eae35bb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 04:44:27.013273 10390 ts_tablet_manager.cc:1905] T 84d59be1d52a4792ae939e549df59cae P 7d92e85d3e924393b59d6c248eae35bb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 04:44:27.013674 10389 ts_tablet_manager.cc:1905] T 84d59be1d52a4792ae939e549df59cae P c59bfc412fae4c048efc0ec4ae51bd8c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 04:44:27.016229 10390 ts_tablet_manager.cc:1918] T 84d59be1d52a4792ae939e549df59cae P 7d92e85d3e924393b59d6c248eae35bb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 04:44:27.016388 10390 log.cc:1196] T 84d59be1d52a4792ae939e549df59cae P 7d92e85d3e924393b59d6c248eae35bb: Deleting WAL directory at /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786164000593138-21443-0/minicluster-data/ts-1/wal/wals/84d59be1d52a4792ae939e549df59cae
I20260808 04:44:27.016755 10390 ts_tablet_manager.cc:1939] T 84d59be1d52a4792ae939e549df59cae P 7d92e85d3e924393b59d6c248eae35bb: Deleting consensus metadata
I20260808 04:44:27.017508 10389 ts_tablet_manager.cc:1918] T 84d59be1d52a4792ae939e549df59cae P c59bfc412fae4c048efc0ec4ae51bd8c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 04:44:27.017635 10389 log.cc:1196] T 84d59be1d52a4792ae939e549df59cae P c59bfc412fae4c048efc0ec4ae51bd8c: Deleting WAL directory at /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786164000593138-21443-0/minicluster-data/ts-2/wal/wals/84d59be1d52a4792ae939e549df59cae
I20260808 04:44:27.018069 10389 ts_tablet_manager.cc:1939] T 84d59be1d52a4792ae939e549df59cae P c59bfc412fae4c048efc0ec4ae51bd8c: Deleting consensus metadata
I20260808 04:44:27.018321 9830 catalog_manager.cc:4841] TS 7d92e85d3e924393b59d6c248eae35bb (127.20.240.194:34407): tablet 84d59be1d52a4792ae939e549df59cae (table test-table [id=0e4b5a2e1b2843c4a32f5bbd93da382a]) successfully deleted
I20260808 04:44:27.019568 9831 catalog_manager.cc:4841] TS c59bfc412fae4c048efc0ec4ae51bd8c (127.20.240.195:40783): tablet 84d59be1d52a4792ae939e549df59cae (table test-table [id=0e4b5a2e1b2843c4a32f5bbd93da382a]) successfully deleted
W20260808 04:44:27.019923 9831 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.20.240.193:45215 (error 108)
I20260808 04:44:27.020092 21443 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu with pid 10058
I20260808 04:44:27.022848 10361 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:27.022416 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.193:45215 (local address 127.0.0.1:49230)
0808 04:44:27.022640 (+ 224us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:27.022729 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.240.193:45215: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":95}
W20260808 04:44:27.023167 9831 catalog_manager.cc:4584] TS 2ce239838b36428cac6697cb0a3aec83 (127.20.240.193:45215): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 84d59be1d52a4792ae939e549df59cae: Network error: Client connection negotiation failed: client connection to 127.20.240.193:45215: connect: Connection refused (error 111)
I20260808 04:44:27.028121 21443 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu with pid 10206
I20260808 04:44:27.035598 21443 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu with pid 9813
2026-08-08T04:44:27Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/4 (2496 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/5
2026-08-08T04:44:27Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T04:44:27Z Disabled control of system clock
I20260808 04:44:27.070377 21443 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
/tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786164000593138-21443-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786164000593138-21443-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786164000593138-21443-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786164000593138-21443-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.240.254:45895
--webserver_interface=127.20.240.254
--webserver_port=0
--builtin_ntp_servers=127.20.240.212:35195
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.240.254:45895
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260808 04:44:27.188360 10397 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:44:27.188647 10397 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:44:27.188686 10397 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:44:27.193064 10397 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 04:44:27.193252 10397 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:44:27.193293 10397 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:44:27.193328 10397 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 04:44:27.193414 10397 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 04:44:27.198823 10397 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.240.212:35195
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786164000593138-21443-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786164000593138-21443-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.240.254:45895
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.240.254:45895
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786164000593138-21443-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.240.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10397
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786164000593138-21443-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 04:05:18 UTC on ccycloud.quasar-drfdgt.root.comops.site
build id 4574101
I20260808 04:44:27.200068 10397 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:44:27.201666 10397 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:44:27.212019 10408 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:44:27.212019 10403 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:44:27.212368 10397 server_base.cc:1034] running on GCE node
W20260808 04:44:27.212644 10405 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:44:27.213372 10397 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:44:27.214768 10397 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:44:27.216046 10397 hybrid_clock.cc:648] HybridClock initialized: now 1786164267216029 us; error 38 us; skew 500 ppm
I20260808 04:44:27.218448 10397 webserver.cc:460] Webserver started at http://127.20.240.254:34923/ using document root <none> and password file <none>
I20260808 04:44:27.219120 10397 fs_manager.cc:359] Metadata directory not provided
I20260808 04:44:27.219251 10397 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:44:27.219511 10397 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 04:44:27.221983 10397 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786164000593138-21443-0/minicluster-data/master-0/data/instance:
uuid: "8e5b6a858e2b408d9dc6c359bfdc8ccf"
format_stamp: "Formatted at 2026-08-08 04:44:27 on dist-test-slave-vxj2"
server_key: "613685ad927092585d5eed25b2c5ebf2"
server_key_iv: "79b438b39c81ac607013e546479a9f21"
server_key_version: "encryptionkey@0"
I20260808 04:44:27.222625 10397 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786164000593138-21443-0/minicluster-data/master-0/wal/instance:
uuid: "8e5b6a858e2b408d9dc6c359bfdc8ccf"
format_stamp: "Formatted at 2026-08-08 04:44:27 on dist-test-slave-vxj2"
server_key: "613685ad927092585d5eed25b2c5ebf2"
server_key_iv: "79b438b39c81ac607013e546479a9f21"
server_key_version: "encryptionkey@0"
I20260808 04:44:27.226785 10397 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260808 04:44:27.229674 10415 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:44:27.231046 10397 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 04:44:27.231225 10397 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786164000593138-21443-0/minicluster-data/master-0/data,/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786164000593138-21443-0/minicluster-data/master-0/wal
uuid: "8e5b6a858e2b408d9dc6c359bfdc8ccf"
format_stamp: "Formatted at 2026-08-08 04:44:27 on dist-test-slave-vxj2"
server_key: "613685ad927092585d5eed25b2c5ebf2"
server_key_iv: "79b438b39c81ac607013e546479a9f21"
server_key_version: "encryptionkey@0"
I20260808 04:44:27.231361 10397 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786164000593138-21443-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786164000593138-21443-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786164000593138-21443-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:44:27.241624 10397 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:44:27.242390 10397 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:44:27.242611 10397 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:44:27.250398 10397 rpc_server.cc:307] RPC server started. Bound to: 127.20.240.254:45895
I20260808 04:44:27.250437 10471 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.240.254:45895 every 8 connection(s)
I20260808 04:44:27.251423 10397 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786164000593138-21443-0/minicluster-data/master-0/data/info.pb
I20260808 04:44:27.254900 10472 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:44:27.257685 21443 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu as pid 10397
I20260808 04:44:27.257817 21443 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786164000593138-21443-0/minicluster-data/master-0/wal/instance
I20260808 04:44:27.258121 21443 external_mini_cluster.cc:1428] Setting key 4b1caf87b85ab8727774c70f98efc1d8
I20260808 04:44:27.261627 10472 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8e5b6a858e2b408d9dc6c359bfdc8ccf: Bootstrap starting.
I20260808 04:44:27.263976 10472 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8e5b6a858e2b408d9dc6c359bfdc8ccf: Neither blocks nor log segments found. Creating new log.
I20260808 04:44:27.264779 10472 log.cc:824] T 00000000000000000000000000000000 P 8e5b6a858e2b408d9dc6c359bfdc8ccf: Log is configured to *not* fsync() on all Append() calls
I20260808 04:44:27.266808 10472 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8e5b6a858e2b408d9dc6c359bfdc8ccf: No bootstrap required, opened a new log
I20260808 04:44:27.267938 10475 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:27.259653 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34100 (local address 127.20.240.254:45895)
0808 04:44:27.260393 (+ 740us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:27.260410 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:27.260448 (+ 38us) server_negotiation.cc:407] Connection header received
0808 04:44:27.261091 (+ 643us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:27.261108 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:27.261624 (+ 516us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:27.262005 (+ 381us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:44:27.262471 (+ 466us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:27.263448 (+ 977us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:27.264481 (+ 1033us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:27.265024 (+ 543us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:27.265238 (+ 214us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:27.266150 (+ 912us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:44:27.266156 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:44:27.266170 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 04:44:27.266590 (+ 420us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:44:27.266646 (+ 56us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 04:44:27.266667 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:44:27.266783 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0808 04:44:27.266928 (+ 145us) server_negotiation.cc:299] Negotiation successful
0808 04:44:27.267194 (+ 266us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":323,"thread_start_us":142,"threads_started":1}
I20260808 04:44:27.270676 10472 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8e5b6a858e2b408d9dc6c359bfdc8ccf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8e5b6a858e2b408d9dc6c359bfdc8ccf" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 45895 } }
I20260808 04:44:27.270938 10472 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8e5b6a858e2b408d9dc6c359bfdc8ccf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:44:27.271029 10472 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8e5b6a858e2b408d9dc6c359bfdc8ccf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e5b6a858e2b408d9dc6c359bfdc8ccf, State: Initialized, Role: FOLLOWER
I20260808 04:44:27.271524 10472 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8e5b6a858e2b408d9dc6c359bfdc8ccf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8e5b6a858e2b408d9dc6c359bfdc8ccf" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 45895 } }
I20260808 04:44:27.271714 10472 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8e5b6a858e2b408d9dc6c359bfdc8ccf [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 04:44:27.271796 10472 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8e5b6a858e2b408d9dc6c359bfdc8ccf [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 04:44:27.271905 10472 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8e5b6a858e2b408d9dc6c359bfdc8ccf [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:44:27.272953 10472 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8e5b6a858e2b408d9dc6c359bfdc8ccf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8e5b6a858e2b408d9dc6c359bfdc8ccf" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 45895 } }
I20260808 04:44:27.273358 10472 leader_election.cc:302] T 00000000000000000000000000000000 P 8e5b6a858e2b408d9dc6c359bfdc8ccf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8e5b6a858e2b408d9dc6c359bfdc8ccf; no voters:
I20260808 04:44:27.273721 10472 leader_election.cc:288] T 00000000000000000000000000000000 P 8e5b6a858e2b408d9dc6c359bfdc8ccf [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 04:44:27.273936 10478 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8e5b6a858e2b408d9dc6c359bfdc8ccf [term 1 FOLLOWER]: Leader election won for term 1
I20260808 04:44:27.274238 10478 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8e5b6a858e2b408d9dc6c359bfdc8ccf [term 1 LEADER]: Becoming Leader. State: Replica: 8e5b6a858e2b408d9dc6c359bfdc8ccf, State: Running, Role: LEADER
I20260808 04:44:27.274574 10478 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8e5b6a858e2b408d9dc6c359bfdc8ccf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8e5b6a858e2b408d9dc6c359bfdc8ccf" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 45895 } }
I20260808 04:44:27.275082 10472 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8e5b6a858e2b408d9dc6c359bfdc8ccf [sys.catalog]: configured and running, proceeding with master startup.
I20260808 04:44:27.276279 10480 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8e5b6a858e2b408d9dc6c359bfdc8ccf [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8e5b6a858e2b408d9dc6c359bfdc8ccf. Latest consensus state: current_term: 1 leader_uuid: "8e5b6a858e2b408d9dc6c359bfdc8ccf" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8e5b6a858e2b408d9dc6c359bfdc8ccf" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 45895 } } }
I20260808 04:44:27.276432 10480 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8e5b6a858e2b408d9dc6c359bfdc8ccf [sys.catalog]: This master's current role is: LEADER
I20260808 04:44:27.276721 10479 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8e5b6a858e2b408d9dc6c359bfdc8ccf [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8e5b6a858e2b408d9dc6c359bfdc8ccf" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8e5b6a858e2b408d9dc6c359bfdc8ccf" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 45895 } } }
I20260808 04:44:27.276921 10479 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8e5b6a858e2b408d9dc6c359bfdc8ccf [sys.catalog]: This master's current role is: LEADER
I20260808 04:44:27.276990 10487 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 04:44:27.280835 10487 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 04:44:27.287634 10487 catalog_manager.cc:1347] Generated new cluster ID: b9df372050bf4e74b79a93a55b59d93b
I20260808 04:44:27.287760 10487 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 04:44:27.302977 10487 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 04:44:27.304039 10487 catalog_manager.cc:1504] Loading token signing keys...
I20260808 04:44:27.314638 10487 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8e5b6a858e2b408d9dc6c359bfdc8ccf: Generated new TSK 0
I20260808 04:44:27.315570 10487 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 04:44:27.323714 21443 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
/tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786164000593138-21443-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786164000593138-21443-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786164000593138-21443-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786164000593138-21443-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.240.193:0
--local_ip_for_outbound_sockets=127.20.240.193
--webserver_interface=127.20.240.193
--webserver_port=0
--tserver_master_addrs=127.20.240.254:45895
--builtin_ntp_servers=127.20.240.212:35195
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260808 04:44:27.452371 10500 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:44:27.452685 10500 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:44:27.452730 10500 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:44:27.456983 10500 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:44:27.457062 10500 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:44:27.457120 10500 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.240.193
I20260808 04:44:27.462350 10500 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.240.212:35195
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786164000593138-21443-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786164000593138-21443-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.240.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786164000593138-21443-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.240.193
--webserver_port=0
--tserver_master_addrs=127.20.240.254:45895
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10500
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.240.193
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786164000593138-21443-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 04:05:18 UTC on ccycloud.quasar-drfdgt.root.comops.site
build id 4574101
I20260808 04:44:27.463477 10500 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:44:27.464916 10500 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:44:27.474803 10509 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:44:27.474802 10507 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:44:27.474838 10506 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:44:27.474896 10500 server_base.cc:1034] running on GCE node
I20260808 04:44:27.475634 10500 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:44:27.476442 10500 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:44:27.477640 10500 hybrid_clock.cc:648] HybridClock initialized: now 1786164267477624 us; error 24 us; skew 500 ppm
I20260808 04:44:27.485083 10500 webserver.cc:460] Webserver started at http://127.20.240.193:34591/ using document root <none> and password file <none>
I20260808 04:44:27.485847 10500 fs_manager.cc:359] Metadata directory not provided
I20260808 04:44:27.485926 10500 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:44:27.486164 10500 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 04:44:27.488384 10500 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786164000593138-21443-0/minicluster-data/ts-0/data/instance:
uuid: "84f8fbc54bd74709ac24567836ce2986"
format_stamp: "Formatted at 2026-08-08 04:44:27 on dist-test-slave-vxj2"
server_key: "2eb2b0bc4a88d1502c33607764f8f072"
server_key_iv: "d6f5b019aec4cb8c4cfa1c8cc89e2dbc"
server_key_version: "encryptionkey@0"
I20260808 04:44:27.488983 10500 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786164000593138-21443-0/minicluster-data/ts-0/wal/instance:
uuid: "84f8fbc54bd74709ac24567836ce2986"
format_stamp: "Formatted at 2026-08-08 04:44:27 on dist-test-slave-vxj2"
server_key: "2eb2b0bc4a88d1502c33607764f8f072"
server_key_iv: "d6f5b019aec4cb8c4cfa1c8cc89e2dbc"
server_key_version: "encryptionkey@0"
I20260808 04:44:27.493124 10500 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.001s
I20260808 04:44:27.496112 10516 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:44:27.497717 10500 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 04:44:27.497922 10500 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786164000593138-21443-0/minicluster-data/ts-0/data,/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786164000593138-21443-0/minicluster-data/ts-0/wal
uuid: "84f8fbc54bd74709ac24567836ce2986"
format_stamp: "Formatted at 2026-08-08 04:44:27 on dist-test-slave-vxj2"
server_key: "2eb2b0bc4a88d1502c33607764f8f072"
server_key_iv: "d6f5b019aec4cb8c4cfa1c8cc89e2dbc"
server_key_version: "encryptionkey@0"
I20260808 04:44:27.498044 10500 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786164000593138-21443-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786164000593138-21443-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786164000593138-21443-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:44:27.519232 10500 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:44:27.520035 10500 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:44:27.520257 10500 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:44:27.520972 10500 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 04:44:27.522059 10500 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 04:44:27.522111 10500 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 04:44:27.522182 10500 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 04:44:27.522219 10500 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 04:44:27.531904 10500 rpc_server.cc:307] RPC server started. Bound to: 127.20.240.193:35343
I20260808 04:44:27.531958 10635 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.240.193:35343 every 8 connection(s)
I20260808 04:44:27.532927 10500 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786164000593138-21443-0/minicluster-data/ts-0/data/info.pb
I20260808 04:44:27.541544 21443 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu as pid 10500
I20260808 04:44:27.541687 21443 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786164000593138-21443-0/minicluster-data/ts-0/wal/instance
I20260808 04:44:27.541988 21443 external_mini_cluster.cc:1428] Setting key 04989a9660a2fb7a06194a5d4ed2da58
I20260808 04:44:27.542711 10475 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:27.534884 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.240.193:44845 (local address 127.20.240.254:45895)
0808 04:44:27.535071 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:27.535076 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:27.536259 (+ 1183us) server_negotiation.cc:407] Connection header received
0808 04:44:27.537746 (+ 1487us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:27.537750 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:27.537804 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:27.537908 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:44:27.538814 (+ 906us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:27.539496 (+ 682us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:27.540662 (+ 1166us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:27.540896 (+ 234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:27.540991 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:27.542203 (+ 1212us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:44:27.542206 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:44:27.542208 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 04:44:27.542221 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:44:27.542241 (+ 20us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 04:44:27.542249 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:44:27.542333 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0808 04:44:27.542500 (+ 167us) server_negotiation.cc:299] Negotiation successful
0808 04:44:27.542567 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82}
I20260808 04:44:27.543684 10640 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:27.535361 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:45895 (local address 127.20.240.193:44845)
0808 04:44:27.536111 (+ 750us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:27.536154 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0808 04:44:27.537520 (+ 1366us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:44:27.538091 (+ 571us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:44:27.538097 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:44:27.538180 (+ 83us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:44:27.538678 (+ 498us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:44:27.538691 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:44:27.539618 (+ 927us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:44:27.539620 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:44:27.540528 (+ 908us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:44:27.540538 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:44:27.541049 (+ 511us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:44:27.541052 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:44:27.541223 (+ 171us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:27.541877 (+ 654us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 04:44:27.541879 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:44:27.541932 (+ 53us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 04:44:27.542005 (+ 73us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:44:27.542334 (+ 329us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:44:27.542347 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:44:27.542356 (+ 9us) client_negotiation.cc:769] Sending connection context
0808 04:44:27.542500 (+ 144us) client_negotiation.cc:240] Negotiation successful
0808 04:44:27.542811 (+ 311us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":269,"thread_start_us":129,"threads_started":1}
I20260808 04:44:27.544107 21443 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
/tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786164000593138-21443-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786164000593138-21443-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786164000593138-21443-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786164000593138-21443-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.240.194:0
--local_ip_for_outbound_sockets=127.20.240.194
--webserver_interface=127.20.240.194
--webserver_port=0
--tserver_master_addrs=127.20.240.254:45895
--builtin_ntp_servers=127.20.240.212:35195
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260808 04:44:27.545028 10637 heartbeater.cc:347] Connected to a master server at 127.20.240.254:45895
I20260808 04:44:27.545327 10637 heartbeater.cc:464] Registering TS with master...
I20260808 04:44:27.545890 10637 heartbeater.cc:511] Master 127.20.240.254:45895 requested a full tablet report, sending...
I20260808 04:44:27.547665 10434 ts_manager.cc:194] Registered new tserver with Master: 84f8fbc54bd74709ac24567836ce2986 (127.20.240.193:35343)
I20260808 04:44:27.549597 10434 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.20.240.193:44845
W20260808 04:44:27.660209 10641 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:44:27.660503 10641 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:44:27.660543 10641 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:44:27.664878 10641 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:44:27.664953 10641 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:44:27.665012 10641 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.240.194
I20260808 04:44:27.669872 10641 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.240.212:35195
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786164000593138-21443-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786164000593138-21443-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.240.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786164000593138-21443-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.240.194
--webserver_port=0
--tserver_master_addrs=127.20.240.254:45895
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10641
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.240.194
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786164000593138-21443-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 04:05:18 UTC on ccycloud.quasar-drfdgt.root.comops.site
build id 4574101
I20260808 04:44:27.671027 10641 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:44:27.672521 10641 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:44:27.683511 10650 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:44:27.683432 10647 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:44:27.683456 10648 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:44:27.683650 10641 server_base.cc:1034] running on GCE node
I20260808 04:44:27.684242 10641 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:44:27.685236 10641 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:44:27.686427 10641 hybrid_clock.cc:648] HybridClock initialized: now 1786164267686353 us; error 90 us; skew 500 ppm
I20260808 04:44:27.688748 10641 webserver.cc:460] Webserver started at http://127.20.240.194:41633/ using document root <none> and password file <none>
I20260808 04:44:27.689462 10641 fs_manager.cc:359] Metadata directory not provided
I20260808 04:44:27.689544 10641 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:44:27.689769 10641 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 04:44:27.691951 10641 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786164000593138-21443-0/minicluster-data/ts-1/data/instance:
uuid: "8c117d26fdb9455fbee81a5c19c96faa"
format_stamp: "Formatted at 2026-08-08 04:44:27 on dist-test-slave-vxj2"
server_key: "0f8a60bcf42896c488e7341a257a3bd0"
server_key_iv: "11f9f26ebf02a5b80f637b9a9169d180"
server_key_version: "encryptionkey@0"
I20260808 04:44:27.692548 10641 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786164000593138-21443-0/minicluster-data/ts-1/wal/instance:
uuid: "8c117d26fdb9455fbee81a5c19c96faa"
format_stamp: "Formatted at 2026-08-08 04:44:27 on dist-test-slave-vxj2"
server_key: "0f8a60bcf42896c488e7341a257a3bd0"
server_key_iv: "11f9f26ebf02a5b80f637b9a9169d180"
server_key_version: "encryptionkey@0"
I20260808 04:44:27.696553 10641 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.004s
I20260808 04:44:27.699290 10656 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:44:27.700646 10641 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260808 04:44:27.700783 10641 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786164000593138-21443-0/minicluster-data/ts-1/data,/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786164000593138-21443-0/minicluster-data/ts-1/wal
uuid: "8c117d26fdb9455fbee81a5c19c96faa"
format_stamp: "Formatted at 2026-08-08 04:44:27 on dist-test-slave-vxj2"
server_key: "0f8a60bcf42896c488e7341a257a3bd0"
server_key_iv: "11f9f26ebf02a5b80f637b9a9169d180"
server_key_version: "encryptionkey@0"
I20260808 04:44:27.700907 10641 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786164000593138-21443-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786164000593138-21443-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786164000593138-21443-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:44:27.728135 10641 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:44:27.728900 10641 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:44:27.729111 10641 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:44:27.729823 10641 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 04:44:27.730906 10641 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 04:44:27.730986 10641 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 04:44:27.731067 10641 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 04:44:27.731110 10641 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 04:44:27.740936 10641 rpc_server.cc:307] RPC server started. Bound to: 127.20.240.194:32771
I20260808 04:44:27.740959 10784 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.240.194:32771 every 8 connection(s)
I20260808 04:44:27.741988 10641 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786164000593138-21443-0/minicluster-data/ts-1/data/info.pb
I20260808 04:44:27.752223 21443 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu as pid 10641
I20260808 04:44:27.752403 21443 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786164000593138-21443-0/minicluster-data/ts-1/wal/instance
I20260808 04:44:27.752565 10475 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:27.743986 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.240.194:46681 (local address 127.20.240.254:45895)
0808 04:44:27.744145 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:27.744150 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:27.745700 (+ 1550us) server_negotiation.cc:407] Connection header received
0808 04:44:27.747298 (+ 1598us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:27.747302 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:27.747366 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:27.747456 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:44:27.748466 (+ 1010us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:27.749012 (+ 546us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:27.750314 (+ 1302us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:27.750553 (+ 239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:27.750673 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:27.752016 (+ 1343us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:44:27.752020 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:44:27.752022 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 04:44:27.752038 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:44:27.752059 (+ 21us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 04:44:27.752067 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:44:27.752167 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0808 04:44:27.752337 (+ 170us) server_negotiation.cc:299] Negotiation successful
0808 04:44:27.752411 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260808 04:44:27.752729 21443 external_mini_cluster.cc:1428] Setting key 25a04a96de02bceea2cd1e300f5011fa
I20260808 04:44:27.753706 10787 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:27.744462 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:45895 (local address 127.20.240.194:46681)
0808 04:44:27.745523 (+ 1061us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:27.745569 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0808 04:44:27.746982 (+ 1413us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:44:27.747662 (+ 680us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:44:27.747669 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:44:27.747760 (+ 91us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:44:27.748300 (+ 540us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:44:27.748314 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:44:27.749195 (+ 881us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:44:27.749198 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:44:27.750167 (+ 969us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:44:27.750178 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:44:27.750742 (+ 564us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:44:27.750747 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:44:27.750949 (+ 202us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:27.751664 (+ 715us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 04:44:27.751665 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:44:27.751712 (+ 47us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 04:44:27.751786 (+ 74us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:44:27.752174 (+ 388us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:44:27.752185 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:44:27.752192 (+ 7us) client_negotiation.cc:769] Sending connection context
0808 04:44:27.752338 (+ 146us) client_negotiation.cc:240] Negotiation successful
0808 04:44:27.752675 (+ 337us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":576,"thread_start_us":467,"threads_started":1}
I20260808 04:44:27.755066 10785 heartbeater.cc:347] Connected to a master server at 127.20.240.254:45895
I20260808 04:44:27.755159 21443 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
/tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786164000593138-21443-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786164000593138-21443-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786164000593138-21443-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786164000593138-21443-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.240.195:0
--local_ip_for_outbound_sockets=127.20.240.195
--webserver_interface=127.20.240.195
--webserver_port=0
--tserver_master_addrs=127.20.240.254:45895
--builtin_ntp_servers=127.20.240.212:35195
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260808 04:44:27.755395 10785 heartbeater.cc:464] Registering TS with master...
I20260808 04:44:27.755977 10785 heartbeater.cc:511] Master 127.20.240.254:45895 requested a full tablet report, sending...
I20260808 04:44:27.757130 10434 ts_manager.cc:194] Registered new tserver with Master: 8c117d26fdb9455fbee81a5c19c96faa (127.20.240.194:32771)
I20260808 04:44:27.757987 10434 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.20.240.194:46681
W20260808 04:44:27.871834 10788 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:44:27.872181 10788 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:44:27.872263 10788 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:44:27.876842 10788 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:44:27.876947 10788 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:44:27.877038 10788 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.240.195
I20260808 04:44:27.882928 10788 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.240.212:35195
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786164000593138-21443-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786164000593138-21443-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.240.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786164000593138-21443-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.240.195
--webserver_port=0
--tserver_master_addrs=127.20.240.254:45895
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10788
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.240.195
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786164000593138-21443-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 04:05:18 UTC on ccycloud.quasar-drfdgt.root.comops.site
build id 4574101
I20260808 04:44:27.884157 10788 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:44:27.885735 10788 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:44:27.895944 10794 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:44:27.895934 10793 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:44:27.896039 10797 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:44:27.896255 10788 server_base.cc:1034] running on GCE node
I20260808 04:44:27.896806 10788 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:44:27.897647 10788 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:44:27.898865 10788 hybrid_clock.cc:648] HybridClock initialized: now 1786164267898834 us; error 67 us; skew 500 ppm
I20260808 04:44:27.901005 10788 webserver.cc:460] Webserver started at http://127.20.240.195:34287/ using document root <none> and password file <none>
I20260808 04:44:27.901769 10788 fs_manager.cc:359] Metadata directory not provided
I20260808 04:44:27.901934 10788 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:44:27.902195 10788 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 04:44:27.904546 10788 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786164000593138-21443-0/minicluster-data/ts-2/data/instance:
uuid: "1760f15e916e4220aea491b7345bea2f"
format_stamp: "Formatted at 2026-08-08 04:44:27 on dist-test-slave-vxj2"
server_key: "4021bb3711ae3c130085022536122f3d"
server_key_iv: "b0512c8b6589e4bde7c15fe9c6e6c10c"
server_key_version: "encryptionkey@0"
I20260808 04:44:27.905228 10788 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786164000593138-21443-0/minicluster-data/ts-2/wal/instance:
uuid: "1760f15e916e4220aea491b7345bea2f"
format_stamp: "Formatted at 2026-08-08 04:44:27 on dist-test-slave-vxj2"
server_key: "4021bb3711ae3c130085022536122f3d"
server_key_iv: "b0512c8b6589e4bde7c15fe9c6e6c10c"
server_key_version: "encryptionkey@0"
I20260808 04:44:27.909330 10788 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20260808 04:44:27.911900 10804 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:44:27.913254 10788 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 04:44:27.913388 10788 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786164000593138-21443-0/minicluster-data/ts-2/data,/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786164000593138-21443-0/minicluster-data/ts-2/wal
uuid: "1760f15e916e4220aea491b7345bea2f"
format_stamp: "Formatted at 2026-08-08 04:44:27 on dist-test-slave-vxj2"
server_key: "4021bb3711ae3c130085022536122f3d"
server_key_iv: "b0512c8b6589e4bde7c15fe9c6e6c10c"
server_key_version: "encryptionkey@0"
I20260808 04:44:27.913511 10788 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786164000593138-21443-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786164000593138-21443-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786164000593138-21443-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:44:27.941311 10788 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:44:27.942080 10788 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:44:27.942306 10788 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:44:27.943020 10788 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 04:44:27.944038 10788 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 04:44:27.944113 10788 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 04:44:27.944190 10788 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 04:44:27.944235 10788 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 04:44:27.953620 10788 rpc_server.cc:307] RPC server started. Bound to: 127.20.240.195:38947
I20260808 04:44:27.953694 10931 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.240.195:38947 every 8 connection(s)
I20260808 04:44:27.954627 10788 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786164000593138-21443-0/minicluster-data/ts-2/data/info.pb
I20260808 04:44:27.963161 21443 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu as pid 10788
I20260808 04:44:27.963294 21443 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786164000593138-21443-0/minicluster-data/ts-2/wal/instance
I20260808 04:44:27.963606 21443 external_mini_cluster.cc:1428] Setting key 6a0b911d3b8416392aaf280f1c380517
I20260808 04:44:27.964437 10475 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:27.956598 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.240.195:59305 (local address 127.20.240.254:45895)
0808 04:44:27.956780 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:27.956785 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:27.957912 (+ 1127us) server_negotiation.cc:407] Connection header received
0808 04:44:27.959275 (+ 1363us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:27.959278 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:27.959327 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:27.959405 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:44:27.960294 (+ 889us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:27.960915 (+ 621us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:27.962147 (+ 1232us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:27.962382 (+ 235us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:27.962472 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:27.963681 (+ 1209us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:44:27.963684 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:44:27.963686 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 04:44:27.963717 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:44:27.963741 (+ 24us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 04:44:27.963754 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:44:27.963839 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0808 04:44:27.964164 (+ 325us) server_negotiation.cc:299] Negotiation successful
0808 04:44:27.964269 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260808 04:44:27.965368 10934 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:27.957029 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:45895 (local address 127.20.240.195:59305)
0808 04:44:27.957760 (+ 731us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:27.957802 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0808 04:44:27.959067 (+ 1265us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:44:27.959568 (+ 501us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:44:27.959573 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:44:27.959652 (+ 79us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:44:27.960124 (+ 472us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:44:27.960135 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:44:27.961050 (+ 915us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:44:27.961053 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:44:27.962021 (+ 968us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:44:27.962030 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:44:27.962518 (+ 488us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:44:27.962521 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:44:27.962661 (+ 140us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:27.963405 (+ 744us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 04:44:27.963407 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:44:27.963449 (+ 42us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 04:44:27.963512 (+ 63us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:44:27.963854 (+ 342us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:44:27.963865 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:44:27.963871 (+ 6us) client_negotiation.cc:769] Sending connection context
0808 04:44:27.964062 (+ 191us) client_negotiation.cc:240] Negotiation successful
0808 04:44:27.964348 (+ 286us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":348,"thread_start_us":189,"threads_started":1}
I20260808 04:44:27.966499 10932 heartbeater.cc:347] Connected to a master server at 127.20.240.254:45895
I20260808 04:44:27.966763 10932 heartbeater.cc:464] Registering TS with master...
I20260808 04:44:27.967415 10932 heartbeater.cc:511] Master 127.20.240.254:45895 requested a full tablet report, sending...
I20260808 04:44:27.968509 10432 ts_manager.cc:194] Registered new tserver with Master: 1760f15e916e4220aea491b7345bea2f (127.20.240.195:38947)
I20260808 04:44:27.969137 10432 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.20.240.195:59305
I20260808 04:44:27.978152 21443 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 04:44:27.984341 10475 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:27.980170 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34110 (local address 127.20.240.254:45895)
0808 04:44:27.980320 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:27.980326 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:27.980483 (+ 157us) server_negotiation.cc:407] Connection header received
0808 04:44:27.980648 (+ 165us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:27.980651 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:27.980692 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:27.980776 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:44:27.981079 (+ 303us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:27.981659 (+ 580us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:27.982561 (+ 902us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:27.982831 (+ 270us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:27.982944 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:27.983908 (+ 964us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:44:27.983912 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:44:27.983915 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 04:44:27.983935 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:44:27.983953 (+ 18us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 04:44:27.983961 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:44:27.984041 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0808 04:44:27.984132 (+ 91us) server_negotiation.cc:299] Negotiation successful
0808 04:44:27.984192 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260808 04:44:27.987439 10432 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34110:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 04:44:27.990634 10432 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 04:44:28.006220 10950 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:28.000368 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39884 (local address 127.20.240.194:32771)
0808 04:44:28.001063 (+ 695us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:28.001075 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:28.001099 (+ 24us) server_negotiation.cc:407] Connection header received
0808 04:44:28.001200 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:28.001205 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:28.001397 (+ 192us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:28.001588 (+ 191us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 04:44:28.001839 (+ 251us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:28.002825 (+ 986us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:28.004598 (+ 1773us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:28.005454 (+ 856us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:28.005580 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:28.005771 (+ 191us) server_negotiation.cc:1035] Waiting for connection context
0808 04:44:28.005956 (+ 185us) server_negotiation.cc:299] Negotiation successful
0808 04:44:28.006044 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":602,"thread_start_us":140,"threads_started":1}
I20260808 04:44:28.006217 10946 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:27.999673 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.194:32771 (local address 127.0.0.1:39884)
0808 04:44:28.000197 (+ 524us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:28.000250 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0808 04:44:28.000387 (+ 137us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:44:28.001572 (+ 1185us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:44:28.001575 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:44:28.001592 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 04:44:28.001711 (+ 119us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:44:28.001716 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:44:28.002949 (+ 1233us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:44:28.002970 (+ 21us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:44:28.004434 (+ 1464us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:44:28.004444 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:44:28.005601 (+ 1157us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:44:28.005608 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:44:28.005732 (+ 124us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:28.005784 (+ 52us) client_negotiation.cc:769] Sending connection context
0808 04:44:28.005906 (+ 122us) client_negotiation.cc:240] Negotiation successful
0808 04:44:28.006040 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":354,"mutex_wait_us":45,"thread_start_us":91,"threads_started":1}
I20260808 04:44:28.006543 10947 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:28.000417 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.193:35343 (local address 127.0.0.1:60742)
0808 04:44:28.001616 (+ 1199us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:28.001630 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 04:44:28.001715 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:44:28.002179 (+ 464us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:44:28.002183 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:44:28.002201 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 04:44:28.002282 (+ 81us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:44:28.002288 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:44:28.003630 (+ 1342us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:44:28.003633 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:44:28.004752 (+ 1119us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:44:28.004761 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:44:28.005711 (+ 950us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:44:28.005715 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:44:28.006160 (+ 445us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:28.006211 (+ 51us) client_negotiation.cc:769] Sending connection context
0808 04:44:28.006285 (+ 74us) client_negotiation.cc:240] Negotiation successful
0808 04:44:28.006365 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1139,"mutex_wait_us":20,"thread_start_us":102,"threads_started":1}
I20260808 04:44:28.006763 10949 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:27.999856 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.195:38947 (local address 127.0.0.1:39682)
0808 04:44:28.000645 (+ 789us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:28.000660 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 04:44:28.000743 (+ 83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:44:28.001334 (+ 591us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:44:28.001340 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:44:28.001358 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 04:44:28.001531 (+ 173us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:44:28.001541 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:44:28.003000 (+ 1459us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:44:28.003004 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:44:28.004415 (+ 1411us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:44:28.004426 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:44:28.005847 (+ 1421us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:44:28.005857 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:44:28.006295 (+ 438us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:28.006322 (+ 27us) client_negotiation.cc:769] Sending connection context
0808 04:44:28.006406 (+ 84us) client_negotiation.cc:240] Negotiation successful
0808 04:44:28.006491 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":722,"mutex_wait_us":377,"thread_start_us":97,"threads_started":1}
I20260808 04:44:28.007184 10951 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:28.000577 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60742 (local address 127.20.240.193:35343)
0808 04:44:28.000960 (+ 383us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:28.000969 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:28.001751 (+ 782us) server_negotiation.cc:407] Connection header received
0808 04:44:28.001831 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:28.001836 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:28.002013 (+ 177us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:28.002160 (+ 147us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 04:44:28.002416 (+ 256us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:28.003497 (+ 1081us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:28.004881 (+ 1384us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:28.005559 (+ 678us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:28.005928 (+ 369us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:28.006096 (+ 168us) server_negotiation.cc:1035] Waiting for connection context
0808 04:44:28.006946 (+ 850us) server_negotiation.cc:299] Negotiation successful
0808 04:44:28.007050 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":267,"thread_start_us":89,"threads_started":1}
I20260808 04:44:28.007735 10948 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:28.000041 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39682 (local address 127.20.240.195:38947)
0808 04:44:28.000793 (+ 752us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:28.000811 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:28.000836 (+ 25us) server_negotiation.cc:407] Connection header received
0808 04:44:28.000914 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:28.000922 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:28.001141 (+ 219us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:28.001364 (+ 223us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 04:44:28.001670 (+ 306us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:28.002850 (+ 1180us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:28.004573 (+ 1723us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:28.005470 (+ 897us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:28.005580 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:28.005771 (+ 191us) server_negotiation.cc:1035] Waiting for connection context
0808 04:44:28.006616 (+ 845us) server_negotiation.cc:299] Negotiation successful
0808 04:44:28.006736 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":643,"thread_start_us":113,"threads_started":1}
I20260808 04:44:28.009985 10858 tablet_service.cc:1467] Processing CreateTablet for tablet 4d24d2547cf54584aeb455c80b9e026b (DEFAULT_TABLE table=test-table [id=9bb300825367497dae1151cb77323613]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 04:44:28.009948 10707 tablet_service.cc:1467] Processing CreateTablet for tablet 4d24d2547cf54584aeb455c80b9e026b (DEFAULT_TABLE table=test-table [id=9bb300825367497dae1151cb77323613]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 04:44:28.009948 10566 tablet_service.cc:1467] Processing CreateTablet for tablet 4d24d2547cf54584aeb455c80b9e026b (DEFAULT_TABLE table=test-table [id=9bb300825367497dae1151cb77323613]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 04:44:28.010988 10707 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4d24d2547cf54584aeb455c80b9e026b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:44:28.010988 10566 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4d24d2547cf54584aeb455c80b9e026b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:44:28.010994 10858 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4d24d2547cf54584aeb455c80b9e026b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:44:28.017879 10953 tablet_bootstrap.cc:492] T 4d24d2547cf54584aeb455c80b9e026b P 1760f15e916e4220aea491b7345bea2f: Bootstrap starting.
I20260808 04:44:28.019080 10955 tablet_bootstrap.cc:492] T 4d24d2547cf54584aeb455c80b9e026b P 84f8fbc54bd74709ac24567836ce2986: Bootstrap starting.
I20260808 04:44:28.020321 10953 tablet_bootstrap.cc:654] T 4d24d2547cf54584aeb455c80b9e026b P 1760f15e916e4220aea491b7345bea2f: Neither blocks nor log segments found. Creating new log.
I20260808 04:44:28.020788 10955 tablet_bootstrap.cc:654] T 4d24d2547cf54584aeb455c80b9e026b P 84f8fbc54bd74709ac24567836ce2986: Neither blocks nor log segments found. Creating new log.
I20260808 04:44:28.021142 10953 log.cc:824] T 4d24d2547cf54584aeb455c80b9e026b P 1760f15e916e4220aea491b7345bea2f: Log is configured to *not* fsync() on all Append() calls
I20260808 04:44:28.021538 10954 tablet_bootstrap.cc:492] T 4d24d2547cf54584aeb455c80b9e026b P 8c117d26fdb9455fbee81a5c19c96faa: Bootstrap starting.
I20260808 04:44:28.021627 10955 log.cc:824] T 4d24d2547cf54584aeb455c80b9e026b P 84f8fbc54bd74709ac24567836ce2986: Log is configured to *not* fsync() on all Append() calls
I20260808 04:44:28.023402 10954 tablet_bootstrap.cc:654] T 4d24d2547cf54584aeb455c80b9e026b P 8c117d26fdb9455fbee81a5c19c96faa: Neither blocks nor log segments found. Creating new log.
I20260808 04:44:28.023803 10955 tablet_bootstrap.cc:492] T 4d24d2547cf54584aeb455c80b9e026b P 84f8fbc54bd74709ac24567836ce2986: No bootstrap required, opened a new log
I20260808 04:44:28.023803 10953 tablet_bootstrap.cc:492] T 4d24d2547cf54584aeb455c80b9e026b P 1760f15e916e4220aea491b7345bea2f: No bootstrap required, opened a new log
I20260808 04:44:28.024010 10955 ts_tablet_manager.cc:1397] T 4d24d2547cf54584aeb455c80b9e026b P 84f8fbc54bd74709ac24567836ce2986: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260808 04:44:28.024010 10953 ts_tablet_manager.cc:1397] T 4d24d2547cf54584aeb455c80b9e026b P 1760f15e916e4220aea491b7345bea2f: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260808 04:44:28.024199 10954 log.cc:824] T 4d24d2547cf54584aeb455c80b9e026b P 8c117d26fdb9455fbee81a5c19c96faa: Log is configured to *not* fsync() on all Append() calls
I20260808 04:44:28.025985 10954 tablet_bootstrap.cc:492] T 4d24d2547cf54584aeb455c80b9e026b P 8c117d26fdb9455fbee81a5c19c96faa: No bootstrap required, opened a new log
I20260808 04:44:28.026201 10954 ts_tablet_manager.cc:1397] T 4d24d2547cf54584aeb455c80b9e026b P 8c117d26fdb9455fbee81a5c19c96faa: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260808 04:44:28.028538 10953 raft_consensus.cc:348] T 4d24d2547cf54584aeb455c80b9e026b P 1760f15e916e4220aea491b7345bea2f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c117d26fdb9455fbee81a5c19c96faa" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 32771 } } peers { permanent_uuid: "1760f15e916e4220aea491b7345bea2f" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 38947 } } peers { permanent_uuid: "84f8fbc54bd74709ac24567836ce2986" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 35343 } }
I20260808 04:44:28.028538 10955 raft_consensus.cc:348] T 4d24d2547cf54584aeb455c80b9e026b P 84f8fbc54bd74709ac24567836ce2986 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c117d26fdb9455fbee81a5c19c96faa" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 32771 } } peers { permanent_uuid: "1760f15e916e4220aea491b7345bea2f" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 38947 } } peers { permanent_uuid: "84f8fbc54bd74709ac24567836ce2986" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 35343 } }
I20260808 04:44:28.028824 10955 raft_consensus.cc:374] T 4d24d2547cf54584aeb455c80b9e026b P 84f8fbc54bd74709ac24567836ce2986 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:44:28.028824 10953 raft_consensus.cc:374] T 4d24d2547cf54584aeb455c80b9e026b P 1760f15e916e4220aea491b7345bea2f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:44:28.028879 10955 raft_consensus.cc:729] T 4d24d2547cf54584aeb455c80b9e026b P 84f8fbc54bd74709ac24567836ce2986 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 84f8fbc54bd74709ac24567836ce2986, State: Initialized, Role: FOLLOWER
I20260808 04:44:28.028895 10953 raft_consensus.cc:729] T 4d24d2547cf54584aeb455c80b9e026b P 1760f15e916e4220aea491b7345bea2f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1760f15e916e4220aea491b7345bea2f, State: Initialized, Role: FOLLOWER
I20260808 04:44:28.029458 10955 consensus_queue.cc:260] T 4d24d2547cf54584aeb455c80b9e026b P 84f8fbc54bd74709ac24567836ce2986 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c117d26fdb9455fbee81a5c19c96faa" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 32771 } } peers { permanent_uuid: "1760f15e916e4220aea491b7345bea2f" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 38947 } } peers { permanent_uuid: "84f8fbc54bd74709ac24567836ce2986" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 35343 } }
I20260808 04:44:28.029676 10953 consensus_queue.cc:260] T 4d24d2547cf54584aeb455c80b9e026b P 1760f15e916e4220aea491b7345bea2f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c117d26fdb9455fbee81a5c19c96faa" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 32771 } } peers { permanent_uuid: "1760f15e916e4220aea491b7345bea2f" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 38947 } } peers { permanent_uuid: "84f8fbc54bd74709ac24567836ce2986" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 35343 } }
I20260808 04:44:28.029681 10954 raft_consensus.cc:348] T 4d24d2547cf54584aeb455c80b9e026b P 8c117d26fdb9455fbee81a5c19c96faa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c117d26fdb9455fbee81a5c19c96faa" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 32771 } } peers { permanent_uuid: "1760f15e916e4220aea491b7345bea2f" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 38947 } } peers { permanent_uuid: "84f8fbc54bd74709ac24567836ce2986" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 35343 } }
I20260808 04:44:28.030028 10954 raft_consensus.cc:374] T 4d24d2547cf54584aeb455c80b9e026b P 8c117d26fdb9455fbee81a5c19c96faa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:44:28.030092 10954 raft_consensus.cc:729] T 4d24d2547cf54584aeb455c80b9e026b P 8c117d26fdb9455fbee81a5c19c96faa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c117d26fdb9455fbee81a5c19c96faa, State: Initialized, Role: FOLLOWER
I20260808 04:44:28.030423 10637 heartbeater.cc:503] Master 127.20.240.254:45895 was elected leader, sending a full tablet report...
I20260808 04:44:28.030558 10953 ts_tablet_manager.cc:1428] T 4d24d2547cf54584aeb455c80b9e026b P 1760f15e916e4220aea491b7345bea2f: Time spent starting tablet: real 0.006s user 0.008s sys 0.000s
I20260808 04:44:28.030717 10932 heartbeater.cc:503] Master 127.20.240.254:45895 was elected leader, sending a full tablet report...
I20260808 04:44:28.030558 10955 ts_tablet_manager.cc:1428] T 4d24d2547cf54584aeb455c80b9e026b P 84f8fbc54bd74709ac24567836ce2986: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260808 04:44:28.031637 10954 consensus_queue.cc:260] T 4d24d2547cf54584aeb455c80b9e026b P 8c117d26fdb9455fbee81a5c19c96faa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c117d26fdb9455fbee81a5c19c96faa" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 32771 } } peers { permanent_uuid: "1760f15e916e4220aea491b7345bea2f" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 38947 } } peers { permanent_uuid: "84f8fbc54bd74709ac24567836ce2986" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 35343 } }
I20260808 04:44:28.032524 10954 ts_tablet_manager.cc:1428] T 4d24d2547cf54584aeb455c80b9e026b P 8c117d26fdb9455fbee81a5c19c96faa: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260808 04:44:28.032876 10785 heartbeater.cc:503] Master 127.20.240.254:45895 was elected leader, sending a full tablet report...
W20260808 04:44:28.034204 10638 tablet.cc:2369] T 4d24d2547cf54584aeb455c80b9e026b P 84f8fbc54bd74709ac24567836ce2986: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 04:44:28.078660 10960 raft_consensus.cc:482] T 4d24d2547cf54584aeb455c80b9e026b P 84f8fbc54bd74709ac24567836ce2986 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 04:44:28.078882 10960 raft_consensus.cc:504] T 4d24d2547cf54584aeb455c80b9e026b P 84f8fbc54bd74709ac24567836ce2986 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c117d26fdb9455fbee81a5c19c96faa" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 32771 } } peers { permanent_uuid: "1760f15e916e4220aea491b7345bea2f" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 38947 } } peers { permanent_uuid: "84f8fbc54bd74709ac24567836ce2986" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 35343 } }
I20260808 04:44:28.080155 10960 leader_election.cc:288] T 4d24d2547cf54584aeb455c80b9e026b P 84f8fbc54bd74709ac24567836ce2986 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8c117d26fdb9455fbee81a5c19c96faa (127.20.240.194:32771), 1760f15e916e4220aea491b7345bea2f (127.20.240.195:38947)
I20260808 04:44:28.084194 10950 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:28.080680 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.240.193:34255 (local address 127.20.240.194:32771)
0808 04:44:28.080805 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:28.080810 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:28.080962 (+ 152us) server_negotiation.cc:407] Connection header received
0808 04:44:28.081070 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:28.081073 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:28.081125 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:28.081232 (+ 107us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 04:44:28.081533 (+ 301us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:28.082049 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:28.083219 (+ 1170us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:28.083610 (+ 391us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:28.083739 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:28.083789 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0808 04:44:28.083985 (+ 196us) server_negotiation.cc:299] Negotiation successful
0808 04:44:28.084057 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260808 04:44:28.084211 10948 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:28.080562 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.240.193:50231 (local address 127.20.240.195:38947)
0808 04:44:28.080727 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:28.080734 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:28.081108 (+ 374us) server_negotiation.cc:407] Connection header received
0808 04:44:28.081238 (+ 130us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:28.081241 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:28.081284 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:28.081377 (+ 93us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 04:44:28.081675 (+ 298us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:28.082173 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:28.083241 (+ 1068us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:28.083638 (+ 397us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:28.083767 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:28.083823 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0808 04:44:28.084009 (+ 186us) server_negotiation.cc:299] Negotiation successful
0808 04:44:28.084083 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260808 04:44:28.084244 10964 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:28.080457 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.195:38947 (local address 127.20.240.193:50231)
0808 04:44:28.080962 (+ 505us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:28.080978 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 04:44:28.081104 (+ 126us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:44:28.081385 (+ 281us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:44:28.081388 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:44:28.081405 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 04:44:28.081551 (+ 146us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:44:28.081557 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:44:28.082301 (+ 744us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:44:28.082305 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:44:28.083106 (+ 801us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:44:28.083115 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:44:28.083764 (+ 649us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:44:28.083768 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:44:28.083867 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:28.083894 (+ 27us) client_negotiation.cc:769] Sending connection context
0808 04:44:28.083984 (+ 90us) client_negotiation.cc:240] Negotiation successful
0808 04:44:28.084063 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":414,"mutex_wait_us":139,"thread_start_us":116,"threads_started":1}
I20260808 04:44:28.084254 10963 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:28.080457 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.194:32771 (local address 127.20.240.193:34255)
0808 04:44:28.080845 (+ 388us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:28.080862 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 04:44:28.080982 (+ 120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:44:28.081263 (+ 281us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:44:28.081266 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:44:28.081280 (+ 14us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 04:44:28.081417 (+ 137us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:44:28.081423 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:44:28.082166 (+ 743us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:44:28.082176 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:44:28.083090 (+ 914us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:44:28.083099 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:44:28.083736 (+ 637us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:44:28.083740 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:44:28.083836 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:28.083870 (+ 34us) client_negotiation.cc:769] Sending connection context
0808 04:44:28.083956 (+ 86us) client_negotiation.cc:240] Negotiation successful
0808 04:44:28.084039 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":312,"mutex_wait_us":62,"thread_start_us":99,"threads_started":1}
I20260808 04:44:28.084918 10731 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d24d2547cf54584aeb455c80b9e026b" candidate_uuid: "84f8fbc54bd74709ac24567836ce2986" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c117d26fdb9455fbee81a5c19c96faa" is_pre_election: true
I20260808 04:44:28.084929 10881 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d24d2547cf54584aeb455c80b9e026b" candidate_uuid: "84f8fbc54bd74709ac24567836ce2986" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1760f15e916e4220aea491b7345bea2f" is_pre_election: true
I20260808 04:44:28.085256 10731 raft_consensus.cc:2454] T 4d24d2547cf54584aeb455c80b9e026b P 8c117d26fdb9455fbee81a5c19c96faa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 84f8fbc54bd74709ac24567836ce2986 in term 0.
I20260808 04:44:28.085255 10881 raft_consensus.cc:2454] T 4d24d2547cf54584aeb455c80b9e026b P 1760f15e916e4220aea491b7345bea2f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 84f8fbc54bd74709ac24567836ce2986 in term 0.
I20260808 04:44:28.085728 10519 leader_election.cc:302] T 4d24d2547cf54584aeb455c80b9e026b P 84f8fbc54bd74709ac24567836ce2986 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 84f8fbc54bd74709ac24567836ce2986, 8c117d26fdb9455fbee81a5c19c96faa; no voters:
I20260808 04:44:28.086062 10960 raft_consensus.cc:2781] T 4d24d2547cf54584aeb455c80b9e026b P 84f8fbc54bd74709ac24567836ce2986 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 04:44:28.086154 10960 raft_consensus.cc:482] T 4d24d2547cf54584aeb455c80b9e026b P 84f8fbc54bd74709ac24567836ce2986 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 04:44:28.086198 10960 raft_consensus.cc:3037] T 4d24d2547cf54584aeb455c80b9e026b P 84f8fbc54bd74709ac24567836ce2986 [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:44:28.087247 10960 raft_consensus.cc:504] T 4d24d2547cf54584aeb455c80b9e026b P 84f8fbc54bd74709ac24567836ce2986 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c117d26fdb9455fbee81a5c19c96faa" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 32771 } } peers { permanent_uuid: "1760f15e916e4220aea491b7345bea2f" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 38947 } } peers { permanent_uuid: "84f8fbc54bd74709ac24567836ce2986" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 35343 } }
I20260808 04:44:28.087608 10960 leader_election.cc:288] T 4d24d2547cf54584aeb455c80b9e026b P 84f8fbc54bd74709ac24567836ce2986 [CANDIDATE]: Term 1 election: Requested vote from peers 8c117d26fdb9455fbee81a5c19c96faa (127.20.240.194:32771), 1760f15e916e4220aea491b7345bea2f (127.20.240.195:38947)
I20260808 04:44:28.087963 10731 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d24d2547cf54584aeb455c80b9e026b" candidate_uuid: "84f8fbc54bd74709ac24567836ce2986" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c117d26fdb9455fbee81a5c19c96faa"
I20260808 04:44:28.087992 10881 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d24d2547cf54584aeb455c80b9e026b" candidate_uuid: "84f8fbc54bd74709ac24567836ce2986" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1760f15e916e4220aea491b7345bea2f"
I20260808 04:44:28.088110 10731 raft_consensus.cc:3037] T 4d24d2547cf54584aeb455c80b9e026b P 8c117d26fdb9455fbee81a5c19c96faa [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:44:28.088143 10881 raft_consensus.cc:3037] T 4d24d2547cf54584aeb455c80b9e026b P 1760f15e916e4220aea491b7345bea2f [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:44:28.089208 10881 raft_consensus.cc:2454] T 4d24d2547cf54584aeb455c80b9e026b P 1760f15e916e4220aea491b7345bea2f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 84f8fbc54bd74709ac24567836ce2986 in term 1.
I20260808 04:44:28.089248 10731 raft_consensus.cc:2454] T 4d24d2547cf54584aeb455c80b9e026b P 8c117d26fdb9455fbee81a5c19c96faa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 84f8fbc54bd74709ac24567836ce2986 in term 1.
I20260808 04:44:28.089545 10518 leader_election.cc:302] T 4d24d2547cf54584aeb455c80b9e026b P 84f8fbc54bd74709ac24567836ce2986 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1760f15e916e4220aea491b7345bea2f, 84f8fbc54bd74709ac24567836ce2986; no voters:
I20260808 04:44:28.089752 10960 raft_consensus.cc:2781] T 4d24d2547cf54584aeb455c80b9e026b P 84f8fbc54bd74709ac24567836ce2986 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 04:44:28.089942 10960 raft_consensus.cc:686] T 4d24d2547cf54584aeb455c80b9e026b P 84f8fbc54bd74709ac24567836ce2986 [term 1 LEADER]: Becoming Leader. State: Replica: 84f8fbc54bd74709ac24567836ce2986, State: Running, Role: LEADER
I20260808 04:44:28.090294 10960 consensus_queue.cc:237] T 4d24d2547cf54584aeb455c80b9e026b P 84f8fbc54bd74709ac24567836ce2986 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c117d26fdb9455fbee81a5c19c96faa" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 32771 } } peers { permanent_uuid: "1760f15e916e4220aea491b7345bea2f" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 38947 } } peers { permanent_uuid: "84f8fbc54bd74709ac24567836ce2986" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 35343 } }
I20260808 04:44:28.093735 10432 catalog_manager.cc:5495] T 4d24d2547cf54584aeb455c80b9e026b P 84f8fbc54bd74709ac24567836ce2986 reported cstate change: term changed from 0 to 1, leader changed from <none> to 84f8fbc54bd74709ac24567836ce2986 (127.20.240.193). New cstate: current_term: 1 leader_uuid: "84f8fbc54bd74709ac24567836ce2986" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c117d26fdb9455fbee81a5c19c96faa" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 32771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1760f15e916e4220aea491b7345bea2f" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 38947 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "84f8fbc54bd74709ac24567836ce2986" member_type: VOTER last_known_addr { host: "127.20.240.193" port: 35343 } health_report { overall_health: HEALTHY } } }
I20260808 04:44:28.105641 10951 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:28.101812 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60750 (local address 127.20.240.193:35343)
0808 04:44:28.101953 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:28.101958 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:28.102001 (+ 43us) server_negotiation.cc:407] Connection header received
0808 04:44:28.102205 (+ 204us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:28.102207 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:28.102266 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:28.102399 (+ 133us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 04:44:28.102649 (+ 250us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:28.103154 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:28.104034 (+ 880us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:28.104248 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:28.104363 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:28.104761 (+ 398us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 04:44:28.105279 (+ 518us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 04:44:28.105379 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0808 04:44:28.105474 (+ 95us) server_negotiation.cc:299] Negotiation successful
0808 04:44:28.105530 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260808 04:44:28.112242 10881 raft_consensus.cc:1261] T 4d24d2547cf54584aeb455c80b9e026b P 1760f15e916e4220aea491b7345bea2f [term 1 FOLLOWER]: Refusing update from remote peer 84f8fbc54bd74709ac24567836ce2986: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 04:44:28.112242 10731 raft_consensus.cc:1261] T 4d24d2547cf54584aeb455c80b9e026b P 8c117d26fdb9455fbee81a5c19c96faa [term 1 FOLLOWER]: Refusing update from remote peer 84f8fbc54bd74709ac24567836ce2986: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 04:44:28.113073 10960 consensus_queue.cc:1035] T 4d24d2547cf54584aeb455c80b9e026b P 84f8fbc54bd74709ac24567836ce2986 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1760f15e916e4220aea491b7345bea2f" member_type: VOTER last_known_addr { host: "127.20.240.195" port: 38947 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 04:44:28.113334 10965 consensus_queue.cc:1035] T 4d24d2547cf54584aeb455c80b9e026b P 84f8fbc54bd74709ac24567836ce2986 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c117d26fdb9455fbee81a5c19c96faa" member_type: VOTER last_known_addr { host: "127.20.240.194" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 04:44:28.120488 10968 mvcc.cc:205] Tried to move back new op lower bound from 7316128842179035136 to 7316128842100621312. Current Snapshot: MvccSnapshot[applied={T|T < 7316128842179035136}]
I20260808 04:44:28.121658 10970 mvcc.cc:205] Tried to move back new op lower bound from 7316128842179035136 to 7316128842100621312. Current Snapshot: MvccSnapshot[applied={T|T < 7316128842179035136}]
I20260808 04:44:28.123664 10969 mvcc.cc:205] Tried to move back new op lower bound from 7316128842179035136 to 7316128842100621312. Current Snapshot: MvccSnapshot[applied={T|T < 7316128842179035136}]
I20260808 04:44:28.128966 10431 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:34110:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 04:44:28.129187 10431 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:34110:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 04:44:28.132148 10431 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 8e5b6a858e2b408d9dc6c359bfdc8ccf: Sending DeleteTablet for 3 replicas of tablet 4d24d2547cf54584aeb455c80b9e026b
I20260808 04:44:28.133062 10858 tablet_service.cc:1514] Processing DeleteTablet for tablet 4d24d2547cf54584aeb455c80b9e026b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 04:44:28 UTC) from {username='slave'} at 127.0.0.1:39682
I20260808 04:44:28.133059 10707 tablet_service.cc:1514] Processing DeleteTablet for tablet 4d24d2547cf54584aeb455c80b9e026b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 04:44:28 UTC) from {username='slave'} at 127.0.0.1:39884
I20260808 04:44:28.133127 10566 tablet_service.cc:1514] Processing DeleteTablet for tablet 4d24d2547cf54584aeb455c80b9e026b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 04:44:28 UTC) from {username='slave'} at 127.0.0.1:60742
I20260808 04:44:28.133623 10979 tablet_replica.cc:330] T 4d24d2547cf54584aeb455c80b9e026b P 1760f15e916e4220aea491b7345bea2f: stopping tablet replica
I20260808 04:44:28.133980 10979 raft_consensus.cc:2229] T 4d24d2547cf54584aeb455c80b9e026b P 1760f15e916e4220aea491b7345bea2f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 04:44:28.134300 21443 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu with pid 10500
I20260808 04:44:28.134311 10979 raft_consensus.cc:2258] T 4d24d2547cf54584aeb455c80b9e026b P 1760f15e916e4220aea491b7345bea2f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 04:44:28.137221 10978 tablet_replica.cc:330] T 4d24d2547cf54584aeb455c80b9e026b P 8c117d26fdb9455fbee81a5c19c96faa: stopping tablet replica
I20260808 04:44:28.137571 10978 raft_consensus.cc:2229] T 4d24d2547cf54584aeb455c80b9e026b P 8c117d26fdb9455fbee81a5c19c96faa [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 04:44:28.137902 10978 raft_consensus.cc:2258] T 4d24d2547cf54584aeb455c80b9e026b P 8c117d26fdb9455fbee81a5c19c96faa [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 04:44:28.138636 10979 ts_tablet_manager.cc:1905] T 4d24d2547cf54584aeb455c80b9e026b P 1760f15e916e4220aea491b7345bea2f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 04:44:28.139142 10978 ts_tablet_manager.cc:1905] T 4d24d2547cf54584aeb455c80b9e026b P 8c117d26fdb9455fbee81a5c19c96faa: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 04:44:28.141324 10978 ts_tablet_manager.cc:1918] T 4d24d2547cf54584aeb455c80b9e026b P 8c117d26fdb9455fbee81a5c19c96faa: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 04:44:28.141526 10978 log.cc:1196] T 4d24d2547cf54584aeb455c80b9e026b P 8c117d26fdb9455fbee81a5c19c96faa: Deleting WAL directory at /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786164000593138-21443-0/minicluster-data/ts-1/wal/wals/4d24d2547cf54584aeb455c80b9e026b
I20260808 04:44:28.141867 10978 ts_tablet_manager.cc:1939] T 4d24d2547cf54584aeb455c80b9e026b P 8c117d26fdb9455fbee81a5c19c96faa: Deleting consensus metadata
I20260808 04:44:28.142204 10979 ts_tablet_manager.cc:1918] T 4d24d2547cf54584aeb455c80b9e026b P 1760f15e916e4220aea491b7345bea2f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 04:44:28.142318 10979 log.cc:1196] T 4d24d2547cf54584aeb455c80b9e026b P 1760f15e916e4220aea491b7345bea2f: Deleting WAL directory at /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786164000593138-21443-0/minicluster-data/ts-2/wal/wals/4d24d2547cf54584aeb455c80b9e026b
I20260808 04:44:28.142638 10979 ts_tablet_manager.cc:1939] T 4d24d2547cf54584aeb455c80b9e026b P 1760f15e916e4220aea491b7345bea2f: Deleting consensus metadata
I20260808 04:44:28.143153 10418 catalog_manager.cc:4841] TS 8c117d26fdb9455fbee81a5c19c96faa (127.20.240.194:32771): tablet 4d24d2547cf54584aeb455c80b9e026b (table test-table [id=9bb300825367497dae1151cb77323613]) successfully deleted
W20260808 04:44:28.143590 10416 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.20.240.193:35343 (error 108)
I20260808 04:44:28.143786 10417 catalog_manager.cc:4841] TS 1760f15e916e4220aea491b7345bea2f (127.20.240.195:38947): tablet 4d24d2547cf54584aeb455c80b9e026b (table test-table [id=9bb300825367497dae1151cb77323613]) successfully deleted
I20260808 04:44:28.144485 21443 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu with pid 10641
I20260808 04:44:28.144742 10949 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:28.144403 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.193:35343 (local address 127.0.0.1:60760)
0808 04:44:28.144554 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:28.144637 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.240.193:35343: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
W20260808 04:44:28.147361 10416 catalog_manager.cc:4584] TS 84f8fbc54bd74709ac24567836ce2986 (127.20.240.193:35343): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 4d24d2547cf54584aeb455c80b9e026b: Network error: Client connection negotiation failed: client connection to 127.20.240.193:35343: connect: Connection refused (error 111)
I20260808 04:44:28.153324 21443 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu with pid 10788
I20260808 04:44:28.160741 21443 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu with pid 10397
2026-08-08T04:44:28Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/5 (1123 ms)
[----------] 6 tests from EncryptionPolicyTest (11488 ms total)
[----------] 18 tests from AuthTokenIssuingTest
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/0
Loading random data
Initializing database '/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786164000593138-21443-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 04:44:28 dist-test-slave-vxj2 krb5kdc[10984](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 04:44:28 dist-test-slave-vxj2 krb5kdc[10984](info): set up 2 sockets
Aug 08 04:44:28 dist-test-slave-vxj2 krb5kdc[10984](info): commencing operation
krb5kdc: starting...
W20260808 04:44:29.271929 21443 mini_kdc.cc:121] Time spent starting KDC: real 1.087s user 0.007s sys 0.000s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786164000593138-21443-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786164000593138-21443-0/krb5kdc/test-user.keytab.
Aug 08 04:44:29 dist-test-slave-vxj2 krb5kdc[10984](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164269, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T04:44:29Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T04:44:29Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786164000593138-21443-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786164000593138-21443-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 04:44:29.408725 21443 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
/tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786164000593138-21443-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786164000593138-21443-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786164000593138-21443-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786164000593138-21443-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37661
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786164000593138-21443-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:32811
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:37661
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786164000593138-21443-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786164000593138-21443-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786164000593138-21443-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 04:44:29.524578 10997 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:44:29.524963 10997 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:44:29.525056 10997 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:44:29.529348 10997 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 04:44:29.529477 10997 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:44:29.529517 10997 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:44:29.529559 10997 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 04:44:29.529592 10997 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 04:44:29.535216 10997 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:32811
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786164000593138-21443-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786164000593138-21443-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:37661
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786164000593138-21443-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37661
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786164000593138-21443-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10997
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786164000593138-21443-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 04:05:18 UTC on ccycloud.quasar-drfdgt.root.comops.site
build id 4574101
I20260808 04:44:29.536463 10997 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:44:29.537603 10997 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:44:29.546748 11003 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:44:29.546923 11005 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:44:29.547067 10997 server_base.cc:1034] running on GCE node
W20260808 04:44:29.546931 11002 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:44:29.547829 10997 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:44:29.549057 10997 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:44:29.550253 10997 hybrid_clock.cc:648] HybridClock initialized: now 1786164269550228 us; error 34 us; skew 500 ppm
Aug 08 04:44:29 dist-test-slave-vxj2 krb5kdc[10984](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164269, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:44:29.553414 10997 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 04:44:29.554467 10997 webserver.cc:460] Webserver started at http://127.0.0.1:45591/ using document root <none> and password file <none>
I20260808 04:44:29.555083 10997 fs_manager.cc:359] Metadata directory not provided
I20260808 04:44:29.555184 10997 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:44:29.555475 10997 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 04:44:29.557824 10997 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786164000593138-21443-0/minicluster-data/master-0/data/instance:
uuid: "fe705504fbca4bdba8dd33bb5f8720a6"
format_stamp: "Formatted at 2026-08-08 04:44:29 on dist-test-slave-vxj2"
server_key: "b5e9e47ea2c7a9308568ff0f2749eb80"
server_key_iv: "eee52312921e23600911588ffbe2de2c"
server_key_version: "encryptionkey@0"
I20260808 04:44:29.558498 10997 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786164000593138-21443-0/minicluster-data/master-0/wal/instance:
uuid: "fe705504fbca4bdba8dd33bb5f8720a6"
format_stamp: "Formatted at 2026-08-08 04:44:29 on dist-test-slave-vxj2"
server_key: "b5e9e47ea2c7a9308568ff0f2749eb80"
server_key_iv: "eee52312921e23600911588ffbe2de2c"
server_key_version: "encryptionkey@0"
I20260808 04:44:29.562763 10997 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260808 04:44:29.565487 11012 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:44:29.566781 10997 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260808 04:44:29.566977 10997 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786164000593138-21443-0/minicluster-data/master-0/data,/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786164000593138-21443-0/minicluster-data/master-0/wal
uuid: "fe705504fbca4bdba8dd33bb5f8720a6"
format_stamp: "Formatted at 2026-08-08 04:44:29 on dist-test-slave-vxj2"
server_key: "b5e9e47ea2c7a9308568ff0f2749eb80"
server_key_iv: "eee52312921e23600911588ffbe2de2c"
server_key_version: "encryptionkey@0"
I20260808 04:44:29.567106 10997 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786164000593138-21443-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786164000593138-21443-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786164000593138-21443-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:44:29.586069 10997 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:44:29.589520 10997 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:44:29.589737 10997 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:44:29.597735 10997 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:37661
I20260808 04:44:29.597765 11071 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:37661 every 8 connection(s)
I20260808 04:44:29.599115 10997 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786164000593138-21443-0/minicluster-data/master-0/data/info.pb
I20260808 04:44:29.602193 11072 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:44:29.606379 21443 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu as pid 10997
I20260808 04:44:29.606573 21443 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786164000593138-21443-0/minicluster-data/master-0/wal/instance
I20260808 04:44:29.606869 21443 external_mini_cluster.cc:1428] Setting key 9fc3ce5488ed831aaf42d5250d63c1aa
I20260808 04:44:29.608472 11072 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fe705504fbca4bdba8dd33bb5f8720a6: Bootstrap starting.
I20260808 04:44:29.611346 11072 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P fe705504fbca4bdba8dd33bb5f8720a6: Neither blocks nor log segments found. Creating new log.
I20260808 04:44:29.612483 11072 log.cc:824] T 00000000000000000000000000000000 P fe705504fbca4bdba8dd33bb5f8720a6: Log is configured to *not* fsync() on all Append() calls
I20260808 04:44:29.614773 11072 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fe705504fbca4bdba8dd33bb5f8720a6: No bootstrap required, opened a new log
Aug 08 04:44:29 dist-test-slave-vxj2 krb5kdc[10984](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164269, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260808 04:44:29.619200 11072 raft_consensus.cc:348] T 00000000000000000000000000000000 P fe705504fbca4bdba8dd33bb5f8720a6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fe705504fbca4bdba8dd33bb5f8720a6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37661 } }
I20260808 04:44:29.619527 11072 raft_consensus.cc:374] T 00000000000000000000000000000000 P fe705504fbca4bdba8dd33bb5f8720a6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:44:29.619601 11072 raft_consensus.cc:729] T 00000000000000000000000000000000 P fe705504fbca4bdba8dd33bb5f8720a6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe705504fbca4bdba8dd33bb5f8720a6, State: Initialized, Role: FOLLOWER
I20260808 04:44:29.620131 11072 consensus_queue.cc:260] T 00000000000000000000000000000000 P fe705504fbca4bdba8dd33bb5f8720a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fe705504fbca4bdba8dd33bb5f8720a6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37661 } }
I20260808 04:44:29.620292 11072 raft_consensus.cc:388] T 00000000000000000000000000000000 P fe705504fbca4bdba8dd33bb5f8720a6 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 04:44:29.620371 11072 raft_consensus.cc:482] T 00000000000000000000000000000000 P fe705504fbca4bdba8dd33bb5f8720a6 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 04:44:29.620483 11072 raft_consensus.cc:3037] T 00000000000000000000000000000000 P fe705504fbca4bdba8dd33bb5f8720a6 [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:44:29.621814 11072 raft_consensus.cc:504] T 00000000000000000000000000000000 P fe705504fbca4bdba8dd33bb5f8720a6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fe705504fbca4bdba8dd33bb5f8720a6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37661 } }
I20260808 04:44:29.622238 11072 leader_election.cc:302] T 00000000000000000000000000000000 P fe705504fbca4bdba8dd33bb5f8720a6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: fe705504fbca4bdba8dd33bb5f8720a6; no voters:
I20260808 04:44:29.622639 11072 leader_election.cc:288] T 00000000000000000000000000000000 P fe705504fbca4bdba8dd33bb5f8720a6 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 04:44:29.622823 11077 raft_consensus.cc:2781] T 00000000000000000000000000000000 P fe705504fbca4bdba8dd33bb5f8720a6 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 04:44:29.623143 11077 raft_consensus.cc:686] T 00000000000000000000000000000000 P fe705504fbca4bdba8dd33bb5f8720a6 [term 1 LEADER]: Becoming Leader. State: Replica: fe705504fbca4bdba8dd33bb5f8720a6, State: Running, Role: LEADER
I20260808 04:44:29.623374 11075 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:29.608502 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58277 (local address 127.0.0.1:37661)
0808 04:44:29.608987 (+ 485us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:29.609007 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:29.609050 (+ 43us) server_negotiation.cc:407] Connection header received
0808 04:44:29.609994 (+ 944us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:29.610018 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:29.610463 (+ 445us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:29.610823 (+ 360us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:44:29.611611 (+ 788us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:29.613092 (+ 1481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:29.614080 (+ 988us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:29.614765 (+ 685us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:29.614944 (+ 179us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:29.617650 (+ 2706us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:44:29.617657 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:44:29.617678 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:44:29.617712 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:44:29.619792 (+ 2080us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:44:29.620373 (+ 581us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:44:29.620381 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:44:29.620390 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:44:29.620551 (+ 161us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:44:29.620885 (+ 334us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:44:29.620888 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:44:29.620890 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:44:29.621479 (+ 589us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:44:29.621705 (+ 226us) server_negotiation.cc:1035] Waiting for connection context
0808 04:44:29.622093 (+ 388us) server_negotiation.cc:299] Negotiation successful
0808 04:44:29.622333 (+ 240us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":339,"thread_start_us":142,"threads_started":1}
I20260808 04:44:29.623538 11077 consensus_queue.cc:237] T 00000000000000000000000000000000 P fe705504fbca4bdba8dd33bb5f8720a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fe705504fbca4bdba8dd33bb5f8720a6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37661 } }
I20260808 04:44:29.624008 11072 sys_catalog.cc:564] T 00000000000000000000000000000000 P fe705504fbca4bdba8dd33bb5f8720a6 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 04:44:29.624862 11077 sys_catalog.cc:455] T 00000000000000000000000000000000 P fe705504fbca4bdba8dd33bb5f8720a6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader fe705504fbca4bdba8dd33bb5f8720a6. Latest consensus state: current_term: 1 leader_uuid: "fe705504fbca4bdba8dd33bb5f8720a6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fe705504fbca4bdba8dd33bb5f8720a6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37661 } } }
I20260808 04:44:29.624991 11077 sys_catalog.cc:458] T 00000000000000000000000000000000 P fe705504fbca4bdba8dd33bb5f8720a6 [sys.catalog]: This master's current role is: LEADER
I20260808 04:44:29.625896 11079 sys_catalog.cc:455] T 00000000000000000000000000000000 P fe705504fbca4bdba8dd33bb5f8720a6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "fe705504fbca4bdba8dd33bb5f8720a6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fe705504fbca4bdba8dd33bb5f8720a6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37661 } } }
I20260808 04:44:29.626035 11079 sys_catalog.cc:458] T 00000000000000000000000000000000 P fe705504fbca4bdba8dd33bb5f8720a6 [sys.catalog]: This master's current role is: LEADER
I20260808 04:44:29.628633 21443 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
W20260808 04:44:29.630112 11092 catalog_manager.cc:1558] T 00000000000000000000000000000000 P fe705504fbca4bdba8dd33bb5f8720a6: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 04:44:29.630211 11092 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 04:44:29.630309 11086 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 04:44:29.631312 11086 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 04:44:29.638041 11086 catalog_manager.cc:1347] Generated new cluster ID: e384f47d6ca8409faf1d844867d3488c
I20260808 04:44:29.638123 11086 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 04:44:29.640062 11075 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:29.630812 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59413 (local address 127.0.0.1:37661)
0808 04:44:29.630951 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:29.630956 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:29.631242 (+ 286us) server_negotiation.cc:407] Connection header received
0808 04:44:29.631395 (+ 153us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:29.631400 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:29.631463 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:29.631558 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:44:29.632265 (+ 707us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:29.632795 (+ 530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:29.633692 (+ 897us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:29.633953 (+ 261us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:29.634067 (+ 114us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:29.635901 (+ 1834us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:44:29.635906 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:44:29.635909 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:44:29.635937 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:44:29.637877 (+ 1940us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:44:29.638491 (+ 614us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:44:29.638495 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:44:29.638497 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:44:29.638611 (+ 114us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:44:29.639020 (+ 409us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:44:29.639024 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:44:29.639026 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:44:29.639291 (+ 265us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:44:29.639437 (+ 146us) server_negotiation.cc:1035] Waiting for connection context
0808 04:44:29.639776 (+ 339us) server_negotiation.cc:299] Negotiation successful
0808 04:44:29.639897 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260808 04:44:29.659725 11086 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 04:44:29.661041 11086 catalog_manager.cc:1504] Loading token signing keys...
I20260808 04:44:29.668740 11086 catalog_manager.cc:5868] T 00000000000000000000000000000000 P fe705504fbca4bdba8dd33bb5f8720a6: Generated new TSK 0
I20260808 04:44:29.669658 11086 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 04:44:29.680294 21443 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu with pid 10997
W20260808 04:44:29.687691 10982 connection.cc:535] client connection to 127.0.0.1:37661 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:37661): Connection reset by peer (error 104)
2026-08-08T04:44:29Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/0 (1517 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/1
Loading random data
Initializing database '/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786164000593138-21443-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 04:44:29 dist-test-slave-vxj2 krb5kdc[11104](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 04:44:29 dist-test-slave-vxj2 krb5kdc[11104](info): set up 2 sockets
Aug 08 04:44:29 dist-test-slave-vxj2 krb5kdc[11104](info): commencing operation
krb5kdc: starting...
W20260808 04:44:30.768800 21443 mini_kdc.cc:121] Time spent starting KDC: real 1.066s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786164000593138-21443-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786164000593138-21443-0/krb5kdc/test-user.keytab.
Aug 08 04:44:30 dist-test-slave-vxj2 krb5kdc[11104](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164270, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T04:44:30Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T04:44:30Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786164000593138-21443-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786164000593138-21443-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 04:44:30.904747 21443 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
/tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786164000593138-21443-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786164000593138-21443-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786164000593138-21443-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786164000593138-21443-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37741
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786164000593138-21443-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:36477
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:37741
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786164000593138-21443-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786164000593138-21443-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786164000593138-21443-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 04:44:31.020815 11120 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:44:31.021163 11120 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:44:31.021296 11120 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:44:31.025602 11120 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 04:44:31.025694 11120 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:44:31.025730 11120 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:44:31.025789 11120 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 04:44:31.025844 11120 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 04:44:31.031615 11120 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:36477
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786164000593138-21443-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786164000593138-21443-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:37741
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786164000593138-21443-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37741
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786164000593138-21443-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11120
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786164000593138-21443-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 04:05:18 UTC on ccycloud.quasar-drfdgt.root.comops.site
build id 4574101
I20260808 04:44:31.032845 11120 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:44:31.034018 11120 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260808 04:44:31.042968 11120 server_base.cc:1034] running on GCE node
W20260808 04:44:31.042992 11128 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:44:31.042915 11125 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:44:31.042915 11126 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:44:31.043738 11120 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:44:31.044946 11120 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:44:31.046150 11120 hybrid_clock.cc:648] HybridClock initialized: now 1786164271046143 us; error 60 us; skew 500 ppm
Aug 08 04:44:31 dist-test-slave-vxj2 krb5kdc[11104](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164271, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:44:31.049451 11120 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 04:44:31.050483 11120 webserver.cc:460] Webserver started at http://127.0.0.1:40327/ using document root <none> and password file <none>
I20260808 04:44:31.051087 11120 fs_manager.cc:359] Metadata directory not provided
I20260808 04:44:31.051154 11120 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:44:31.051385 11120 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 04:44:31.053637 11120 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786164000593138-21443-0/minicluster-data/master-0/data/instance:
uuid: "2947f891a30246a59faa3e030f19bda9"
format_stamp: "Formatted at 2026-08-08 04:44:31 on dist-test-slave-vxj2"
server_key: "8458e662b2d0833c46988a2c1e74e969"
server_key_iv: "5bce6907f7856ccf11ba4d08190ace49"
server_key_version: "encryptionkey@0"
I20260808 04:44:31.054261 11120 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786164000593138-21443-0/minicluster-data/master-0/wal/instance:
uuid: "2947f891a30246a59faa3e030f19bda9"
format_stamp: "Formatted at 2026-08-08 04:44:31 on dist-test-slave-vxj2"
server_key: "8458e662b2d0833c46988a2c1e74e969"
server_key_iv: "5bce6907f7856ccf11ba4d08190ace49"
server_key_version: "encryptionkey@0"
I20260808 04:44:31.058470 11120 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.000s sys 0.004s
I20260808 04:44:31.061312 11136 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:44:31.062834 11120 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260808 04:44:31.063001 11120 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786164000593138-21443-0/minicluster-data/master-0/data,/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786164000593138-21443-0/minicluster-data/master-0/wal
uuid: "2947f891a30246a59faa3e030f19bda9"
format_stamp: "Formatted at 2026-08-08 04:44:31 on dist-test-slave-vxj2"
server_key: "8458e662b2d0833c46988a2c1e74e969"
server_key_iv: "5bce6907f7856ccf11ba4d08190ace49"
server_key_version: "encryptionkey@0"
I20260808 04:44:31.063143 11120 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786164000593138-21443-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786164000593138-21443-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786164000593138-21443-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:44:31.085632 11120 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:44:31.089633 11120 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:44:31.089888 11120 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:44:31.098302 11120 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:37741
I20260808 04:44:31.098325 11194 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:37741 every 8 connection(s)
I20260808 04:44:31.099371 11120 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786164000593138-21443-0/minicluster-data/master-0/data/info.pb
I20260808 04:44:31.102439 11195 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:44:31.102531 21443 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu as pid 11120
I20260808 04:44:31.102680 21443 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786164000593138-21443-0/minicluster-data/master-0/wal/instance
I20260808 04:44:31.103035 21443 external_mini_cluster.cc:1428] Setting key ae72cc4898faa9166cb2a006345ec343
I20260808 04:44:31.109804 11195 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2947f891a30246a59faa3e030f19bda9: Bootstrap starting.
I20260808 04:44:31.112290 11195 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2947f891a30246a59faa3e030f19bda9: Neither blocks nor log segments found. Creating new log.
I20260808 04:44:31.113051 11198 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:31.104556 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54921 (local address 127.0.0.1:37741)
0808 04:44:31.105133 (+ 577us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:31.105206 (+ 73us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:31.105260 (+ 54us) server_negotiation.cc:407] Connection header received
0808 04:44:31.106122 (+ 862us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:31.106150 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:31.106564 (+ 414us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:31.106950 (+ 386us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:44:31.107382 (+ 432us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:31.108402 (+ 1020us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:31.109483 (+ 1081us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:31.110044 (+ 561us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:31.110226 (+ 182us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:31.111291 (+ 1065us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:44:31.111297 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:44:31.111311 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 04:44:31.111712 (+ 401us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:44:31.111771 (+ 59us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 04:44:31.111796 (+ 25us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:44:31.111942 (+ 146us) server_negotiation.cc:1035] Waiting for connection context
0808 04:44:31.112095 (+ 153us) server_negotiation.cc:299] Negotiation successful
0808 04:44:31.112248 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":391,"thread_start_us":174,"threads_started":1}
I20260808 04:44:31.113129 11195 log.cc:824] T 00000000000000000000000000000000 P 2947f891a30246a59faa3e030f19bda9: Log is configured to *not* fsync() on all Append() calls
I20260808 04:44:31.115531 11195 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2947f891a30246a59faa3e030f19bda9: No bootstrap required, opened a new log
I20260808 04:44:31.116348 21443 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 04:44:31.119844 11195 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2947f891a30246a59faa3e030f19bda9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2947f891a30246a59faa3e030f19bda9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37741 } }
I20260808 04:44:31.120137 11195 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2947f891a30246a59faa3e030f19bda9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:44:31.120213 11195 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2947f891a30246a59faa3e030f19bda9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2947f891a30246a59faa3e030f19bda9, State: Initialized, Role: FOLLOWER
I20260808 04:44:31.120723 11195 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2947f891a30246a59faa3e030f19bda9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2947f891a30246a59faa3e030f19bda9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37741 } }
I20260808 04:44:31.120886 11195 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2947f891a30246a59faa3e030f19bda9 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 04:44:31.120954 11195 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2947f891a30246a59faa3e030f19bda9 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 04:44:31.121058 11195 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2947f891a30246a59faa3e030f19bda9 [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:44:31.122406 11195 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2947f891a30246a59faa3e030f19bda9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2947f891a30246a59faa3e030f19bda9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37741 } }
I20260808 04:44:31.122821 11195 leader_election.cc:302] T 00000000000000000000000000000000 P 2947f891a30246a59faa3e030f19bda9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2947f891a30246a59faa3e030f19bda9; no voters:
I20260808 04:44:31.123026 11198 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:31.118558 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59497 (local address 127.0.0.1:37741)
0808 04:44:31.118744 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:31.118748 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:31.118855 (+ 107us) server_negotiation.cc:407] Connection header received
0808 04:44:31.118983 (+ 128us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:31.118985 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:31.119026 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:31.119094 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:44:31.119434 (+ 340us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:31.119966 (+ 532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:31.121119 (+ 1153us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:31.121453 (+ 334us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:31.121537 (+ 84us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:31.122485 (+ 948us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:44:31.122488 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:44:31.122491 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 04:44:31.122535 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:44:31.122568 (+ 33us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 04:44:31.122583 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:44:31.122662 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0808 04:44:31.122828 (+ 166us) server_negotiation.cc:299] Negotiation successful
0808 04:44:31.122861 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":111}
I20260808 04:44:31.123219 11195 leader_election.cc:288] T 00000000000000000000000000000000 P 2947f891a30246a59faa3e030f19bda9 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 04:44:31.123391 11205 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2947f891a30246a59faa3e030f19bda9 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 04:44:31.123597 11205 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2947f891a30246a59faa3e030f19bda9 [term 1 LEADER]: Becoming Leader. State: Replica: 2947f891a30246a59faa3e030f19bda9, State: Running, Role: LEADER
I20260808 04:44:31.123907 11205 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2947f891a30246a59faa3e030f19bda9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2947f891a30246a59faa3e030f19bda9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37741 } }
I20260808 04:44:31.124606 11195 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2947f891a30246a59faa3e030f19bda9 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 04:44:31.125175 11205 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2947f891a30246a59faa3e030f19bda9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2947f891a30246a59faa3e030f19bda9. Latest consensus state: current_term: 1 leader_uuid: "2947f891a30246a59faa3e030f19bda9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2947f891a30246a59faa3e030f19bda9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37741 } } }
I20260808 04:44:31.125299 11205 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2947f891a30246a59faa3e030f19bda9 [sys.catalog]: This master's current role is: LEADER
I20260808 04:44:31.125627 11207 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2947f891a30246a59faa3e030f19bda9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2947f891a30246a59faa3e030f19bda9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2947f891a30246a59faa3e030f19bda9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37741 } } }
I20260808 04:44:31.125744 11207 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2947f891a30246a59faa3e030f19bda9 [sys.catalog]: This master's current role is: LEADER
I20260808 04:44:31.125773 11211 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 04:44:31.129267 11211 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 04:44:31.135264 11211 catalog_manager.cc:1347] Generated new cluster ID: 0f13a8ede74842a5bcaa6d642586e52d
I20260808 04:44:31.135372 11211 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 04:44:31.174157 11211 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 04:44:31.175204 11211 catalog_manager.cc:1504] Loading token signing keys...
I20260808 04:44:31.180241 11211 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2947f891a30246a59faa3e030f19bda9: Generated new TSK 0
I20260808 04:44:31.181093 11211 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 04:44:31.188530 21443 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu with pid 11120
W20260808 04:44:31.196954 11102 connection.cc:535] client connection to 127.0.0.1:37741 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:37741): Connection reset by peer (error 104)
2026-08-08T04:44:31Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/1 (1509 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/2
Loading random data
Initializing database '/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786164000593138-21443-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 04:44:31 dist-test-slave-vxj2 krb5kdc[11227](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 04:44:31 dist-test-slave-vxj2 krb5kdc[11227](info): set up 2 sockets
Aug 08 04:44:31 dist-test-slave-vxj2 krb5kdc[11227](info): commencing operation
krb5kdc: starting...
W20260808 04:44:32.289057 21443 mini_kdc.cc:121] Time spent starting KDC: real 1.077s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786164000593138-21443-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786164000593138-21443-0/krb5kdc/test-user.keytab.
Aug 08 04:44:32 dist-test-slave-vxj2 krb5kdc[11227](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164272, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T04:44:32Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T04:44:32Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786164000593138-21443-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786164000593138-21443-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 04:44:32.425586 21443 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
/tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786164000593138-21443-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786164000593138-21443-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786164000593138-21443-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786164000593138-21443-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:33035
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786164000593138-21443-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:45013
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:33035
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786164000593138-21443-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786164000593138-21443-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786164000593138-21443-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 04:44:32.548063 11240 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:44:32.548378 11240 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:44:32.548424 11240 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:44:32.552760 11240 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 04:44:32.552843 11240 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:44:32.552863 11240 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:44:32.552882 11240 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 04:44:32.552898 11240 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 04:44:32.558790 11240 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:45013
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786164000593138-21443-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786164000593138-21443-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:33035
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786164000593138-21443-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:33035
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786164000593138-21443-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11240
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786164000593138-21443-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 04:05:18 UTC on ccycloud.quasar-drfdgt.root.comops.site
build id 4574101
I20260808 04:44:32.560062 11240 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:44:32.561210 11240 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:44:32.570735 11246 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:44:32.570725 11249 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:44:32.570789 11240 server_base.cc:1034] running on GCE node
W20260808 04:44:32.570698 11245 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:44:32.571705 11240 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:44:32.572988 11240 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:44:32.574193 11240 hybrid_clock.cc:648] HybridClock initialized: now 1786164272574175 us; error 33 us; skew 500 ppm
Aug 08 04:44:32 dist-test-slave-vxj2 krb5kdc[11227](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164272, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:44:32.581650 11240 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 04:44:32.582769 11240 webserver.cc:460] Webserver started at http://127.0.0.1:34935/ using document root <none> and password file <none>
I20260808 04:44:32.583573 11240 fs_manager.cc:359] Metadata directory not provided
I20260808 04:44:32.583694 11240 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:44:32.583959 11240 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 04:44:32.586403 11240 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786164000593138-21443-0/minicluster-data/master-0/data/instance:
uuid: "4dc61022a9474bdf808d0ad26a657e2e"
format_stamp: "Formatted at 2026-08-08 04:44:32 on dist-test-slave-vxj2"
server_key: "103e8e1b55ca8ec092767f17f5166ff7"
server_key_iv: "1ebe728afb5130f012327ce7aa3f7c89"
server_key_version: "encryptionkey@0"
I20260808 04:44:32.587041 11240 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786164000593138-21443-0/minicluster-data/master-0/wal/instance:
uuid: "4dc61022a9474bdf808d0ad26a657e2e"
format_stamp: "Formatted at 2026-08-08 04:44:32 on dist-test-slave-vxj2"
server_key: "103e8e1b55ca8ec092767f17f5166ff7"
server_key_iv: "1ebe728afb5130f012327ce7aa3f7c89"
server_key_version: "encryptionkey@0"
I20260808 04:44:32.591536 11240 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260808 04:44:32.594306 11257 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:44:32.595662 11240 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 04:44:32.595853 11240 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786164000593138-21443-0/minicluster-data/master-0/data,/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786164000593138-21443-0/minicluster-data/master-0/wal
uuid: "4dc61022a9474bdf808d0ad26a657e2e"
format_stamp: "Formatted at 2026-08-08 04:44:32 on dist-test-slave-vxj2"
server_key: "103e8e1b55ca8ec092767f17f5166ff7"
server_key_iv: "1ebe728afb5130f012327ce7aa3f7c89"
server_key_version: "encryptionkey@0"
I20260808 04:44:32.595991 11240 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786164000593138-21443-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786164000593138-21443-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786164000593138-21443-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:44:32.601001 11240 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:44:32.604540 11240 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:44:32.604797 11240 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:44:32.612928 11240 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:33035
I20260808 04:44:32.612974 11312 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:33035 every 8 connection(s)
I20260808 04:44:32.614102 11240 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786164000593138-21443-0/minicluster-data/master-0/data/info.pb
I20260808 04:44:32.617288 11313 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:44:32.623735 21443 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu as pid 11240
I20260808 04:44:32.623857 11313 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4dc61022a9474bdf808d0ad26a657e2e: Bootstrap starting.
I20260808 04:44:32.623909 21443 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786164000593138-21443-0/minicluster-data/master-0/wal/instance
I20260808 04:44:32.624233 21443 external_mini_cluster.cc:1428] Setting key 3a14a4317fe0a4eab85c553ddf3c45dd
I20260808 04:44:32.627005 11313 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4dc61022a9474bdf808d0ad26a657e2e: Neither blocks nor log segments found. Creating new log.
I20260808 04:44:32.627878 11313 log.cc:824] T 00000000000000000000000000000000 P 4dc61022a9474bdf808d0ad26a657e2e: Log is configured to *not* fsync() on all Append() calls
I20260808 04:44:32.630412 11313 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4dc61022a9474bdf808d0ad26a657e2e: No bootstrap required, opened a new log
I20260808 04:44:32.630537 11317 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:32.625877 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34497 (local address 127.0.0.1:33035)
0808 04:44:32.626388 (+ 511us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:32.626403 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:32.626451 (+ 48us) server_negotiation.cc:407] Connection header received
0808 04:44:32.627279 (+ 828us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:32.627300 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:32.627704 (+ 404us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:32.628116 (+ 412us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:44:32.628990 (+ 874us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:44:32.628995 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:44:32.629007 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 04:44:32.629017 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:44:32.629077 (+ 60us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 04:44:32.629096 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:44:32.629268 (+ 172us) server_negotiation.cc:1035] Waiting for connection context
0808 04:44:32.629447 (+ 179us) server_negotiation.cc:299] Negotiation successful
0808 04:44:32.629707 (+ 260us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":336,"thread_start_us":150,"threads_started":1}
I20260808 04:44:32.633699 21443 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 04:44:32.634603 11313 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4dc61022a9474bdf808d0ad26a657e2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4dc61022a9474bdf808d0ad26a657e2e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33035 } }
I20260808 04:44:32.634930 11313 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4dc61022a9474bdf808d0ad26a657e2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:44:32.635015 11313 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4dc61022a9474bdf808d0ad26a657e2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dc61022a9474bdf808d0ad26a657e2e, State: Initialized, Role: FOLLOWER
I20260808 04:44:32.635553 11313 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4dc61022a9474bdf808d0ad26a657e2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4dc61022a9474bdf808d0ad26a657e2e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33035 } }
I20260808 04:44:32.635730 11313 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4dc61022a9474bdf808d0ad26a657e2e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 04:44:32.635811 11313 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4dc61022a9474bdf808d0ad26a657e2e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 04:44:32.635939 11313 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4dc61022a9474bdf808d0ad26a657e2e [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:44:32.637135 11313 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4dc61022a9474bdf808d0ad26a657e2e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4dc61022a9474bdf808d0ad26a657e2e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33035 } }
I20260808 04:44:32.637534 11313 leader_election.cc:302] T 00000000000000000000000000000000 P 4dc61022a9474bdf808d0ad26a657e2e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4dc61022a9474bdf808d0ad26a657e2e; no voters:
I20260808 04:44:32.637861 11313 leader_election.cc:288] T 00000000000000000000000000000000 P 4dc61022a9474bdf808d0ad26a657e2e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 04:44:32.637952 11325 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4dc61022a9474bdf808d0ad26a657e2e [term 1 FOLLOWER]: Leader election won for term 1
I20260808 04:44:32.638186 11325 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4dc61022a9474bdf808d0ad26a657e2e [term 1 LEADER]: Becoming Leader. State: Replica: 4dc61022a9474bdf808d0ad26a657e2e, State: Running, Role: LEADER
I20260808 04:44:32.638321 11317 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:32.636210 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41127 (local address 127.0.0.1:33035)
0808 04:44:32.636339 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:32.636344 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:32.636572 (+ 228us) server_negotiation.cc:407] Connection header received
0808 04:44:32.636749 (+ 177us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:32.636752 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:32.636789 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:32.636941 (+ 152us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:44:32.637791 (+ 850us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:44:32.637795 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:44:32.637797 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 04:44:32.637810 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:44:32.637840 (+ 30us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 04:44:32.637863 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:44:32.637953 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0808 04:44:32.638157 (+ 204us) server_negotiation.cc:299] Negotiation successful
0808 04:44:32.638201 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260808 04:44:32.638763 11325 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4dc61022a9474bdf808d0ad26a657e2e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4dc61022a9474bdf808d0ad26a657e2e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33035 } }
I20260808 04:44:32.639343 11313 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4dc61022a9474bdf808d0ad26a657e2e [sys.catalog]: configured and running, proceeding with master startup.
I20260808 04:44:32.640779 11327 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4dc61022a9474bdf808d0ad26a657e2e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4dc61022a9474bdf808d0ad26a657e2e. Latest consensus state: current_term: 1 leader_uuid: "4dc61022a9474bdf808d0ad26a657e2e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4dc61022a9474bdf808d0ad26a657e2e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33035 } } }
I20260808 04:44:32.640758 11326 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4dc61022a9474bdf808d0ad26a657e2e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4dc61022a9474bdf808d0ad26a657e2e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4dc61022a9474bdf808d0ad26a657e2e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33035 } } }
I20260808 04:44:32.640947 11327 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4dc61022a9474bdf808d0ad26a657e2e [sys.catalog]: This master's current role is: LEADER
I20260808 04:44:32.640950 11326 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4dc61022a9474bdf808d0ad26a657e2e [sys.catalog]: This master's current role is: LEADER
I20260808 04:44:32.641419 11338 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 04:44:32.644475 11338 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 04:44:32.650427 11338 catalog_manager.cc:1347] Generated new cluster ID: d965cdaba6cb46f6b7699ab288ea60c8
I20260808 04:44:32.650523 11338 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 04:44:32.666915 11338 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 04:44:32.667313 11338 catalog_manager.cc:1504] Loading token signing keys...
I20260808 04:44:32.688417 11338 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4dc61022a9474bdf808d0ad26a657e2e: Generated new TSK 0
I20260808 04:44:32.689329 11338 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 04:44:32.696492 21443 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu with pid 11240
2026-08-08T04:44:32Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/2 (1506 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/3
Loading random data
Initializing database '/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786164000593138-21443-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 04:44:32 dist-test-slave-vxj2 krb5kdc[11348](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 04:44:32 dist-test-slave-vxj2 krb5kdc[11348](info): set up 2 sockets
Aug 08 04:44:32 dist-test-slave-vxj2 krb5kdc[11348](info): commencing operation
krb5kdc: starting...
W20260808 04:44:33.800848 21443 mini_kdc.cc:121] Time spent starting KDC: real 1.082s user 0.003s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786164000593138-21443-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786164000593138-21443-0/krb5kdc/test-user.keytab.
Aug 08 04:44:33 dist-test-slave-vxj2 krb5kdc[11348](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164273, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T04:44:33Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T04:44:33Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786164000593138-21443-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786164000593138-21443-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 04:44:33.936868 21443 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
/tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786164000593138-21443-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786164000593138-21443-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786164000593138-21443-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786164000593138-21443-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37247
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786164000593138-21443-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:45361
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:37247
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786164000593138-21443-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786164000593138-21443-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786164000593138-21443-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 04:44:34.058521 11361 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:44:34.058904 11361 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:44:34.058996 11361 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:44:34.063313 11361 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 04:44:34.063453 11361 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:44:34.063491 11361 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:44:34.063537 11361 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 04:44:34.063570 11361 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 04:44:34.069665 11361 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:45361
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786164000593138-21443-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786164000593138-21443-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:37247
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786164000593138-21443-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37247
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786164000593138-21443-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11361
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786164000593138-21443-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 04:05:18 UTC on ccycloud.quasar-drfdgt.root.comops.site
build id 4574101
I20260808 04:44:34.070950 11361 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:44:34.072052 11361 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:44:34.081158 11366 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:44:34.081187 11367 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:44:34.081343 11361 server_base.cc:1034] running on GCE node
W20260808 04:44:34.081187 11369 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:44:34.082221 11361 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:44:34.083549 11361 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:44:34.084772 11361 hybrid_clock.cc:648] HybridClock initialized: now 1786164274084752 us; error 37 us; skew 500 ppm
Aug 08 04:44:34 dist-test-slave-vxj2 krb5kdc[11348](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164274, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:44:34.088027 11361 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 04:44:34.089056 11361 webserver.cc:460] Webserver started at http://127.0.0.1:40859/ using document root <none> and password file <none>
I20260808 04:44:34.089677 11361 fs_manager.cc:359] Metadata directory not provided
I20260808 04:44:34.089744 11361 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:44:34.089931 11361 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 04:44:34.092083 11361 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786164000593138-21443-0/minicluster-data/master-0/data/instance:
uuid: "7d4b994740c94a689cd5c2014dc590e4"
format_stamp: "Formatted at 2026-08-08 04:44:34 on dist-test-slave-vxj2"
server_key: "8a311091b7c8744cba4e5e4a49344be5"
server_key_iv: "7f15565f0485ce7f35a04d9fcfa11ddc"
server_key_version: "encryptionkey@0"
I20260808 04:44:34.092650 11361 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786164000593138-21443-0/minicluster-data/master-0/wal/instance:
uuid: "7d4b994740c94a689cd5c2014dc590e4"
format_stamp: "Formatted at 2026-08-08 04:44:34 on dist-test-slave-vxj2"
server_key: "8a311091b7c8744cba4e5e4a49344be5"
server_key_iv: "7f15565f0485ce7f35a04d9fcfa11ddc"
server_key_version: "encryptionkey@0"
I20260808 04:44:34.096606 11361 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260808 04:44:34.099485 11376 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:44:34.100936 11361 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260808 04:44:34.101074 11361 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786164000593138-21443-0/minicluster-data/master-0/data,/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786164000593138-21443-0/minicluster-data/master-0/wal
uuid: "7d4b994740c94a689cd5c2014dc590e4"
format_stamp: "Formatted at 2026-08-08 04:44:34 on dist-test-slave-vxj2"
server_key: "8a311091b7c8744cba4e5e4a49344be5"
server_key_iv: "7f15565f0485ce7f35a04d9fcfa11ddc"
server_key_version: "encryptionkey@0"
I20260808 04:44:34.101261 11361 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786164000593138-21443-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786164000593138-21443-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786164000593138-21443-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:44:34.122570 11361 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:44:34.126042 11361 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:44:34.126240 11361 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:44:34.134449 11361 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:37247
I20260808 04:44:34.134482 11435 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:37247 every 8 connection(s)
I20260808 04:44:34.135509 11361 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786164000593138-21443-0/minicluster-data/master-0/data/info.pb
I20260808 04:44:34.138572 11436 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:44:34.144516 11436 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7d4b994740c94a689cd5c2014dc590e4: Bootstrap starting.
I20260808 04:44:34.145292 21443 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu as pid 11361
I20260808 04:44:34.145450 21443 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786164000593138-21443-0/minicluster-data/master-0/wal/instance
I20260808 04:44:34.145761 21443 external_mini_cluster.cc:1428] Setting key a01b3abb9de25e6690647460631e61cf
I20260808 04:44:34.147830 11436 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7d4b994740c94a689cd5c2014dc590e4: Neither blocks nor log segments found. Creating new log.
I20260808 04:44:34.148607 11436 log.cc:824] T 00000000000000000000000000000000 P 7d4b994740c94a689cd5c2014dc590e4: Log is configured to *not* fsync() on all Append() calls
I20260808 04:44:34.151304 11436 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7d4b994740c94a689cd5c2014dc590e4: No bootstrap required, opened a new log
Aug 08 04:44:34 dist-test-slave-vxj2 krb5kdc[11348](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164273, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260808 04:44:34.156945 11436 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7d4b994740c94a689cd5c2014dc590e4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7d4b994740c94a689cd5c2014dc590e4" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37247 } }
I20260808 04:44:34.157368 11436 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7d4b994740c94a689cd5c2014dc590e4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:44:34.157455 11436 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7d4b994740c94a689cd5c2014dc590e4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d4b994740c94a689cd5c2014dc590e4, State: Initialized, Role: FOLLOWER
I20260808 04:44:34.158038 11436 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7d4b994740c94a689cd5c2014dc590e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7d4b994740c94a689cd5c2014dc590e4" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37247 } }
I20260808 04:44:34.158202 11436 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7d4b994740c94a689cd5c2014dc590e4 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 04:44:34.158316 11436 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7d4b994740c94a689cd5c2014dc590e4 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 04:44:34.158489 11436 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7d4b994740c94a689cd5c2014dc590e4 [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:44:34.159718 11436 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7d4b994740c94a689cd5c2014dc590e4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7d4b994740c94a689cd5c2014dc590e4" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37247 } }
I20260808 04:44:34.160246 11436 leader_election.cc:302] T 00000000000000000000000000000000 P 7d4b994740c94a689cd5c2014dc590e4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7d4b994740c94a689cd5c2014dc590e4; no voters:
I20260808 04:44:34.160734 11436 leader_election.cc:288] T 00000000000000000000000000000000 P 7d4b994740c94a689cd5c2014dc590e4 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 04:44:34.160852 11442 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7d4b994740c94a689cd5c2014dc590e4 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 04:44:34.161206 11442 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7d4b994740c94a689cd5c2014dc590e4 [term 1 LEADER]: Becoming Leader. State: Replica: 7d4b994740c94a689cd5c2014dc590e4, State: Running, Role: LEADER
I20260808 04:44:34.161648 11442 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7d4b994740c94a689cd5c2014dc590e4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7d4b994740c94a689cd5c2014dc590e4" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37247 } }
I20260808 04:44:34.162475 11436 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7d4b994740c94a689cd5c2014dc590e4 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 04:44:34.163676 11443 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7d4b994740c94a689cd5c2014dc590e4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7d4b994740c94a689cd5c2014dc590e4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7d4b994740c94a689cd5c2014dc590e4" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37247 } } }
I20260808 04:44:34.163774 11440 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:34.147268 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50199 (local address 127.0.0.1:37247)
0808 04:44:34.147766 (+ 498us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:34.147782 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:34.147819 (+ 37us) server_negotiation.cc:407] Connection header received
0808 04:44:34.148587 (+ 768us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:34.148605 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:34.149083 (+ 478us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:34.149535 (+ 452us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:44:34.150583 (+ 1048us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:34.151680 (+ 1097us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:34.152976 (+ 1296us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:34.153573 (+ 597us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:34.153704 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:34.157120 (+ 3416us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:44:34.157127 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:44:34.157148 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:44:34.157231 (+ 83us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:44:34.159362 (+ 2131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:44:34.160055 (+ 693us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:44:34.160063 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:44:34.160070 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:44:34.160248 (+ 178us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:44:34.160706 (+ 458us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:44:34.160710 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:44:34.160712 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:44:34.161475 (+ 763us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:44:34.161695 (+ 220us) server_negotiation.cc:1035] Waiting for connection context
0808 04:44:34.162140 (+ 445us) server_negotiation.cc:299] Negotiation successful
0808 04:44:34.162523 (+ 383us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":351,"thread_start_us":148,"threads_started":1}
I20260808 04:44:34.163867 11443 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7d4b994740c94a689cd5c2014dc590e4 [sys.catalog]: This master's current role is: LEADER
I20260808 04:44:34.165131 11444 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7d4b994740c94a689cd5c2014dc590e4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7d4b994740c94a689cd5c2014dc590e4. Latest consensus state: current_term: 1 leader_uuid: "7d4b994740c94a689cd5c2014dc590e4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7d4b994740c94a689cd5c2014dc590e4" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37247 } } }
I20260808 04:44:34.166004 11444 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7d4b994740c94a689cd5c2014dc590e4 [sys.catalog]: This master's current role is: LEADER
I20260808 04:44:34.167833 21443 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
W20260808 04:44:34.168268 11457 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 7d4b994740c94a689cd5c2014dc590e4: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 04:44:34.168365 11457 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 04:44:34.168426 11451 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 04:44:34.169415 11451 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 04:44:34.176671 11451 catalog_manager.cc:1347] Generated new cluster ID: 4e915d7b4c3947d3a94855a9f4e36975
I20260808 04:44:34.176765 11451 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 04:44:34.183537 11440 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:34.173843 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52239 (local address 127.0.0.1:37247)
0808 04:44:34.173994 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:34.174000 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:34.174805 (+ 805us) server_negotiation.cc:407] Connection header received
0808 04:44:34.174850 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:34.174853 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:34.174895 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:34.174995 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:44:34.175719 (+ 724us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:34.176325 (+ 606us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:34.177535 (+ 1210us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:34.177938 (+ 403us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:34.178068 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:34.179797 (+ 1729us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:44:34.179800 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:44:34.179803 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:44:34.179832 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:44:34.181697 (+ 1865us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:44:34.182196 (+ 499us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:44:34.182200 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:44:34.182202 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:44:34.182294 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:44:34.182580 (+ 286us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:44:34.182584 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:44:34.182586 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:44:34.182831 (+ 245us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:44:34.182963 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0808 04:44:34.183202 (+ 239us) server_negotiation.cc:299] Negotiation successful
0808 04:44:34.183338 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260808 04:44:34.189354 11451 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 04:44:34.190420 11451 catalog_manager.cc:1504] Loading token signing keys...
I20260808 04:44:34.206934 11451 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 7d4b994740c94a689cd5c2014dc590e4: Generated new TSK 0
I20260808 04:44:34.207785 11451 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 04:44:34.213617 21443 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu with pid 11361
2026-08-08T04:44:34Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/3 (1517 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/4
Loading random data
Initializing database '/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786164000593138-21443-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 04:44:34 dist-test-slave-vxj2 krb5kdc[11469](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 04:44:34 dist-test-slave-vxj2 krb5kdc[11469](info): set up 2 sockets
Aug 08 04:44:34 dist-test-slave-vxj2 krb5kdc[11469](info): commencing operation
krb5kdc: starting...
W20260808 04:44:35.307868 21443 mini_kdc.cc:121] Time spent starting KDC: real 1.071s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786164000593138-21443-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786164000593138-21443-0/krb5kdc/test-user.keytab.
Aug 08 04:44:35 dist-test-slave-vxj2 krb5kdc[11469](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164275, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T04:44:35Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T04:44:35Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786164000593138-21443-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786164000593138-21443-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 04:44:35.445679 21443 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
/tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786164000593138-21443-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786164000593138-21443-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786164000593138-21443-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786164000593138-21443-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45483
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786164000593138-21443-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:40779
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:45483
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786164000593138-21443-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786164000593138-21443-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786164000593138-21443-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 04:44:35.562569 11486 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:44:35.562878 11486 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:44:35.562932 11486 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:44:35.567126 11486 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 04:44:35.567205 11486 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:44:35.567225 11486 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:44:35.567242 11486 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 04:44:35.567258 11486 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 04:44:35.573066 11486 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:40779
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786164000593138-21443-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786164000593138-21443-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:45483
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786164000593138-21443-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45483
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786164000593138-21443-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11486
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786164000593138-21443-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 04:05:18 UTC on ccycloud.quasar-drfdgt.root.comops.site
build id 4574101
I20260808 04:44:35.574326 11486 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:44:35.575444 11486 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:44:35.584976 11492 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:44:35.585219 11486 server_base.cc:1034] running on GCE node
W20260808 04:44:35.585063 11495 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:44:35.585059 11491 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:44:35.585942 11486 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:44:35.587159 11486 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:44:35.588339 11486 hybrid_clock.cc:648] HybridClock initialized: now 1786164275588320 us; error 33 us; skew 500 ppm
Aug 08 04:44:35 dist-test-slave-vxj2 krb5kdc[11469](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164275, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:44:35.591544 11486 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 04:44:35.592545 11486 webserver.cc:460] Webserver started at http://127.0.0.1:38441/ using document root <none> and password file <none>
I20260808 04:44:35.593140 11486 fs_manager.cc:359] Metadata directory not provided
I20260808 04:44:35.593289 11486 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:44:35.593538 11486 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 04:44:35.595728 11486 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786164000593138-21443-0/minicluster-data/master-0/data/instance:
uuid: "e13119a99129484cb3ea4785b8e700e8"
format_stamp: "Formatted at 2026-08-08 04:44:35 on dist-test-slave-vxj2"
server_key: "c20cea21a469faaa8a7e420e40826277"
server_key_iv: "087cac8a6c86091456ed37e0528c6c30"
server_key_version: "encryptionkey@0"
I20260808 04:44:35.596354 11486 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786164000593138-21443-0/minicluster-data/master-0/wal/instance:
uuid: "e13119a99129484cb3ea4785b8e700e8"
format_stamp: "Formatted at 2026-08-08 04:44:35 on dist-test-slave-vxj2"
server_key: "c20cea21a469faaa8a7e420e40826277"
server_key_iv: "087cac8a6c86091456ed37e0528c6c30"
server_key_version: "encryptionkey@0"
I20260808 04:44:35.600438 11486 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.003s
I20260808 04:44:35.603206 11503 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:44:35.604616 11486 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260808 04:44:35.604826 11486 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786164000593138-21443-0/minicluster-data/master-0/data,/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786164000593138-21443-0/minicluster-data/master-0/wal
uuid: "e13119a99129484cb3ea4785b8e700e8"
format_stamp: "Formatted at 2026-08-08 04:44:35 on dist-test-slave-vxj2"
server_key: "c20cea21a469faaa8a7e420e40826277"
server_key_iv: "087cac8a6c86091456ed37e0528c6c30"
server_key_version: "encryptionkey@0"
I20260808 04:44:35.604972 11486 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786164000593138-21443-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786164000593138-21443-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786164000593138-21443-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:44:35.620030 11486 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:44:35.623757 11486 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:44:35.624001 11486 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:44:35.632061 11486 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:45483
I20260808 04:44:35.632077 11558 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:45483 every 8 connection(s)
I20260808 04:44:35.633129 11486 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786164000593138-21443-0/minicluster-data/master-0/data/info.pb
I20260808 04:44:35.633397 21443 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu as pid 11486
I20260808 04:44:35.633551 21443 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786164000593138-21443-0/minicluster-data/master-0/wal/instance
I20260808 04:44:35.633929 21443 external_mini_cluster.cc:1428] Setting key e826c00b8e43d080a05468246aa8485d
I20260808 04:44:35.636440 11559 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:44:35.643193 11559 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e13119a99129484cb3ea4785b8e700e8: Bootstrap starting.
I20260808 04:44:35.643850 11564 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:35.635448 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37907 (local address 127.0.0.1:45483)
0808 04:44:35.635918 (+ 470us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:35.635934 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:35.636001 (+ 67us) server_negotiation.cc:407] Connection header received
0808 04:44:35.636757 (+ 756us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:35.636776 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:35.637192 (+ 416us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:35.637497 (+ 305us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:44:35.637867 (+ 370us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:35.638851 (+ 984us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:35.640165 (+ 1314us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:35.640641 (+ 476us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:35.640782 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:35.641868 (+ 1086us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:44:35.641873 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:44:35.641887 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 04:44:35.642319 (+ 432us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:44:35.642380 (+ 61us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 04:44:35.642403 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:44:35.642491 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0808 04:44:35.642662 (+ 171us) server_negotiation.cc:299] Negotiation successful
0808 04:44:35.642993 (+ 331us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":296,"thread_start_us":153,"threads_started":1}
I20260808 04:44:35.645603 11559 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e13119a99129484cb3ea4785b8e700e8: Neither blocks nor log segments found. Creating new log.
I20260808 04:44:35.646508 11559 log.cc:824] T 00000000000000000000000000000000 P e13119a99129484cb3ea4785b8e700e8: Log is configured to *not* fsync() on all Append() calls
I20260808 04:44:35.646989 21443 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 04:44:35.648741 11559 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e13119a99129484cb3ea4785b8e700e8: No bootstrap required, opened a new log
I20260808 04:44:35.652652 11559 raft_consensus.cc:348] T 00000000000000000000000000000000 P e13119a99129484cb3ea4785b8e700e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e13119a99129484cb3ea4785b8e700e8" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45483 } }
I20260808 04:44:35.652947 11559 raft_consensus.cc:374] T 00000000000000000000000000000000 P e13119a99129484cb3ea4785b8e700e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:44:35.653079 11559 raft_consensus.cc:729] T 00000000000000000000000000000000 P e13119a99129484cb3ea4785b8e700e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e13119a99129484cb3ea4785b8e700e8, State: Initialized, Role: FOLLOWER
I20260808 04:44:35.653100 11564 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:35.649176 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32981 (local address 127.0.0.1:45483)
0808 04:44:35.649280 (+ 104us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:35.649287 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:35.649512 (+ 225us) server_negotiation.cc:407] Connection header received
0808 04:44:35.649655 (+ 143us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:35.649658 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:35.649706 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:35.649799 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:44:35.650083 (+ 284us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:35.650631 (+ 548us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:35.651470 (+ 839us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:35.651708 (+ 238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:35.651821 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:35.652661 (+ 840us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:44:35.652665 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:44:35.652667 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 04:44:35.652682 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:44:35.652717 (+ 35us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 04:44:35.652728 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:44:35.652808 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0808 04:44:35.652904 (+ 96us) server_negotiation.cc:299] Negotiation successful
0808 04:44:35.652962 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260808 04:44:35.653614 11559 consensus_queue.cc:260] T 00000000000000000000000000000000 P e13119a99129484cb3ea4785b8e700e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e13119a99129484cb3ea4785b8e700e8" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45483 } }
I20260808 04:44:35.653790 11559 raft_consensus.cc:388] T 00000000000000000000000000000000 P e13119a99129484cb3ea4785b8e700e8 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 04:44:35.653879 11559 raft_consensus.cc:482] T 00000000000000000000000000000000 P e13119a99129484cb3ea4785b8e700e8 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 04:44:35.654016 11559 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e13119a99129484cb3ea4785b8e700e8 [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:44:35.655057 11559 raft_consensus.cc:504] T 00000000000000000000000000000000 P e13119a99129484cb3ea4785b8e700e8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e13119a99129484cb3ea4785b8e700e8" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45483 } }
I20260808 04:44:35.655435 11559 leader_election.cc:302] T 00000000000000000000000000000000 P e13119a99129484cb3ea4785b8e700e8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e13119a99129484cb3ea4785b8e700e8; no voters:
I20260808 04:44:35.655812 11559 leader_election.cc:288] T 00000000000000000000000000000000 P e13119a99129484cb3ea4785b8e700e8 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 04:44:35.656008 11571 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e13119a99129484cb3ea4785b8e700e8 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 04:44:35.656258 11571 raft_consensus.cc:686] T 00000000000000000000000000000000 P e13119a99129484cb3ea4785b8e700e8 [term 1 LEADER]: Becoming Leader. State: Replica: e13119a99129484cb3ea4785b8e700e8, State: Running, Role: LEADER
I20260808 04:44:35.656661 11571 consensus_queue.cc:237] T 00000000000000000000000000000000 P e13119a99129484cb3ea4785b8e700e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e13119a99129484cb3ea4785b8e700e8" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45483 } }
I20260808 04:44:35.657244 11559 sys_catalog.cc:564] T 00000000000000000000000000000000 P e13119a99129484cb3ea4785b8e700e8 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 04:44:35.658481 11572 sys_catalog.cc:455] T 00000000000000000000000000000000 P e13119a99129484cb3ea4785b8e700e8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e13119a99129484cb3ea4785b8e700e8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e13119a99129484cb3ea4785b8e700e8" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45483 } } }
I20260808 04:44:35.658631 11572 sys_catalog.cc:458] T 00000000000000000000000000000000 P e13119a99129484cb3ea4785b8e700e8 [sys.catalog]: This master's current role is: LEADER
I20260808 04:44:35.659045 11580 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 04:44:35.659021 11573 sys_catalog.cc:455] T 00000000000000000000000000000000 P e13119a99129484cb3ea4785b8e700e8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e13119a99129484cb3ea4785b8e700e8. Latest consensus state: current_term: 1 leader_uuid: "e13119a99129484cb3ea4785b8e700e8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e13119a99129484cb3ea4785b8e700e8" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45483 } } }
I20260808 04:44:35.659250 11573 sys_catalog.cc:458] T 00000000000000000000000000000000 P e13119a99129484cb3ea4785b8e700e8 [sys.catalog]: This master's current role is: LEADER
I20260808 04:44:35.662993 11580 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 04:44:35.669140 11580 catalog_manager.cc:1347] Generated new cluster ID: fd29c66d2ee74c7e9ea3316c6f8530c0
I20260808 04:44:35.669272 11580 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 04:44:35.696550 11580 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 04:44:35.698009 11580 catalog_manager.cc:1504] Loading token signing keys...
I20260808 04:44:35.709721 11580 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e13119a99129484cb3ea4785b8e700e8: Generated new TSK 0
I20260808 04:44:35.710664 11580 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 04:44:35.724298 21443 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu with pid 11486
2026-08-08T04:44:35Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/4 (1509 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/5
Loading random data
Initializing database '/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786164000593138-21443-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 04:44:35 dist-test-slave-vxj2 krb5kdc[11594](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 04:44:35 dist-test-slave-vxj2 krb5kdc[11594](info): set up 2 sockets
Aug 08 04:44:35 dist-test-slave-vxj2 krb5kdc[11594](info): commencing operation
krb5kdc: starting...
W20260808 04:44:36.812039 21443 mini_kdc.cc:121] Time spent starting KDC: real 1.065s user 0.005s sys 0.002s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786164000593138-21443-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786164000593138-21443-0/krb5kdc/test-user.keytab.
Aug 08 04:44:36 dist-test-slave-vxj2 krb5kdc[11594](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164276, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T04:44:36Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T04:44:36Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786164000593138-21443-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786164000593138-21443-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 04:44:36.944952 21443 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
/tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786164000593138-21443-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786164000593138-21443-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786164000593138-21443-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786164000593138-21443-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37361
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786164000593138-21443-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:41093
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:37361
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786164000593138-21443-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786164000593138-21443-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786164000593138-21443-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 04:44:37.062888 11607 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:44:37.063220 11607 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:44:37.063267 11607 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:44:37.067812 11607 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 04:44:37.067927 11607 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:44:37.067947 11607 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:44:37.067965 11607 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 04:44:37.067981 11607 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 04:44:37.074008 11607 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:41093
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786164000593138-21443-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786164000593138-21443-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:37361
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786164000593138-21443-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37361
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786164000593138-21443-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11607
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786164000593138-21443-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 04:05:18 UTC on ccycloud.quasar-drfdgt.root.comops.site
build id 4574101
I20260808 04:44:37.075234 11607 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:44:37.076335 11607 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:44:37.085541 11613 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:44:37.085534 11615 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:44:37.085600 11607 server_base.cc:1034] running on GCE node
W20260808 04:44:37.085534 11612 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:44:37.086577 11607 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:44:37.087728 11607 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:44:37.088909 11607 hybrid_clock.cc:648] HybridClock initialized: now 1786164277088893 us; error 32 us; skew 500 ppm
Aug 08 04:44:37 dist-test-slave-vxj2 krb5kdc[11594](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164277, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:44:37.092023 11607 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 04:44:37.092979 11607 webserver.cc:460] Webserver started at http://127.0.0.1:44545/ using document root <none> and password file <none>
I20260808 04:44:37.093597 11607 fs_manager.cc:359] Metadata directory not provided
I20260808 04:44:37.093663 11607 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:44:37.093838 11607 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 04:44:37.095995 11607 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786164000593138-21443-0/minicluster-data/master-0/data/instance:
uuid: "f807f3ddd11742798581836a338486e3"
format_stamp: "Formatted at 2026-08-08 04:44:37 on dist-test-slave-vxj2"
server_key: "ab9884e7cdbdde1f16d1a420d5a238df"
server_key_iv: "efcfd70ccb06736a9cec37635279ea6c"
server_key_version: "encryptionkey@0"
I20260808 04:44:37.096549 11607 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786164000593138-21443-0/minicluster-data/master-0/wal/instance:
uuid: "f807f3ddd11742798581836a338486e3"
format_stamp: "Formatted at 2026-08-08 04:44:37 on dist-test-slave-vxj2"
server_key: "ab9884e7cdbdde1f16d1a420d5a238df"
server_key_iv: "efcfd70ccb06736a9cec37635279ea6c"
server_key_version: "encryptionkey@0"
I20260808 04:44:37.100430 11607 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260808 04:44:37.103152 11622 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:44:37.104574 11607 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260808 04:44:37.104741 11607 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786164000593138-21443-0/minicluster-data/master-0/data,/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786164000593138-21443-0/minicluster-data/master-0/wal
uuid: "f807f3ddd11742798581836a338486e3"
format_stamp: "Formatted at 2026-08-08 04:44:37 on dist-test-slave-vxj2"
server_key: "ab9884e7cdbdde1f16d1a420d5a238df"
server_key_iv: "efcfd70ccb06736a9cec37635279ea6c"
server_key_version: "encryptionkey@0"
I20260808 04:44:37.104876 11607 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786164000593138-21443-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786164000593138-21443-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786164000593138-21443-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:44:37.110302 11607 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:44:37.113869 11607 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:44:37.114091 11607 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:44:37.122114 11607 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:37361
I20260808 04:44:37.122186 11679 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:37361 every 8 connection(s)
I20260808 04:44:37.123208 11607 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786164000593138-21443-0/minicluster-data/master-0/data/info.pb
I20260808 04:44:37.126243 11680 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:44:37.131994 11680 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f807f3ddd11742798581836a338486e3: Bootstrap starting.
I20260808 04:44:37.132331 21443 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu as pid 11607
I20260808 04:44:37.132476 21443 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786164000593138-21443-0/minicluster-data/master-0/wal/instance
I20260808 04:44:37.132782 21443 external_mini_cluster.cc:1428] Setting key 81b2aecde797f4353cfb8e0aff8812f5
I20260808 04:44:37.135100 11680 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f807f3ddd11742798581836a338486e3: Neither blocks nor log segments found. Creating new log.
I20260808 04:44:37.136003 11680 log.cc:824] T 00000000000000000000000000000000 P f807f3ddd11742798581836a338486e3: Log is configured to *not* fsync() on all Append() calls
I20260808 04:44:37.138468 11680 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f807f3ddd11742798581836a338486e3: No bootstrap required, opened a new log
I20260808 04:44:37.138839 11683 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:37.134180 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39505 (local address 127.0.0.1:37361)
0808 04:44:37.134689 (+ 509us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:37.134708 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:37.134748 (+ 40us) server_negotiation.cc:407] Connection header received
0808 04:44:37.135648 (+ 900us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:37.135672 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:37.136050 (+ 378us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:37.136422 (+ 372us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:44:37.137518 (+ 1096us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:44:37.137522 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:44:37.137533 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 04:44:37.137543 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:44:37.137598 (+ 55us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 04:44:37.137618 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:44:37.137708 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0808 04:44:37.137875 (+ 167us) server_negotiation.cc:299] Negotiation successful
0808 04:44:37.138058 (+ 183us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":349,"thread_start_us":190,"threads_started":1}
I20260808 04:44:37.141631 21443 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 04:44:37.142642 11680 raft_consensus.cc:348] T 00000000000000000000000000000000 P f807f3ddd11742798581836a338486e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f807f3ddd11742798581836a338486e3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37361 } }
I20260808 04:44:37.142958 11680 raft_consensus.cc:374] T 00000000000000000000000000000000 P f807f3ddd11742798581836a338486e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:44:37.143028 11680 raft_consensus.cc:729] T 00000000000000000000000000000000 P f807f3ddd11742798581836a338486e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f807f3ddd11742798581836a338486e3, State: Initialized, Role: FOLLOWER
I20260808 04:44:37.143623 11680 consensus_queue.cc:260] T 00000000000000000000000000000000 P f807f3ddd11742798581836a338486e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f807f3ddd11742798581836a338486e3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37361 } }
I20260808 04:44:37.143837 11680 raft_consensus.cc:388] T 00000000000000000000000000000000 P f807f3ddd11742798581836a338486e3 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 04:44:37.143931 11680 raft_consensus.cc:482] T 00000000000000000000000000000000 P f807f3ddd11742798581836a338486e3 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 04:44:37.144061 11680 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f807f3ddd11742798581836a338486e3 [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:44:37.145491 11680 raft_consensus.cc:504] T 00000000000000000000000000000000 P f807f3ddd11742798581836a338486e3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f807f3ddd11742798581836a338486e3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37361 } }
I20260808 04:44:37.145977 11683 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:37.144089 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47731 (local address 127.0.0.1:37361)
0808 04:44:37.144223 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:37.144228 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:37.144456 (+ 228us) server_negotiation.cc:407] Connection header received
0808 04:44:37.144576 (+ 120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:37.144578 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:37.144609 (+ 31us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:37.144678 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:44:37.145490 (+ 812us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:44:37.145492 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:44:37.145494 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 04:44:37.145504 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:44:37.145529 (+ 25us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 04:44:37.145539 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:44:37.145610 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0808 04:44:37.145780 (+ 170us) server_negotiation.cc:299] Negotiation successful
0808 04:44:37.145815 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260808 04:44:37.145933 11680 leader_election.cc:302] T 00000000000000000000000000000000 P f807f3ddd11742798581836a338486e3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f807f3ddd11742798581836a338486e3; no voters:
I20260808 04:44:37.146325 11680 leader_election.cc:288] T 00000000000000000000000000000000 P f807f3ddd11742798581836a338486e3 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 04:44:37.146436 11690 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f807f3ddd11742798581836a338486e3 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 04:44:37.146664 11690 raft_consensus.cc:686] T 00000000000000000000000000000000 P f807f3ddd11742798581836a338486e3 [term 1 LEADER]: Becoming Leader. State: Replica: f807f3ddd11742798581836a338486e3, State: Running, Role: LEADER
I20260808 04:44:37.147104 11690 consensus_queue.cc:237] T 00000000000000000000000000000000 P f807f3ddd11742798581836a338486e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f807f3ddd11742798581836a338486e3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37361 } }
I20260808 04:44:37.147779 11680 sys_catalog.cc:564] T 00000000000000000000000000000000 P f807f3ddd11742798581836a338486e3 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 04:44:37.149014 11692 sys_catalog.cc:455] T 00000000000000000000000000000000 P f807f3ddd11742798581836a338486e3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f807f3ddd11742798581836a338486e3. Latest consensus state: current_term: 1 leader_uuid: "f807f3ddd11742798581836a338486e3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f807f3ddd11742798581836a338486e3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37361 } } }
I20260808 04:44:37.149024 11691 sys_catalog.cc:455] T 00000000000000000000000000000000 P f807f3ddd11742798581836a338486e3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f807f3ddd11742798581836a338486e3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f807f3ddd11742798581836a338486e3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37361 } } }
I20260808 04:44:37.149207 11692 sys_catalog.cc:458] T 00000000000000000000000000000000 P f807f3ddd11742798581836a338486e3 [sys.catalog]: This master's current role is: LEADER
I20260808 04:44:37.149255 11691 sys_catalog.cc:458] T 00000000000000000000000000000000 P f807f3ddd11742798581836a338486e3 [sys.catalog]: This master's current role is: LEADER
I20260808 04:44:37.150570 11700 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 04:44:37.154033 11700 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 04:44:37.160279 11700 catalog_manager.cc:1347] Generated new cluster ID: 7ae2f5e8308848d5b82b9440533ebe65
I20260808 04:44:37.160395 11700 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 04:44:37.188555 11700 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 04:44:37.189016 11700 catalog_manager.cc:1504] Loading token signing keys...
I20260808 04:44:37.195784 11700 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f807f3ddd11742798581836a338486e3: Generated new TSK 0
I20260808 04:44:37.196635 11700 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 04:44:37.209012 21443 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu with pid 11607
2026-08-08T04:44:37Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/5 (1485 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/6
Loading random data
Initializing database '/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786164000593138-21443-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 04:44:37 dist-test-slave-vxj2 krb5kdc[11712](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 04:44:37 dist-test-slave-vxj2 krb5kdc[11712](info): set up 2 sockets
Aug 08 04:44:37 dist-test-slave-vxj2 krb5kdc[11712](info): commencing operation
krb5kdc: starting...
W20260808 04:44:38.303862 21443 mini_kdc.cc:121] Time spent starting KDC: real 1.072s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786164000593138-21443-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786164000593138-21443-0/krb5kdc/test-user.keytab.
Aug 08 04:44:38 dist-test-slave-vxj2 krb5kdc[11712](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164278, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T04:44:38Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T04:44:38Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786164000593138-21443-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786164000593138-21443-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 04:44:38.437427 21443 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
/tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786164000593138-21443-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786164000593138-21443-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786164000593138-21443-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786164000593138-21443-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:44591
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786164000593138-21443-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:41109
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:44591
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786164000593138-21443-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786164000593138-21443-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786164000593138-21443-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 04:44:38.558317 11725 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:44:38.558704 11725 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:44:38.558786 11725 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:44:38.563139 11725 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 04:44:38.563265 11725 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:44:38.563306 11725 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:44:38.563347 11725 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 04:44:38.563388 11725 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 04:44:38.569293 11725 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:41109
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786164000593138-21443-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786164000593138-21443-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:44591
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786164000593138-21443-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:44591
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786164000593138-21443-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11725
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786164000593138-21443-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 04:05:18 UTC on ccycloud.quasar-drfdgt.root.comops.site
build id 4574101
I20260808 04:44:38.570549 11725 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:44:38.571681 11725 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:44:38.580808 11735 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:44:38.580911 11732 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:44:38.580808 11731 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:44:38.581192 11725 server_base.cc:1034] running on GCE node
I20260808 04:44:38.581904 11725 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:44:38.583135 11725 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:44:38.584304 11725 hybrid_clock.cc:648] HybridClock initialized: now 1786164278584273 us; error 46 us; skew 500 ppm
Aug 08 04:44:38 dist-test-slave-vxj2 krb5kdc[11712](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164278, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:44:38.591084 11725 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 04:44:38.592046 11725 webserver.cc:460] Webserver started at http://127.0.0.1:45883/ using document root <none> and password file <none>
I20260808 04:44:38.592603 11725 fs_manager.cc:359] Metadata directory not provided
I20260808 04:44:38.592664 11725 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:44:38.592844 11725 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 04:44:38.595109 11725 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786164000593138-21443-0/minicluster-data/master-0/data/instance:
uuid: "b3d5223886fb4d34917f9259abb1f184"
format_stamp: "Formatted at 2026-08-08 04:44:38 on dist-test-slave-vxj2"
server_key: "45d8c64394915213d5deb8af2e5411af"
server_key_iv: "470dfb687fe1b73c496a2f3efb53dcd9"
server_key_version: "encryptionkey@0"
I20260808 04:44:38.595634 11725 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786164000593138-21443-0/minicluster-data/master-0/wal/instance:
uuid: "b3d5223886fb4d34917f9259abb1f184"
format_stamp: "Formatted at 2026-08-08 04:44:38 on dist-test-slave-vxj2"
server_key: "45d8c64394915213d5deb8af2e5411af"
server_key_iv: "470dfb687fe1b73c496a2f3efb53dcd9"
server_key_version: "encryptionkey@0"
I20260808 04:44:38.599583 11725 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260808 04:44:38.602679 11742 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:44:38.604064 11725 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260808 04:44:38.604230 11725 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786164000593138-21443-0/minicluster-data/master-0/data,/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786164000593138-21443-0/minicluster-data/master-0/wal
uuid: "b3d5223886fb4d34917f9259abb1f184"
format_stamp: "Formatted at 2026-08-08 04:44:38 on dist-test-slave-vxj2"
server_key: "45d8c64394915213d5deb8af2e5411af"
server_key_iv: "470dfb687fe1b73c496a2f3efb53dcd9"
server_key_version: "encryptionkey@0"
I20260808 04:44:38.604372 11725 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786164000593138-21443-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786164000593138-21443-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786164000593138-21443-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:44:38.631101 11725 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:44:38.634415 11725 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:44:38.634651 11725 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:44:38.642765 11725 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:44591
I20260808 04:44:38.642787 11798 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:44591 every 8 connection(s)
I20260808 04:44:38.643839 11725 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786164000593138-21443-0/minicluster-data/master-0/data/info.pb
I20260808 04:44:38.645397 21443 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu as pid 11725
I20260808 04:44:38.645540 21443 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786164000593138-21443-0/minicluster-data/master-0/wal/instance
I20260808 04:44:38.645819 21443 external_mini_cluster.cc:1428] Setting key 6ff2ec69bebb7839fff49285047e3b85
I20260808 04:44:38.647385 11799 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:44:38.654958 11799 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b3d5223886fb4d34917f9259abb1f184: Bootstrap starting.
Aug 08 04:44:38 dist-test-slave-vxj2 krb5kdc[11712](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164278, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260808 04:44:38.657768 11799 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b3d5223886fb4d34917f9259abb1f184: Neither blocks nor log segments found. Creating new log.
I20260808 04:44:38.658842 11799 log.cc:824] T 00000000000000000000000000000000 P b3d5223886fb4d34917f9259abb1f184: Log is configured to *not* fsync() on all Append() calls
I20260808 04:44:38.661697 11799 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b3d5223886fb4d34917f9259abb1f184: No bootstrap required, opened a new log
I20260808 04:44:38.662987 11803 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:38.647391 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.142:57593 (local address 127.0.0.1:44591)
0808 04:44:38.647886 (+ 495us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:38.647906 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:38.647951 (+ 45us) server_negotiation.cc:407] Connection header received
0808 04:44:38.648829 (+ 878us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:38.648865 (+ 36us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:38.649342 (+ 477us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:38.649716 (+ 374us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:44:38.650489 (+ 773us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:38.652015 (+ 1526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:38.652914 (+ 899us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:38.653687 (+ 773us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:38.653877 (+ 190us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:38.656753 (+ 2876us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:44:38.656759 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:44:38.656777 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:44:38.656814 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:44:38.659171 (+ 2357us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:44:38.659988 (+ 817us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:44:38.659994 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:44:38.660000 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:44:38.660146 (+ 146us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:44:38.660553 (+ 407us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:44:38.660556 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:44:38.660558 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:44:38.661098 (+ 540us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:44:38.661338 (+ 240us) server_negotiation.cc:1035] Waiting for connection context
0808 04:44:38.661723 (+ 385us) server_negotiation.cc:299] Negotiation successful
0808 04:44:38.661991 (+ 268us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":335,"thread_start_us":146,"threads_started":1}
I20260808 04:44:38.665917 11799 raft_consensus.cc:348] T 00000000000000000000000000000000 P b3d5223886fb4d34917f9259abb1f184 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b3d5223886fb4d34917f9259abb1f184" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44591 } }
I20260808 04:44:38.666160 11799 raft_consensus.cc:374] T 00000000000000000000000000000000 P b3d5223886fb4d34917f9259abb1f184 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:44:38.666224 11799 raft_consensus.cc:729] T 00000000000000000000000000000000 P b3d5223886fb4d34917f9259abb1f184 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3d5223886fb4d34917f9259abb1f184, State: Initialized, Role: FOLLOWER
I20260808 04:44:38.666508 21443 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 04:44:38.666798 11799 consensus_queue.cc:260] T 00000000000000000000000000000000 P b3d5223886fb4d34917f9259abb1f184 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b3d5223886fb4d34917f9259abb1f184" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44591 } }
I20260808 04:44:38.666966 11799 raft_consensus.cc:388] T 00000000000000000000000000000000 P b3d5223886fb4d34917f9259abb1f184 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 04:44:38.667043 11799 raft_consensus.cc:482] T 00000000000000000000000000000000 P b3d5223886fb4d34917f9259abb1f184 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 04:44:38.667152 11799 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b3d5223886fb4d34917f9259abb1f184 [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:44:38.668601 11799 raft_consensus.cc:504] T 00000000000000000000000000000000 P b3d5223886fb4d34917f9259abb1f184 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b3d5223886fb4d34917f9259abb1f184" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44591 } }
I20260808 04:44:38.669015 11799 leader_election.cc:302] T 00000000000000000000000000000000 P b3d5223886fb4d34917f9259abb1f184 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b3d5223886fb4d34917f9259abb1f184; no voters:
I20260808 04:44:38.669546 11799 leader_election.cc:288] T 00000000000000000000000000000000 P b3d5223886fb4d34917f9259abb1f184 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 04:44:38.669667 11810 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b3d5223886fb4d34917f9259abb1f184 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 04:44:38.670017 11810 raft_consensus.cc:686] T 00000000000000000000000000000000 P b3d5223886fb4d34917f9259abb1f184 [term 1 LEADER]: Becoming Leader. State: Replica: b3d5223886fb4d34917f9259abb1f184, State: Running, Role: LEADER
I20260808 04:44:38.670382 11810 consensus_queue.cc:237] T 00000000000000000000000000000000 P b3d5223886fb4d34917f9259abb1f184 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b3d5223886fb4d34917f9259abb1f184" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44591 } }
I20260808 04:44:38.671120 11799 sys_catalog.cc:564] T 00000000000000000000000000000000 P b3d5223886fb4d34917f9259abb1f184 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 04:44:38.672628 11811 sys_catalog.cc:455] T 00000000000000000000000000000000 P b3d5223886fb4d34917f9259abb1f184 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b3d5223886fb4d34917f9259abb1f184. Latest consensus state: current_term: 1 leader_uuid: "b3d5223886fb4d34917f9259abb1f184" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b3d5223886fb4d34917f9259abb1f184" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44591 } } }
I20260808 04:44:38.672791 11811 sys_catalog.cc:458] T 00000000000000000000000000000000 P b3d5223886fb4d34917f9259abb1f184 [sys.catalog]: This master's current role is: LEADER
I20260808 04:44:38.673213 11812 sys_catalog.cc:455] T 00000000000000000000000000000000 P b3d5223886fb4d34917f9259abb1f184 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b3d5223886fb4d34917f9259abb1f184" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b3d5223886fb4d34917f9259abb1f184" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44591 } } }
I20260808 04:44:38.673339 11812 sys_catalog.cc:458] T 00000000000000000000000000000000 P b3d5223886fb4d34917f9259abb1f184 [sys.catalog]: This master's current role is: LEADER
I20260808 04:44:38.673811 11820 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 04:44:38.677453 11820 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 04:44:38.679793 11803 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:38.669015 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.142:54787 (local address 127.0.0.1:44591)
0808 04:44:38.669198 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:38.669203 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:38.669385 (+ 182us) server_negotiation.cc:407] Connection header received
0808 04:44:38.669584 (+ 199us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:38.669587 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:38.669649 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:38.669753 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:44:38.670698 (+ 945us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:38.671647 (+ 949us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:38.672784 (+ 1137us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:38.673126 (+ 342us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:38.673266 (+ 140us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:38.675304 (+ 2038us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:44:38.675308 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:44:38.675311 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:44:38.675338 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:44:38.677100 (+ 1762us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:44:38.677803 (+ 703us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:44:38.677806 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:44:38.677808 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:44:38.677913 (+ 105us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:44:38.678338 (+ 425us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:44:38.678341 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:44:38.678343 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:44:38.678567 (+ 224us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:44:38.678723 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0808 04:44:38.679480 (+ 757us) server_negotiation.cc:299] Negotiation successful
0808 04:44:38.679608 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260808 04:44:38.684273 11820 catalog_manager.cc:1347] Generated new cluster ID: 322e3f0c0291429f8d59f1421a684889
I20260808 04:44:38.684353 11820 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 04:44:38.692835 11820 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 04:44:38.693907 11820 catalog_manager.cc:1504] Loading token signing keys...
I20260808 04:44:38.698933 11820 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b3d5223886fb4d34917f9259abb1f184: Generated new TSK 0
I20260808 04:44:38.699740 11820 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 04:44:38.710927 21443 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu with pid 11725
W20260808 04:44:38.718153 11710 connection.cc:535] client connection to 127.0.0.1:44591 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:44591): Connection reset by peer (error 104)
2026-08-08T04:44:38Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/6 (1500 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/7
Loading random data
Initializing database '/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786164000593138-21443-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 04:44:38 dist-test-slave-vxj2 krb5kdc[11834](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 04:44:38 dist-test-slave-vxj2 krb5kdc[11834](info): set up 2 sockets
Aug 08 04:44:38 dist-test-slave-vxj2 krb5kdc[11834](info): commencing operation
krb5kdc: starting...
W20260808 04:44:39.845270 21443 mini_kdc.cc:121] Time spent starting KDC: real 1.112s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786164000593138-21443-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786164000593138-21443-0/krb5kdc/test-user.keytab.
Aug 08 04:44:39 dist-test-slave-vxj2 krb5kdc[11834](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164279, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T04:44:39Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T04:44:39Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786164000593138-21443-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786164000593138-21443-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 04:44:39.981668 21443 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
/tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786164000593138-21443-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786164000593138-21443-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786164000593138-21443-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786164000593138-21443-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:38455
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786164000593138-21443-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:37323
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:38455
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786164000593138-21443-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786164000593138-21443-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786164000593138-21443-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 04:44:40.104331 11847 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:44:40.104632 11847 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:44:40.104677 11847 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:44:40.108891 11847 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 04:44:40.108973 11847 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:44:40.108995 11847 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:44:40.109012 11847 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 04:44:40.109028 11847 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 04:44:40.114807 11847 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:37323
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786164000593138-21443-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786164000593138-21443-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:38455
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786164000593138-21443-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:38455
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786164000593138-21443-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11847
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786164000593138-21443-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 04:05:18 UTC on ccycloud.quasar-drfdgt.root.comops.site
build id 4574101
I20260808 04:44:40.116046 11847 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:44:40.117054 11847 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:44:40.126080 11855 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:44:40.126067 11853 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:44:40.126310 11847 server_base.cc:1034] running on GCE node
W20260808 04:44:40.126067 11852 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:44:40.127127 11847 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:44:40.128419 11847 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:44:40.129644 11847 hybrid_clock.cc:648] HybridClock initialized: now 1786164280129629 us; error 28 us; skew 500 ppm
Aug 08 04:44:40 dist-test-slave-vxj2 krb5kdc[11834](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164280, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:44:40.132773 11847 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 04:44:40.133829 11847 webserver.cc:460] Webserver started at http://127.0.0.1:41467/ using document root <none> and password file <none>
I20260808 04:44:40.134418 11847 fs_manager.cc:359] Metadata directory not provided
I20260808 04:44:40.134481 11847 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:44:40.134663 11847 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 04:44:40.136884 11847 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786164000593138-21443-0/minicluster-data/master-0/data/instance:
uuid: "87c83e44ab6f4abb8ebb35fad21c7510"
format_stamp: "Formatted at 2026-08-08 04:44:40 on dist-test-slave-vxj2"
server_key: "783632f00c55b4da808949e51e838770"
server_key_iv: "0efa5abef036561ffed8ba7f4da1aa26"
server_key_version: "encryptionkey@0"
I20260808 04:44:40.137545 11847 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786164000593138-21443-0/minicluster-data/master-0/wal/instance:
uuid: "87c83e44ab6f4abb8ebb35fad21c7510"
format_stamp: "Formatted at 2026-08-08 04:44:40 on dist-test-slave-vxj2"
server_key: "783632f00c55b4da808949e51e838770"
server_key_iv: "0efa5abef036561ffed8ba7f4da1aa26"
server_key_version: "encryptionkey@0"
I20260808 04:44:40.141814 11847 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260808 04:44:40.144623 11862 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:44:40.146216 11847 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 04:44:40.146351 11847 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786164000593138-21443-0/minicluster-data/master-0/data,/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786164000593138-21443-0/minicluster-data/master-0/wal
uuid: "87c83e44ab6f4abb8ebb35fad21c7510"
format_stamp: "Formatted at 2026-08-08 04:44:40 on dist-test-slave-vxj2"
server_key: "783632f00c55b4da808949e51e838770"
server_key_iv: "0efa5abef036561ffed8ba7f4da1aa26"
server_key_version: "encryptionkey@0"
I20260808 04:44:40.146492 11847 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786164000593138-21443-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786164000593138-21443-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786164000593138-21443-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:44:40.168503 11847 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:44:40.173265 11847 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:44:40.173513 11847 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:44:40.184466 11847 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:38455
I20260808 04:44:40.184530 11916 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:38455 every 8 connection(s)
I20260808 04:44:40.185993 11847 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786164000593138-21443-0/minicluster-data/master-0/data/info.pb
I20260808 04:44:40.189489 21443 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu as pid 11847
I20260808 04:44:40.189543 11917 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:44:40.189648 21443 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786164000593138-21443-0/minicluster-data/master-0/wal/instance
I20260808 04:44:40.189981 21443 external_mini_cluster.cc:1428] Setting key 521c18da267f9ef0aaa363cf34a9ad5a
I20260808 04:44:40.197536 11917 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 87c83e44ab6f4abb8ebb35fad21c7510: Bootstrap starting.
I20260808 04:44:40.200785 11917 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 87c83e44ab6f4abb8ebb35fad21c7510: Neither blocks nor log segments found. Creating new log.
I20260808 04:44:40.201804 11917 log.cc:824] T 00000000000000000000000000000000 P 87c83e44ab6f4abb8ebb35fad21c7510: Log is configured to *not* fsync() on all Append() calls
I20260808 04:44:40.202661 11920 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:40.191876 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.142:43417 (local address 127.0.0.1:38455)
0808 04:44:40.192355 (+ 479us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:40.192376 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:40.192423 (+ 47us) server_negotiation.cc:407] Connection header received
0808 04:44:40.193223 (+ 800us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:40.193250 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:40.193788 (+ 538us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:40.194185 (+ 397us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:44:40.194800 (+ 615us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:40.196380 (+ 1580us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:40.197941 (+ 1561us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:40.198650 (+ 709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:40.198826 (+ 176us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:40.199994 (+ 1168us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:44:40.200002 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:44:40.200023 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 04:44:40.200656 (+ 633us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:44:40.200742 (+ 86us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 04:44:40.200784 (+ 42us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:44:40.200942 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0808 04:44:40.201265 (+ 323us) server_negotiation.cc:299] Negotiation successful
0808 04:44:40.201627 (+ 362us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":310,"thread_start_us":135,"threads_started":1}
I20260808 04:44:40.205767 11917 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 87c83e44ab6f4abb8ebb35fad21c7510: No bootstrap required, opened a new log
I20260808 04:44:40.206494 21443 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 04:44:40.210903 11917 raft_consensus.cc:348] T 00000000000000000000000000000000 P 87c83e44ab6f4abb8ebb35fad21c7510 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "87c83e44ab6f4abb8ebb35fad21c7510" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38455 } }
I20260808 04:44:40.211283 11917 raft_consensus.cc:374] T 00000000000000000000000000000000 P 87c83e44ab6f4abb8ebb35fad21c7510 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:44:40.211344 11917 raft_consensus.cc:729] T 00000000000000000000000000000000 P 87c83e44ab6f4abb8ebb35fad21c7510 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87c83e44ab6f4abb8ebb35fad21c7510, State: Initialized, Role: FOLLOWER
I20260808 04:44:40.211858 11917 consensus_queue.cc:260] T 00000000000000000000000000000000 P 87c83e44ab6f4abb8ebb35fad21c7510 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "87c83e44ab6f4abb8ebb35fad21c7510" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38455 } }
I20260808 04:44:40.212077 11917 raft_consensus.cc:388] T 00000000000000000000000000000000 P 87c83e44ab6f4abb8ebb35fad21c7510 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 04:44:40.212157 11917 raft_consensus.cc:482] T 00000000000000000000000000000000 P 87c83e44ab6f4abb8ebb35fad21c7510 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 04:44:40.212267 11917 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 87c83e44ab6f4abb8ebb35fad21c7510 [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:44:40.213743 11917 raft_consensus.cc:504] T 00000000000000000000000000000000 P 87c83e44ab6f4abb8ebb35fad21c7510 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "87c83e44ab6f4abb8ebb35fad21c7510" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38455 } }
I20260808 04:44:40.214013 11920 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:40.209053 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.142:41841 (local address 127.0.0.1:38455)
0808 04:44:40.209261 (+ 208us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:40.209269 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:40.209598 (+ 329us) server_negotiation.cc:407] Connection header received
0808 04:44:40.209774 (+ 176us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:40.209777 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:40.209826 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:40.209958 (+ 132us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:44:40.210275 (+ 317us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:40.210821 (+ 546us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:40.211986 (+ 1165us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:40.212408 (+ 422us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:40.212512 (+ 104us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:40.213435 (+ 923us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:44:40.213438 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:44:40.213440 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 04:44:40.213453 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:44:40.213478 (+ 25us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 04:44:40.213489 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:44:40.213560 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0808 04:44:40.213748 (+ 188us) server_negotiation.cc:299] Negotiation successful
0808 04:44:40.213782 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260808 04:44:40.214165 11917 leader_election.cc:302] T 00000000000000000000000000000000 P 87c83e44ab6f4abb8ebb35fad21c7510 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 87c83e44ab6f4abb8ebb35fad21c7510; no voters:
I20260808 04:44:40.214583 11917 leader_election.cc:288] T 00000000000000000000000000000000 P 87c83e44ab6f4abb8ebb35fad21c7510 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 04:44:40.214699 11928 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 87c83e44ab6f4abb8ebb35fad21c7510 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 04:44:40.214926 11928 raft_consensus.cc:686] T 00000000000000000000000000000000 P 87c83e44ab6f4abb8ebb35fad21c7510 [term 1 LEADER]: Becoming Leader. State: Replica: 87c83e44ab6f4abb8ebb35fad21c7510, State: Running, Role: LEADER
I20260808 04:44:40.215258 11928 consensus_queue.cc:237] T 00000000000000000000000000000000 P 87c83e44ab6f4abb8ebb35fad21c7510 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "87c83e44ab6f4abb8ebb35fad21c7510" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38455 } }
I20260808 04:44:40.215963 11917 sys_catalog.cc:564] T 00000000000000000000000000000000 P 87c83e44ab6f4abb8ebb35fad21c7510 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 04:44:40.217092 11929 sys_catalog.cc:455] T 00000000000000000000000000000000 P 87c83e44ab6f4abb8ebb35fad21c7510 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "87c83e44ab6f4abb8ebb35fad21c7510" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "87c83e44ab6f4abb8ebb35fad21c7510" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38455 } } }
I20260808 04:44:40.217253 11929 sys_catalog.cc:458] T 00000000000000000000000000000000 P 87c83e44ab6f4abb8ebb35fad21c7510 [sys.catalog]: This master's current role is: LEADER
I20260808 04:44:40.217540 11930 sys_catalog.cc:455] T 00000000000000000000000000000000 P 87c83e44ab6f4abb8ebb35fad21c7510 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 87c83e44ab6f4abb8ebb35fad21c7510. Latest consensus state: current_term: 1 leader_uuid: "87c83e44ab6f4abb8ebb35fad21c7510" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "87c83e44ab6f4abb8ebb35fad21c7510" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38455 } } }
I20260808 04:44:40.217626 11930 sys_catalog.cc:458] T 00000000000000000000000000000000 P 87c83e44ab6f4abb8ebb35fad21c7510 [sys.catalog]: This master's current role is: LEADER
I20260808 04:44:40.217661 11937 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 04:44:40.221010 11937 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 04:44:40.227854 11937 catalog_manager.cc:1347] Generated new cluster ID: 582d8c3986e44c0ea02e221ae3b4352c
I20260808 04:44:40.227964 11937 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 04:44:40.242208 11937 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 04:44:40.243284 11937 catalog_manager.cc:1504] Loading token signing keys...
I20260808 04:44:40.250204 11937 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 87c83e44ab6f4abb8ebb35fad21c7510: Generated new TSK 0
I20260808 04:44:40.251180 11937 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 04:44:40.263991 21443 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu with pid 11847
W20260808 04:44:40.271126 11830 connection.cc:535] client connection to 127.0.0.1:38455 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:38455): Connection reset by peer (error 104)
2026-08-08T04:44:40Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/7 (1553 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/8
Loading random data
Initializing database '/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786164000593138-21443-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 04:44:40 dist-test-slave-vxj2 krb5kdc[11951](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 04:44:40 dist-test-slave-vxj2 krb5kdc[11951](info): set up 2 sockets
Aug 08 04:44:40 dist-test-slave-vxj2 krb5kdc[11951](info): commencing operation
krb5kdc: starting...
W20260808 04:44:41.356398 21443 mini_kdc.cc:121] Time spent starting KDC: real 1.070s user 0.005s sys 0.001s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786164000593138-21443-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786164000593138-21443-0/krb5kdc/test-user.keytab.
Aug 08 04:44:41 dist-test-slave-vxj2 krb5kdc[11951](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164281, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T04:44:41Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T04:44:41Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786164000593138-21443-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786164000593138-21443-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 04:44:41.484627 21443 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
/tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786164000593138-21443-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786164000593138-21443-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786164000593138-21443-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786164000593138-21443-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46791
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786164000593138-21443-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:33497
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:46791
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786164000593138-21443-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786164000593138-21443-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786164000593138-21443-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 04:44:41.598281 11964 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:44:41.598604 11964 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:44:41.598651 11964 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:44:41.602888 11964 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 04:44:41.602974 11964 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:44:41.602994 11964 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:44:41.603011 11964 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 04:44:41.603027 11964 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 04:44:41.608628 11964 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:33497
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786164000593138-21443-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786164000593138-21443-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:46791
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786164000593138-21443-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46791
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786164000593138-21443-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11964
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786164000593138-21443-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 04:05:18 UTC on ccycloud.quasar-drfdgt.root.comops.site
build id 4574101
I20260808 04:44:41.609946 11964 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:44:41.611048 11964 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:44:41.619923 11969 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:44:41.619935 11971 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:44:41.620080 11964 server_base.cc:1034] running on GCE node
W20260808 04:44:41.620298 11973 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:44:41.620978 11964 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:44:41.622260 11964 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:44:41.623483 11964 hybrid_clock.cc:648] HybridClock initialized: now 1786164281623462 us; error 33 us; skew 500 ppm
Aug 08 04:44:41 dist-test-slave-vxj2 krb5kdc[11951](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164281, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:44:41.627035 11964 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 04:44:41.628086 11964 webserver.cc:460] Webserver started at http://127.0.0.1:33737/ using document root <none> and password file <none>
I20260808 04:44:41.628691 11964 fs_manager.cc:359] Metadata directory not provided
I20260808 04:44:41.628808 11964 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:44:41.629066 11964 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 04:44:41.631400 11964 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786164000593138-21443-0/minicluster-data/master-0/data/instance:
uuid: "05080ed313fb420b85f8165b58d834d9"
format_stamp: "Formatted at 2026-08-08 04:44:41 on dist-test-slave-vxj2"
server_key: "d63a1859c12ab6979f31a75532d7ee20"
server_key_iv: "03539740cce7c530fb5fcc2d0b9220bf"
server_key_version: "encryptionkey@0"
I20260808 04:44:41.632043 11964 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786164000593138-21443-0/minicluster-data/master-0/wal/instance:
uuid: "05080ed313fb420b85f8165b58d834d9"
format_stamp: "Formatted at 2026-08-08 04:44:41 on dist-test-slave-vxj2"
server_key: "d63a1859c12ab6979f31a75532d7ee20"
server_key_iv: "03539740cce7c530fb5fcc2d0b9220bf"
server_key_version: "encryptionkey@0"
I20260808 04:44:41.636255 11964 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.004s
I20260808 04:44:41.638860 11982 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:44:41.640158 11964 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 04:44:41.640314 11964 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786164000593138-21443-0/minicluster-data/master-0/data,/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786164000593138-21443-0/minicluster-data/master-0/wal
uuid: "05080ed313fb420b85f8165b58d834d9"
format_stamp: "Formatted at 2026-08-08 04:44:41 on dist-test-slave-vxj2"
server_key: "d63a1859c12ab6979f31a75532d7ee20"
server_key_iv: "03539740cce7c530fb5fcc2d0b9220bf"
server_key_version: "encryptionkey@0"
I20260808 04:44:41.640435 11964 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786164000593138-21443-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786164000593138-21443-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786164000593138-21443-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:44:41.645267 11964 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:44:41.648310 11964 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:44:41.648528 11964 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:44:41.655949 11964 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:46791
I20260808 04:44:41.656013 12036 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:46791 every 8 connection(s)
I20260808 04:44:41.656967 11964 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786164000593138-21443-0/minicluster-data/master-0/data/info.pb
I20260808 04:44:41.659792 12037 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:44:41.661767 21443 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu as pid 11964
I20260808 04:44:41.661963 21443 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786164000593138-21443-0/minicluster-data/master-0/wal/instance
I20260808 04:44:41.662257 21443 external_mini_cluster.cc:1428] Setting key fc103273eb009cbdb51b8d7f18fdc40a
I20260808 04:44:41.666401 12037 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 05080ed313fb420b85f8165b58d834d9: Bootstrap starting.
I20260808 04:44:41.668241 12040 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:41.663710 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.142:34067 (local address 127.0.0.1:46791)
0808 04:44:41.664156 (+ 446us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:41.664175 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:41.664220 (+ 45us) server_negotiation.cc:407] Connection header received
0808 04:44:41.665227 (+ 1007us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:41.665250 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:41.665619 (+ 369us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:41.665990 (+ 371us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:44:41.666821 (+ 831us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:44:41.666826 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:44:41.666841 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 04:44:41.666853 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:44:41.666917 (+ 64us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 04:44:41.666943 (+ 26us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:44:41.667084 (+ 141us) server_negotiation.cc:1035] Waiting for connection context
0808 04:44:41.667149 (+ 65us) server_negotiation.cc:299] Negotiation successful
0808 04:44:41.667316 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":295,"thread_start_us":123,"threads_started":1}
I20260808 04:44:41.669216 12037 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 05080ed313fb420b85f8165b58d834d9: Neither blocks nor log segments found. Creating new log.
I20260808 04:44:41.670054 12037 log.cc:824] T 00000000000000000000000000000000 P 05080ed313fb420b85f8165b58d834d9: Log is configured to *not* fsync() on all Append() calls
I20260808 04:44:41.671250 21443 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 04:44:41.672250 12037 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 05080ed313fb420b85f8165b58d834d9: No bootstrap required, opened a new log
I20260808 04:44:41.675218 12040 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:41.673467 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.142:40023 (local address 127.0.0.1:46791)
0808 04:44:41.673614 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:41.673619 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:41.673837 (+ 218us) server_negotiation.cc:407] Connection header received
0808 04:44:41.673972 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:41.673974 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:41.674006 (+ 32us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:41.674075 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:44:41.674798 (+ 723us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:44:41.674801 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:44:41.674803 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 04:44:41.674813 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:44:41.674839 (+ 26us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 04:44:41.674849 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:44:41.674920 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0808 04:44:41.675024 (+ 104us) server_negotiation.cc:299] Negotiation successful
0808 04:44:41.675061 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260808 04:44:41.677057 12037 raft_consensus.cc:348] T 00000000000000000000000000000000 P 05080ed313fb420b85f8165b58d834d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "05080ed313fb420b85f8165b58d834d9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46791 } }
I20260808 04:44:41.677384 12037 raft_consensus.cc:374] T 00000000000000000000000000000000 P 05080ed313fb420b85f8165b58d834d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:44:41.677428 12037 raft_consensus.cc:729] T 00000000000000000000000000000000 P 05080ed313fb420b85f8165b58d834d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 05080ed313fb420b85f8165b58d834d9, State: Initialized, Role: FOLLOWER
I20260808 04:44:41.677935 12037 consensus_queue.cc:260] T 00000000000000000000000000000000 P 05080ed313fb420b85f8165b58d834d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "05080ed313fb420b85f8165b58d834d9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46791 } }
I20260808 04:44:41.678107 12037 raft_consensus.cc:388] T 00000000000000000000000000000000 P 05080ed313fb420b85f8165b58d834d9 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 04:44:41.678197 12037 raft_consensus.cc:482] T 00000000000000000000000000000000 P 05080ed313fb420b85f8165b58d834d9 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 04:44:41.678313 12037 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 05080ed313fb420b85f8165b58d834d9 [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:44:41.679575 12037 raft_consensus.cc:504] T 00000000000000000000000000000000 P 05080ed313fb420b85f8165b58d834d9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "05080ed313fb420b85f8165b58d834d9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46791 } }
I20260808 04:44:41.679965 12037 leader_election.cc:302] T 00000000000000000000000000000000 P 05080ed313fb420b85f8165b58d834d9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 05080ed313fb420b85f8165b58d834d9; no voters:
I20260808 04:44:41.680308 12037 leader_election.cc:288] T 00000000000000000000000000000000 P 05080ed313fb420b85f8165b58d834d9 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 04:44:41.680488 12047 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 05080ed313fb420b85f8165b58d834d9 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 04:44:41.680722 12047 raft_consensus.cc:686] T 00000000000000000000000000000000 P 05080ed313fb420b85f8165b58d834d9 [term 1 LEADER]: Becoming Leader. State: Replica: 05080ed313fb420b85f8165b58d834d9, State: Running, Role: LEADER
I20260808 04:44:41.681115 12047 consensus_queue.cc:237] T 00000000000000000000000000000000 P 05080ed313fb420b85f8165b58d834d9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "05080ed313fb420b85f8165b58d834d9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46791 } }
I20260808 04:44:41.681763 12037 sys_catalog.cc:564] T 00000000000000000000000000000000 P 05080ed313fb420b85f8165b58d834d9 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 04:44:41.682912 12048 sys_catalog.cc:455] T 00000000000000000000000000000000 P 05080ed313fb420b85f8165b58d834d9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "05080ed313fb420b85f8165b58d834d9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "05080ed313fb420b85f8165b58d834d9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46791 } } }
I20260808 04:44:41.683044 12048 sys_catalog.cc:458] T 00000000000000000000000000000000 P 05080ed313fb420b85f8165b58d834d9 [sys.catalog]: This master's current role is: LEADER
I20260808 04:44:41.683238 12049 sys_catalog.cc:455] T 00000000000000000000000000000000 P 05080ed313fb420b85f8165b58d834d9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 05080ed313fb420b85f8165b58d834d9. Latest consensus state: current_term: 1 leader_uuid: "05080ed313fb420b85f8165b58d834d9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "05080ed313fb420b85f8165b58d834d9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46791 } } }
I20260808 04:44:41.683344 12049 sys_catalog.cc:458] T 00000000000000000000000000000000 P 05080ed313fb420b85f8165b58d834d9 [sys.catalog]: This master's current role is: LEADER
I20260808 04:44:41.683672 12056 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 04:44:41.687098 12056 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 04:44:41.693007 12056 catalog_manager.cc:1347] Generated new cluster ID: c6919b3e7f98445d8c216186d8592a6d
I20260808 04:44:41.693181 12056 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 04:44:41.713204 12056 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 04:44:41.713552 12056 catalog_manager.cc:1504] Loading token signing keys...
I20260808 04:44:41.717665 12056 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 05080ed313fb420b85f8165b58d834d9: Generated new TSK 0
I20260808 04:44:41.718328 12056 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 04:44:41.728219 21443 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu with pid 11964
2026-08-08T04:44:41Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/8 (1465 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/9
Loading random data
Initializing database '/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786164000593138-21443-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 04:44:41 dist-test-slave-vxj2 krb5kdc[12070](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 04:44:41 dist-test-slave-vxj2 krb5kdc[12070](info): set up 2 sockets
Aug 08 04:44:41 dist-test-slave-vxj2 krb5kdc[12070](info): commencing operation
krb5kdc: starting...
W20260808 04:44:42.824000 21443 mini_kdc.cc:121] Time spent starting KDC: real 1.072s user 0.001s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786164000593138-21443-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786164000593138-21443-0/krb5kdc/test-user.keytab.
Aug 08 04:44:42 dist-test-slave-vxj2 krb5kdc[12070](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164282, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T04:44:42Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T04:44:42Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786164000593138-21443-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786164000593138-21443-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 04:44:42.953368 21443 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
/tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786164000593138-21443-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786164000593138-21443-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786164000593138-21443-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786164000593138-21443-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39401
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786164000593138-21443-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:34745
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:39401
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786164000593138-21443-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786164000593138-21443-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786164000593138-21443-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 04:44:43.068159 12084 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:44:43.068472 12084 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:44:43.068517 12084 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:44:43.072717 12084 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 04:44:43.072790 12084 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:44:43.072817 12084 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:44:43.072865 12084 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 04:44:43.072898 12084 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 04:44:43.078511 12084 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:34745
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786164000593138-21443-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786164000593138-21443-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:39401
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786164000593138-21443-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39401
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786164000593138-21443-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12084
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786164000593138-21443-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 04:05:18 UTC on ccycloud.quasar-drfdgt.root.comops.site
build id 4574101
I20260808 04:44:43.079643 12084 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:44:43.080674 12084 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:44:43.089552 12089 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:44:43.089564 12092 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:44:43.089663 12084 server_base.cc:1034] running on GCE node
W20260808 04:44:43.089725 12090 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:44:43.090476 12084 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:44:43.091656 12084 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:44:43.092957 12084 hybrid_clock.cc:648] HybridClock initialized: now 1786164283092921 us; error 48 us; skew 500 ppm
Aug 08 04:44:43 dist-test-slave-vxj2 krb5kdc[12070](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164283, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:44:43.095973 12084 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 04:44:43.096987 12084 webserver.cc:460] Webserver started at http://127.0.0.1:45437/ using document root <none> and password file <none>
I20260808 04:44:43.097692 12084 fs_manager.cc:359] Metadata directory not provided
I20260808 04:44:43.097795 12084 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:44:43.098045 12084 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 04:44:43.100270 12084 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786164000593138-21443-0/minicluster-data/master-0/data/instance:
uuid: "7ff0a5a044da489486d4017c0c6f832c"
format_stamp: "Formatted at 2026-08-08 04:44:43 on dist-test-slave-vxj2"
server_key: "2293f4d221e47f9869cc3f78c1c57002"
server_key_iv: "b43391d513a95f499ed771484f43d7fd"
server_key_version: "encryptionkey@0"
I20260808 04:44:43.100914 12084 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786164000593138-21443-0/minicluster-data/master-0/wal/instance:
uuid: "7ff0a5a044da489486d4017c0c6f832c"
format_stamp: "Formatted at 2026-08-08 04:44:43 on dist-test-slave-vxj2"
server_key: "2293f4d221e47f9869cc3f78c1c57002"
server_key_iv: "b43391d513a95f499ed771484f43d7fd"
server_key_version: "encryptionkey@0"
I20260808 04:44:43.104914 12084 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.001s
I20260808 04:44:43.107573 12099 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:44:43.108875 12084 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 04:44:43.109030 12084 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786164000593138-21443-0/minicluster-data/master-0/data,/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786164000593138-21443-0/minicluster-data/master-0/wal
uuid: "7ff0a5a044da489486d4017c0c6f832c"
format_stamp: "Formatted at 2026-08-08 04:44:43 on dist-test-slave-vxj2"
server_key: "2293f4d221e47f9869cc3f78c1c57002"
server_key_iv: "b43391d513a95f499ed771484f43d7fd"
server_key_version: "encryptionkey@0"
I20260808 04:44:43.109156 12084 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786164000593138-21443-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786164000593138-21443-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786164000593138-21443-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:44:43.134888 12084 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:44:43.138438 12084 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:44:43.138688 12084 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:44:43.146356 12084 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:39401
I20260808 04:44:43.146382 12156 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:39401 every 8 connection(s)
I20260808 04:44:43.147349 12084 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786164000593138-21443-0/minicluster-data/master-0/data/info.pb
I20260808 04:44:43.150564 21443 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu as pid 12084
I20260808 04:44:43.150647 12157 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:44:43.150727 21443 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786164000593138-21443-0/minicluster-data/master-0/wal/instance
I20260808 04:44:43.151060 21443 external_mini_cluster.cc:1428] Setting key 08b9def80bce55b243e61552ebef5a28
I20260808 04:44:43.157824 12157 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7ff0a5a044da489486d4017c0c6f832c: Bootstrap starting.
I20260808 04:44:43.160713 12157 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7ff0a5a044da489486d4017c0c6f832c: Neither blocks nor log segments found. Creating new log.
Aug 08 04:44:43 dist-test-slave-vxj2 krb5kdc[12070](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164282, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260808 04:44:43.161551 12157 log.cc:824] T 00000000000000000000000000000000 P 7ff0a5a044da489486d4017c0c6f832c: Log is configured to *not* fsync() on all Append() calls
I20260808 04:44:43.163614 12157 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7ff0a5a044da489486d4017c0c6f832c: No bootstrap required, opened a new log
I20260808 04:44:43.166496 12161 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:43.152481 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.142:45251 (local address 127.0.0.1:39401)
0808 04:44:43.152954 (+ 473us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:43.152977 (+ 23us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:43.153015 (+ 38us) server_negotiation.cc:407] Connection header received
0808 04:44:43.153974 (+ 959us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:43.153995 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:43.154347 (+ 352us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:43.154636 (+ 289us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:44:43.155606 (+ 970us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:43.156712 (+ 1106us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:43.157911 (+ 1199us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:43.158436 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:43.158564 (+ 128us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:43.161478 (+ 2914us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:44:43.161483 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:44:43.161497 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:44:43.161526 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:44:43.163342 (+ 1816us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:44:43.163968 (+ 626us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:44:43.163973 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:44:43.163978 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:44:43.164095 (+ 117us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:44:43.164464 (+ 369us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:44:43.164467 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:44:43.164468 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:44:43.164868 (+ 400us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:44:43.165115 (+ 247us) server_negotiation.cc:1035] Waiting for connection context
0808 04:44:43.165448 (+ 333us) server_negotiation.cc:299] Negotiation successful
0808 04:44:43.165695 (+ 247us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":316,"thread_start_us":161,"threads_started":1}
I20260808 04:44:43.167573 12157 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7ff0a5a044da489486d4017c0c6f832c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7ff0a5a044da489486d4017c0c6f832c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39401 } }
I20260808 04:44:43.167873 12157 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7ff0a5a044da489486d4017c0c6f832c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:44:43.167944 12157 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7ff0a5a044da489486d4017c0c6f832c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ff0a5a044da489486d4017c0c6f832c, State: Initialized, Role: FOLLOWER
I20260808 04:44:43.168411 12157 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7ff0a5a044da489486d4017c0c6f832c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7ff0a5a044da489486d4017c0c6f832c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39401 } }
I20260808 04:44:43.168591 12157 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7ff0a5a044da489486d4017c0c6f832c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 04:44:43.168665 12157 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7ff0a5a044da489486d4017c0c6f832c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 04:44:43.168768 12157 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7ff0a5a044da489486d4017c0c6f832c [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:44:43.169893 21443 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 04:44:43.170123 12157 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7ff0a5a044da489486d4017c0c6f832c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7ff0a5a044da489486d4017c0c6f832c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39401 } }
I20260808 04:44:43.170516 12157 leader_election.cc:302] T 00000000000000000000000000000000 P 7ff0a5a044da489486d4017c0c6f832c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7ff0a5a044da489486d4017c0c6f832c; no voters:
I20260808 04:44:43.170902 12157 leader_election.cc:288] T 00000000000000000000000000000000 P 7ff0a5a044da489486d4017c0c6f832c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 04:44:43.171018 12163 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7ff0a5a044da489486d4017c0c6f832c [term 1 FOLLOWER]: Leader election won for term 1
I20260808 04:44:43.171273 12163 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7ff0a5a044da489486d4017c0c6f832c [term 1 LEADER]: Becoming Leader. State: Replica: 7ff0a5a044da489486d4017c0c6f832c, State: Running, Role: LEADER
I20260808 04:44:43.171666 12163 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7ff0a5a044da489486d4017c0c6f832c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7ff0a5a044da489486d4017c0c6f832c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39401 } }
I20260808 04:44:43.172367 12157 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7ff0a5a044da489486d4017c0c6f832c [sys.catalog]: configured and running, proceeding with master startup.
I20260808 04:44:43.173666 12165 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7ff0a5a044da489486d4017c0c6f832c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7ff0a5a044da489486d4017c0c6f832c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7ff0a5a044da489486d4017c0c6f832c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39401 } } }
I20260808 04:44:43.173811 12165 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7ff0a5a044da489486d4017c0c6f832c [sys.catalog]: This master's current role is: LEADER
I20260808 04:44:43.174127 12164 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7ff0a5a044da489486d4017c0c6f832c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7ff0a5a044da489486d4017c0c6f832c. Latest consensus state: current_term: 1 leader_uuid: "7ff0a5a044da489486d4017c0c6f832c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7ff0a5a044da489486d4017c0c6f832c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39401 } } }
I20260808 04:44:43.174237 12164 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7ff0a5a044da489486d4017c0c6f832c [sys.catalog]: This master's current role is: LEADER
W20260808 04:44:43.177412 12183 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 7ff0a5a044da489486d4017c0c6f832c: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 04:44:43.177529 12183 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 04:44:43.177604 12177 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 04:44:43.178413 12177 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 04:44:43.182835 12161 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:43.172606 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.142:45231 (local address 127.0.0.1:39401)
0808 04:44:43.172711 (+ 105us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:43.172716 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:43.173048 (+ 332us) server_negotiation.cc:407] Connection header received
0808 04:44:43.173287 (+ 239us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:43.173290 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:43.173349 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:43.173409 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:44:43.175006 (+ 1597us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:43.175755 (+ 749us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:43.176920 (+ 1165us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:43.177286 (+ 366us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:43.177394 (+ 108us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:43.179179 (+ 1785us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:44:43.179183 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:44:43.179186 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:44:43.179213 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:44:43.180870 (+ 1657us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:44:43.181470 (+ 600us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:44:43.181474 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:44:43.181476 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:44:43.181567 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:44:43.181915 (+ 348us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:44:43.181919 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:44:43.181920 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:44:43.182110 (+ 190us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:44:43.182287 (+ 177us) server_negotiation.cc:1035] Waiting for connection context
0808 04:44:43.182567 (+ 280us) server_negotiation.cc:299] Negotiation successful
0808 04:44:43.182665 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260808 04:44:43.185037 12177 catalog_manager.cc:1347] Generated new cluster ID: 35dbe1fefe4443f3a3fead305b0f9081
I20260808 04:44:43.185106 12177 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 04:44:43.206141 12177 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 04:44:43.207598 12177 catalog_manager.cc:1504] Loading token signing keys...
I20260808 04:44:43.214252 12177 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 7ff0a5a044da489486d4017c0c6f832c: Generated new TSK 0
I20260808 04:44:43.215139 12177 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 04:44:43.220698 21443 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu with pid 12084
W20260808 04:44:43.227952 12068 connection.cc:535] client connection to 127.0.0.1:39401 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:39401): Connection reset by peer (error 104)
2026-08-08T04:44:43Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/9 (1491 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/10
Loading random data
Initializing database '/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786164000593138-21443-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 04:44:43 dist-test-slave-vxj2 krb5kdc[12189](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 04:44:43 dist-test-slave-vxj2 krb5kdc[12189](info): set up 2 sockets
Aug 08 04:44:43 dist-test-slave-vxj2 krb5kdc[12189](info): commencing operation
krb5kdc: starting...
W20260808 04:44:44.323622 21443 mini_kdc.cc:121] Time spent starting KDC: real 1.080s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786164000593138-21443-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786164000593138-21443-0/krb5kdc/test-user.keytab.
Aug 08 04:44:44 dist-test-slave-vxj2 krb5kdc[12189](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164284, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T04:44:44Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T04:44:44Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786164000593138-21443-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786164000593138-21443-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 04:44:44.454767 21443 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
/tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786164000593138-21443-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786164000593138-21443-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786164000593138-21443-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786164000593138-21443-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43609
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786164000593138-21443-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:35055
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:43609
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786164000593138-21443-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786164000593138-21443-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786164000593138-21443-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 04:44:44.570216 12204 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:44:44.570564 12204 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:44:44.570643 12204 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:44:44.574750 12204 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 04:44:44.574868 12204 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:44:44.574913 12204 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:44:44.574952 12204 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 04:44:44.575001 12204 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 04:44:44.580507 12204 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:35055
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786164000593138-21443-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786164000593138-21443-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:43609
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786164000593138-21443-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43609
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786164000593138-21443-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12204
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786164000593138-21443-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 04:05:18 UTC on ccycloud.quasar-drfdgt.root.comops.site
build id 4574101
I20260808 04:44:44.581737 12204 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:44:44.582858 12204 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:44:44.591904 12212 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:44:44.591804 12210 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:44:44.592082 12204 server_base.cc:1034] running on GCE node
W20260808 04:44:44.591802 12209 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:44:44.592871 12204 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:44:44.594117 12204 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:44:44.595309 12204 hybrid_clock.cc:648] HybridClock initialized: now 1786164284595275 us; error 44 us; skew 500 ppm
Aug 08 04:44:44 dist-test-slave-vxj2 krb5kdc[12189](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164284, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:44:44.602135 12204 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 04:44:44.603144 12204 webserver.cc:460] Webserver started at http://127.0.0.1:45561/ using document root <none> and password file <none>
I20260808 04:44:44.603734 12204 fs_manager.cc:359] Metadata directory not provided
I20260808 04:44:44.603874 12204 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:44:44.604120 12204 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 04:44:44.606860 12204 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786164000593138-21443-0/minicluster-data/master-0/data/instance:
uuid: "8518e7229315457e95650f2350f1bdfd"
format_stamp: "Formatted at 2026-08-08 04:44:44 on dist-test-slave-vxj2"
server_key: "77d2678401a458a8414890683eee88bd"
server_key_iv: "9874091bec5e3c26894c99078f0e93ba"
server_key_version: "encryptionkey@0"
I20260808 04:44:44.607455 12204 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786164000593138-21443-0/minicluster-data/master-0/wal/instance:
uuid: "8518e7229315457e95650f2350f1bdfd"
format_stamp: "Formatted at 2026-08-08 04:44:44 on dist-test-slave-vxj2"
server_key: "77d2678401a458a8414890683eee88bd"
server_key_iv: "9874091bec5e3c26894c99078f0e93ba"
server_key_version: "encryptionkey@0"
I20260808 04:44:44.611492 12204 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.001s sys 0.004s
I20260808 04:44:44.614171 12220 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:44:44.615473 12204 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 04:44:44.615641 12204 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786164000593138-21443-0/minicluster-data/master-0/data,/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786164000593138-21443-0/minicluster-data/master-0/wal
uuid: "8518e7229315457e95650f2350f1bdfd"
format_stamp: "Formatted at 2026-08-08 04:44:44 on dist-test-slave-vxj2"
server_key: "77d2678401a458a8414890683eee88bd"
server_key_iv: "9874091bec5e3c26894c99078f0e93ba"
server_key_version: "encryptionkey@0"
I20260808 04:44:44.615772 12204 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786164000593138-21443-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786164000593138-21443-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786164000593138-21443-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:44:44.638916 12204 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:44:44.642546 12204 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:44:44.642766 12204 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:44:44.650394 12204 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:43609
I20260808 04:44:44.650414 12277 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:43609 every 8 connection(s)
I20260808 04:44:44.651386 12204 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786164000593138-21443-0/minicluster-data/master-0/data/info.pb
I20260808 04:44:44.652298 21443 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu as pid 12204
I20260808 04:44:44.652448 21443 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786164000593138-21443-0/minicluster-data/master-0/wal/instance
I20260808 04:44:44.652761 21443 external_mini_cluster.cc:1428] Setting key 5df84dae2b8e72826b62ba4214c4a297
I20260808 04:44:44.654783 12278 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:44:44.660696 12278 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8518e7229315457e95650f2350f1bdfd: Bootstrap starting.
I20260808 04:44:44.662410 12281 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:44.654292 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.142:38425 (local address 127.0.0.1:43609)
0808 04:44:44.654751 (+ 459us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:44.654801 (+ 50us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:44.654874 (+ 73us) server_negotiation.cc:407] Connection header received
0808 04:44:44.655563 (+ 689us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:44.655580 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:44.655933 (+ 353us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:44.656273 (+ 340us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:44:44.656683 (+ 410us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:44.657800 (+ 1117us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:44.658734 (+ 934us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:44.659245 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:44.659422 (+ 177us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:44.660484 (+ 1062us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:44:44.660489 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:44:44.660501 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 04:44:44.661000 (+ 499us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:44:44.661059 (+ 59us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 04:44:44.661084 (+ 25us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:44:44.661289 (+ 205us) server_negotiation.cc:1035] Waiting for connection context
0808 04:44:44.661448 (+ 159us) server_negotiation.cc:299] Negotiation successful
0808 04:44:44.661613 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":319,"thread_start_us":152,"threads_started":1}
I20260808 04:44:44.663210 12278 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8518e7229315457e95650f2350f1bdfd: Neither blocks nor log segments found. Creating new log.
I20260808 04:44:44.664137 12278 log.cc:824] T 00000000000000000000000000000000 P 8518e7229315457e95650f2350f1bdfd: Log is configured to *not* fsync() on all Append() calls
I20260808 04:44:44.665730 21443 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 04:44:44.666495 12278 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8518e7229315457e95650f2350f1bdfd: No bootstrap required, opened a new log
I20260808 04:44:44.670444 12278 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8518e7229315457e95650f2350f1bdfd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8518e7229315457e95650f2350f1bdfd" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43609 } }
I20260808 04:44:44.670727 12278 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8518e7229315457e95650f2350f1bdfd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:44:44.670825 12278 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8518e7229315457e95650f2350f1bdfd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8518e7229315457e95650f2350f1bdfd, State: Initialized, Role: FOLLOWER
I20260808 04:44:44.671277 12278 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8518e7229315457e95650f2350f1bdfd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8518e7229315457e95650f2350f1bdfd" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43609 } }
I20260808 04:44:44.671404 12278 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8518e7229315457e95650f2350f1bdfd [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 04:44:44.671550 12278 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8518e7229315457e95650f2350f1bdfd [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 04:44:44.671663 12278 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8518e7229315457e95650f2350f1bdfd [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:44:44.672043 12281 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:44.667933 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.142:43831 (local address 127.0.0.1:43609)
0808 04:44:44.668053 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:44.668056 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:44.668299 (+ 243us) server_negotiation.cc:407] Connection header received
0808 04:44:44.668446 (+ 147us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:44.668450 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:44.668501 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:44.668588 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:44:44.668867 (+ 279us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:44.669458 (+ 591us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:44.670288 (+ 830us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:44.670526 (+ 238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:44.670642 (+ 116us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:44.671556 (+ 914us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:44:44.671562 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:44:44.671569 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 04:44:44.671581 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:44:44.671628 (+ 47us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 04:44:44.671646 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:44:44.671732 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0808 04:44:44.671857 (+ 125us) server_negotiation.cc:299] Negotiation successful
0808 04:44:44.671894 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260808 04:44:44.672982 12278 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8518e7229315457e95650f2350f1bdfd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8518e7229315457e95650f2350f1bdfd" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43609 } }
I20260808 04:44:44.673429 12278 leader_election.cc:302] T 00000000000000000000000000000000 P 8518e7229315457e95650f2350f1bdfd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8518e7229315457e95650f2350f1bdfd; no voters:
I20260808 04:44:44.673779 12278 leader_election.cc:288] T 00000000000000000000000000000000 P 8518e7229315457e95650f2350f1bdfd [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 04:44:44.673935 12289 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8518e7229315457e95650f2350f1bdfd [term 1 FOLLOWER]: Leader election won for term 1
I20260808 04:44:44.674190 12289 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8518e7229315457e95650f2350f1bdfd [term 1 LEADER]: Becoming Leader. State: Replica: 8518e7229315457e95650f2350f1bdfd, State: Running, Role: LEADER
I20260808 04:44:44.674541 12289 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8518e7229315457e95650f2350f1bdfd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8518e7229315457e95650f2350f1bdfd" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43609 } }
I20260808 04:44:44.675132 12278 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8518e7229315457e95650f2350f1bdfd [sys.catalog]: configured and running, proceeding with master startup.
I20260808 04:44:44.676169 12291 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8518e7229315457e95650f2350f1bdfd [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8518e7229315457e95650f2350f1bdfd. Latest consensus state: current_term: 1 leader_uuid: "8518e7229315457e95650f2350f1bdfd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8518e7229315457e95650f2350f1bdfd" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43609 } } }
I20260808 04:44:44.676321 12291 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8518e7229315457e95650f2350f1bdfd [sys.catalog]: This master's current role is: LEADER
I20260808 04:44:44.676723 12299 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 04:44:44.677981 12290 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8518e7229315457e95650f2350f1bdfd [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8518e7229315457e95650f2350f1bdfd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8518e7229315457e95650f2350f1bdfd" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43609 } } }
I20260808 04:44:44.678087 12290 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8518e7229315457e95650f2350f1bdfd [sys.catalog]: This master's current role is: LEADER
I20260808 04:44:44.680238 12299 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 04:44:44.687065 12299 catalog_manager.cc:1347] Generated new cluster ID: 199bc3c3ea3f4b99b23f0d287d98813c
I20260808 04:44:44.687181 12299 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 04:44:44.696039 12299 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 04:44:44.697415 12299 catalog_manager.cc:1504] Loading token signing keys...
I20260808 04:44:44.711841 12299 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8518e7229315457e95650f2350f1bdfd: Generated new TSK 0
I20260808 04:44:44.712809 12299 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 04:44:44.724830 21443 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu with pid 12204
W20260808 04:44:44.731858 12187 connection.cc:535] client connection to 127.0.0.1:43609 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:43609): Connection reset by peer (error 104)
2026-08-08T04:44:44Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/10 (1503 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/11
Loading random data
Initializing database '/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786164000593138-21443-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 04:44:44 dist-test-slave-vxj2 krb5kdc[12313](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 04:44:44 dist-test-slave-vxj2 krb5kdc[12313](info): set up 2 sockets
Aug 08 04:44:44 dist-test-slave-vxj2 krb5kdc[12313](info): commencing operation
krb5kdc: starting...
W20260808 04:44:45.839365 21443 mini_kdc.cc:121] Time spent starting KDC: real 1.092s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786164000593138-21443-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786164000593138-21443-0/krb5kdc/test-user.keytab.
Aug 08 04:44:45 dist-test-slave-vxj2 krb5kdc[12313](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164285, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T04:44:45Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T04:44:45Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786164000593138-21443-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786164000593138-21443-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 04:44:45.973419 21443 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
/tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786164000593138-21443-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786164000593138-21443-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786164000593138-21443-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786164000593138-21443-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:35731
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786164000593138-21443-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:35391
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:35731
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786164000593138-21443-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786164000593138-21443-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786164000593138-21443-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 04:44:46.090855 12326 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:44:46.091219 12326 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:44:46.091301 12326 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:44:46.095482 12326 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 04:44:46.095598 12326 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:44:46.095638 12326 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:44:46.095676 12326 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 04:44:46.095711 12326 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 04:44:46.101246 12326 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:35391
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786164000593138-21443-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786164000593138-21443-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:35731
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786164000593138-21443-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:35731
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786164000593138-21443-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12326
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786164000593138-21443-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 04:05:18 UTC on ccycloud.quasar-drfdgt.root.comops.site
build id 4574101
I20260808 04:44:46.102471 12326 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:44:46.103564 12326 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:44:46.112640 12331 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:44:46.112710 12334 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:44:46.112682 12326 server_base.cc:1034] running on GCE node
W20260808 04:44:46.112661 12332 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:44:46.113545 12326 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:44:46.114753 12326 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:44:46.115957 12326 hybrid_clock.cc:648] HybridClock initialized: now 1786164286115930 us; error 52 us; skew 500 ppm
Aug 08 04:44:46 dist-test-slave-vxj2 krb5kdc[12313](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164286, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:44:46.118993 12326 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 04:44:46.120137 12326 webserver.cc:460] Webserver started at http://127.0.0.1:37343/ using document root <none> and password file <none>
I20260808 04:44:46.120769 12326 fs_manager.cc:359] Metadata directory not provided
I20260808 04:44:46.120873 12326 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:44:46.121134 12326 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 04:44:46.123471 12326 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786164000593138-21443-0/minicluster-data/master-0/data/instance:
uuid: "17d484402e2c43139aec0e0cc2277c59"
format_stamp: "Formatted at 2026-08-08 04:44:46 on dist-test-slave-vxj2"
server_key: "7d19a9c851fa84041677a0ad222f5e19"
server_key_iv: "b88517039b05afd7bc10a71a246c0c96"
server_key_version: "encryptionkey@0"
I20260808 04:44:46.124119 12326 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786164000593138-21443-0/minicluster-data/master-0/wal/instance:
uuid: "17d484402e2c43139aec0e0cc2277c59"
format_stamp: "Formatted at 2026-08-08 04:44:46 on dist-test-slave-vxj2"
server_key: "7d19a9c851fa84041677a0ad222f5e19"
server_key_iv: "b88517039b05afd7bc10a71a246c0c96"
server_key_version: "encryptionkey@0"
I20260808 04:44:46.128474 12326 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.003s
I20260808 04:44:46.131300 12342 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:44:46.132634 12326 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 04:44:46.132841 12326 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786164000593138-21443-0/minicluster-data/master-0/data,/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786164000593138-21443-0/minicluster-data/master-0/wal
uuid: "17d484402e2c43139aec0e0cc2277c59"
format_stamp: "Formatted at 2026-08-08 04:44:46 on dist-test-slave-vxj2"
server_key: "7d19a9c851fa84041677a0ad222f5e19"
server_key_iv: "b88517039b05afd7bc10a71a246c0c96"
server_key_version: "encryptionkey@0"
I20260808 04:44:46.132984 12326 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786164000593138-21443-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786164000593138-21443-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786164000593138-21443-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:44:46.138281 12326 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:44:46.141676 12326 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:44:46.141903 12326 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:44:46.149873 12326 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:35731
I20260808 04:44:46.149899 12396 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:35731 every 8 connection(s)
I20260808 04:44:46.151043 12326 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786164000593138-21443-0/minicluster-data/master-0/data/info.pb
I20260808 04:44:46.154114 12397 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:44:46.160259 12397 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 17d484402e2c43139aec0e0cc2277c59: Bootstrap starting.
I20260808 04:44:46.160672 21443 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu as pid 12326
I20260808 04:44:46.160797 21443 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786164000593138-21443-0/minicluster-data/master-0/wal/instance
I20260808 04:44:46.161036 21443 external_mini_cluster.cc:1428] Setting key 573383e27bd0ae2e3c5d8a8708057433
I20260808 04:44:46.163331 12397 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 17d484402e2c43139aec0e0cc2277c59: Neither blocks nor log segments found. Creating new log.
I20260808 04:44:46.164304 12397 log.cc:824] T 00000000000000000000000000000000 P 17d484402e2c43139aec0e0cc2277c59: Log is configured to *not* fsync() on all Append() calls
I20260808 04:44:46.166689 12397 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 17d484402e2c43139aec0e0cc2277c59: No bootstrap required, opened a new log
I20260808 04:44:46.167205 12401 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:46.162596 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.142:60803 (local address 127.0.0.1:35731)
0808 04:44:46.163069 (+ 473us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:46.163089 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:46.163134 (+ 45us) server_negotiation.cc:407] Connection header received
0808 04:44:46.164079 (+ 945us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:46.164126 (+ 47us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:46.164529 (+ 403us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:46.164974 (+ 445us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:44:46.165893 (+ 919us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:44:46.165898 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:44:46.165910 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 04:44:46.165921 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:44:46.165977 (+ 56us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 04:44:46.165996 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:44:46.166127 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0808 04:44:46.166231 (+ 104us) server_negotiation.cc:299] Negotiation successful
0808 04:44:46.166408 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":304,"thread_start_us":134,"threads_started":1}
I20260808 04:44:46.170225 21443 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 04:44:46.171051 12397 raft_consensus.cc:348] T 00000000000000000000000000000000 P 17d484402e2c43139aec0e0cc2277c59 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "17d484402e2c43139aec0e0cc2277c59" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35731 } }
I20260808 04:44:46.171317 12397 raft_consensus.cc:374] T 00000000000000000000000000000000 P 17d484402e2c43139aec0e0cc2277c59 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:44:46.171445 12397 raft_consensus.cc:729] T 00000000000000000000000000000000 P 17d484402e2c43139aec0e0cc2277c59 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17d484402e2c43139aec0e0cc2277c59, State: Initialized, Role: FOLLOWER
I20260808 04:44:46.171957 12397 consensus_queue.cc:260] T 00000000000000000000000000000000 P 17d484402e2c43139aec0e0cc2277c59 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "17d484402e2c43139aec0e0cc2277c59" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35731 } }
I20260808 04:44:46.172115 12397 raft_consensus.cc:388] T 00000000000000000000000000000000 P 17d484402e2c43139aec0e0cc2277c59 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 04:44:46.172206 12397 raft_consensus.cc:482] T 00000000000000000000000000000000 P 17d484402e2c43139aec0e0cc2277c59 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 04:44:46.172307 12397 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 17d484402e2c43139aec0e0cc2277c59 [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:44:46.173746 12397 raft_consensus.cc:504] T 00000000000000000000000000000000 P 17d484402e2c43139aec0e0cc2277c59 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "17d484402e2c43139aec0e0cc2277c59" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35731 } }
I20260808 04:44:46.174166 12397 leader_election.cc:302] T 00000000000000000000000000000000 P 17d484402e2c43139aec0e0cc2277c59 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 17d484402e2c43139aec0e0cc2277c59; no voters:
I20260808 04:44:46.174306 12401 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:46.172458 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.142:38071 (local address 127.0.0.1:35731)
0808 04:44:46.172595 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:46.172600 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:46.172819 (+ 219us) server_negotiation.cc:407] Connection header received
0808 04:44:46.172902 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:46.172904 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:46.172938 (+ 34us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:46.173006 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:44:46.173813 (+ 807us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:44:46.173815 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:44:46.173818 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 04:44:46.173829 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:44:46.173856 (+ 27us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 04:44:46.173866 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:44:46.173988 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0808 04:44:46.174066 (+ 78us) server_negotiation.cc:299] Negotiation successful
0808 04:44:46.174110 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260808 04:44:46.174582 12397 leader_election.cc:288] T 00000000000000000000000000000000 P 17d484402e2c43139aec0e0cc2277c59 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 04:44:46.174693 12408 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 17d484402e2c43139aec0e0cc2277c59 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 04:44:46.174947 12408 raft_consensus.cc:686] T 00000000000000000000000000000000 P 17d484402e2c43139aec0e0cc2277c59 [term 1 LEADER]: Becoming Leader. State: Replica: 17d484402e2c43139aec0e0cc2277c59, State: Running, Role: LEADER
I20260808 04:44:46.175258 12408 consensus_queue.cc:237] T 00000000000000000000000000000000 P 17d484402e2c43139aec0e0cc2277c59 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "17d484402e2c43139aec0e0cc2277c59" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35731 } }
I20260808 04:44:46.175942 12397 sys_catalog.cc:564] T 00000000000000000000000000000000 P 17d484402e2c43139aec0e0cc2277c59 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 04:44:46.177631 12410 sys_catalog.cc:455] T 00000000000000000000000000000000 P 17d484402e2c43139aec0e0cc2277c59 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 17d484402e2c43139aec0e0cc2277c59. Latest consensus state: current_term: 1 leader_uuid: "17d484402e2c43139aec0e0cc2277c59" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "17d484402e2c43139aec0e0cc2277c59" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35731 } } }
I20260808 04:44:46.177774 12410 sys_catalog.cc:458] T 00000000000000000000000000000000 P 17d484402e2c43139aec0e0cc2277c59 [sys.catalog]: This master's current role is: LEADER
I20260808 04:44:46.178126 12409 sys_catalog.cc:455] T 00000000000000000000000000000000 P 17d484402e2c43139aec0e0cc2277c59 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "17d484402e2c43139aec0e0cc2277c59" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "17d484402e2c43139aec0e0cc2277c59" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35731 } } }
I20260808 04:44:46.178233 12409 sys_catalog.cc:458] T 00000000000000000000000000000000 P 17d484402e2c43139aec0e0cc2277c59 [sys.catalog]: This master's current role is: LEADER
I20260808 04:44:46.178598 12424 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 04:44:46.181522 12424 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 04:44:46.187323 12424 catalog_manager.cc:1347] Generated new cluster ID: a5e7d3faafd14ac59bf8f25caf21f528
I20260808 04:44:46.187448 12424 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 04:44:46.207737 12424 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 04:44:46.208135 12424 catalog_manager.cc:1504] Loading token signing keys...
I20260808 04:44:46.218545 12424 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 17d484402e2c43139aec0e0cc2277c59: Generated new TSK 0
I20260808 04:44:46.219374 12424 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 04:44:46.228893 21443 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu with pid 12326
2026-08-08T04:44:46Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/11 (1504 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/12
Loading random data
Initializing database '/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786164000593138-21443-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 04:44:46 dist-test-slave-vxj2 krb5kdc[12431](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 04:44:46 dist-test-slave-vxj2 krb5kdc[12431](info): set up 2 sockets
Aug 08 04:44:46 dist-test-slave-vxj2 krb5kdc[12431](info): commencing operation
krb5kdc: starting...
W20260808 04:44:47.324692 21443 mini_kdc.cc:121] Time spent starting KDC: real 1.073s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786164000593138-21443-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786164000593138-21443-0/krb5kdc/test-user.keytab.
Aug 08 04:44:47 dist-test-slave-vxj2 krb5kdc[12431](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164287, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T04:44:47Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T04:44:47Z Disabled control of system clock
WARNING: no policy specified for kudu/127.20.240.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.240.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.240.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.254.keytab.
Entry for principal kudu/127.20.240.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.254.keytab.
I20260808 04:44:47.464342 21443 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
/tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786164000593138-21443-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786164000593138-21443-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786164000593138-21443-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786164000593138-21443-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.240.254:39903
--webserver_interface=127.20.240.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.254.keytab
--principal=kudu/127.20.240.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.240.212:41663
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.240.254:39903
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786164000593138-21443-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786164000593138-21443-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786164000593138-21443-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 04:44:47.583300 12446 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:44:47.583699 12446 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:44:47.583798 12446 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:44:47.588210 12446 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 04:44:47.588341 12446 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:44:47.588378 12446 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:44:47.588423 12446 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 04:44:47.588460 12446 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 04:44:47.594246 12446 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.240.212:41663
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786164000593138-21443-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786164000593138-21443-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.240.254:39903
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.254.keytab
--principal=kudu/127.20.240.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.240.254:39903
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786164000593138-21443-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.240.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12446
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786164000593138-21443-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 04:05:18 UTC on ccycloud.quasar-drfdgt.root.comops.site
build id 4574101
I20260808 04:44:47.595461 12446 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:44:47.596587 12446 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:44:47.605633 12455 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:44:47.605867 12446 server_base.cc:1034] running on GCE node
W20260808 04:44:47.605633 12452 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:44:47.605646 12451 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:44:47.606769 12446 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:44:47.607962 12446 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:44:47.609192 12446 hybrid_clock.cc:648] HybridClock initialized: now 1786164287609136 us; error 47 us; skew 500 ppm
Aug 08 04:44:47 dist-test-slave-vxj2 krb5kdc[12431](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164287, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.240.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:44:47.613025 12446 init.cc:377] Logged in from keytab as kudu/127.20.240.254@KRBTEST.COM (short username kudu)
I20260808 04:44:47.614217 12446 webserver.cc:460] Webserver started at http://127.20.240.254:39497/ using document root <none> and password file <none>
I20260808 04:44:47.614907 12446 fs_manager.cc:359] Metadata directory not provided
I20260808 04:44:47.614985 12446 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:44:47.615180 12446 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 04:44:47.617653 12446 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786164000593138-21443-0/minicluster-data/master-0/data/instance:
uuid: "c2bb92edf25c40fc806d8f2851533b8c"
format_stamp: "Formatted at 2026-08-08 04:44:47 on dist-test-slave-vxj2"
server_key: "106b9cbb57c357914dfb414eec657f39"
server_key_iv: "dd065ed9eb97b614e35894a3a1b3c753"
server_key_version: "encryptionkey@0"
I20260808 04:44:47.618232 12446 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786164000593138-21443-0/minicluster-data/master-0/wal/instance:
uuid: "c2bb92edf25c40fc806d8f2851533b8c"
format_stamp: "Formatted at 2026-08-08 04:44:47 on dist-test-slave-vxj2"
server_key: "106b9cbb57c357914dfb414eec657f39"
server_key_iv: "dd065ed9eb97b614e35894a3a1b3c753"
server_key_version: "encryptionkey@0"
I20260808 04:44:47.622299 12446 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260808 04:44:47.624927 12462 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:44:47.626420 12446 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 04:44:47.626606 12446 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786164000593138-21443-0/minicluster-data/master-0/data,/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786164000593138-21443-0/minicluster-data/master-0/wal
uuid: "c2bb92edf25c40fc806d8f2851533b8c"
format_stamp: "Formatted at 2026-08-08 04:44:47 on dist-test-slave-vxj2"
server_key: "106b9cbb57c357914dfb414eec657f39"
server_key_iv: "dd065ed9eb97b614e35894a3a1b3c753"
server_key_version: "encryptionkey@0"
I20260808 04:44:47.626739 12446 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786164000593138-21443-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786164000593138-21443-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786164000593138-21443-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:44:47.638866 12446 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:44:47.642319 12446 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:44:47.642537 12446 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:44:47.650065 12446 rpc_server.cc:307] RPC server started. Bound to: 127.20.240.254:39903
I20260808 04:44:47.650090 12519 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.240.254:39903 every 8 connection(s)
I20260808 04:44:47.651088 12446 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786164000593138-21443-0/minicluster-data/master-0/data/info.pb
I20260808 04:44:47.651979 21443 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu as pid 12446
I20260808 04:44:47.652137 21443 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786164000593138-21443-0/minicluster-data/master-0/wal/instance
I20260808 04:44:47.652436 21443 external_mini_cluster.cc:1428] Setting key 3a41b6917de97dbb67d16b64c64f5513
I20260808 04:44:47.654507 12520 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:44:47.662381 12520 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c2bb92edf25c40fc806d8f2851533b8c: Bootstrap starting.
Aug 08 04:44:47 dist-test-slave-vxj2 krb5kdc[12431](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164287, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.240.254@KRBTEST.COM
I20260808 04:44:47.665364 12520 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c2bb92edf25c40fc806d8f2851533b8c: Neither blocks nor log segments found. Creating new log.
I20260808 04:44:47.666406 12520 log.cc:824] T 00000000000000000000000000000000 P c2bb92edf25c40fc806d8f2851533b8c: Log is configured to *not* fsync() on all Append() calls
I20260808 04:44:47.669227 12520 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c2bb92edf25c40fc806d8f2851533b8c: No bootstrap required, opened a new log
I20260808 04:44:47.670644 12523 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:47.653922 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44567 (local address 127.20.240.254:39903)
0808 04:44:47.654413 (+ 491us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:47.654433 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:47.654479 (+ 46us) server_negotiation.cc:407] Connection header received
0808 04:44:47.655431 (+ 952us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:47.655459 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:47.655964 (+ 505us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:47.656381 (+ 417us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:44:47.657404 (+ 1023us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:47.658991 (+ 1587us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:47.660126 (+ 1135us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:47.660860 (+ 734us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:47.661035 (+ 175us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:47.664448 (+ 3413us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:44:47.664455 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:44:47.664472 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:44:47.664511 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:44:47.666754 (+ 2243us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:44:47.667560 (+ 806us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:44:47.667570 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:44:47.667580 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:44:47.667906 (+ 326us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:44:47.668285 (+ 379us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:44:47.668291 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:44:47.668293 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:44:47.668832 (+ 539us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:44:47.669049 (+ 217us) server_negotiation.cc:1035] Waiting for connection context
0808 04:44:47.669418 (+ 369us) server_negotiation.cc:299] Negotiation successful
0808 04:44:47.669669 (+ 251us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":311,"thread_start_us":144,"threads_started":1}
I20260808 04:44:47.673323 12520 raft_consensus.cc:348] T 00000000000000000000000000000000 P c2bb92edf25c40fc806d8f2851533b8c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c2bb92edf25c40fc806d8f2851533b8c" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 39903 } }
I20260808 04:44:47.673606 12520 raft_consensus.cc:374] T 00000000000000000000000000000000 P c2bb92edf25c40fc806d8f2851533b8c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:44:47.673689 12520 raft_consensus.cc:729] T 00000000000000000000000000000000 P c2bb92edf25c40fc806d8f2851533b8c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c2bb92edf25c40fc806d8f2851533b8c, State: Initialized, Role: FOLLOWER
I20260808 04:44:47.674160 12520 consensus_queue.cc:260] T 00000000000000000000000000000000 P c2bb92edf25c40fc806d8f2851533b8c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c2bb92edf25c40fc806d8f2851533b8c" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 39903 } }
I20260808 04:44:47.674326 12520 raft_consensus.cc:388] T 00000000000000000000000000000000 P c2bb92edf25c40fc806d8f2851533b8c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 04:44:47.674400 12520 raft_consensus.cc:482] T 00000000000000000000000000000000 P c2bb92edf25c40fc806d8f2851533b8c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 04:44:47.674422 21443 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 04:44:47.674506 12520 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c2bb92edf25c40fc806d8f2851533b8c [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:44:47.675563 12520 raft_consensus.cc:504] T 00000000000000000000000000000000 P c2bb92edf25c40fc806d8f2851533b8c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c2bb92edf25c40fc806d8f2851533b8c" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 39903 } }
I20260808 04:44:47.675933 12520 leader_election.cc:302] T 00000000000000000000000000000000 P c2bb92edf25c40fc806d8f2851533b8c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c2bb92edf25c40fc806d8f2851533b8c; no voters:
I20260808 04:44:47.676291 12520 leader_election.cc:288] T 00000000000000000000000000000000 P c2bb92edf25c40fc806d8f2851533b8c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 04:44:47.676360 12531 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c2bb92edf25c40fc806d8f2851533b8c [term 1 FOLLOWER]: Leader election won for term 1
I20260808 04:44:47.676627 12531 raft_consensus.cc:686] T 00000000000000000000000000000000 P c2bb92edf25c40fc806d8f2851533b8c [term 1 LEADER]: Becoming Leader. State: Replica: c2bb92edf25c40fc806d8f2851533b8c, State: Running, Role: LEADER
I20260808 04:44:47.676949 12531 consensus_queue.cc:237] T 00000000000000000000000000000000 P c2bb92edf25c40fc806d8f2851533b8c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c2bb92edf25c40fc806d8f2851533b8c" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 39903 } }
I20260808 04:44:47.677772 12520 sys_catalog.cc:564] T 00000000000000000000000000000000 P c2bb92edf25c40fc806d8f2851533b8c [sys.catalog]: configured and running, proceeding with master startup.
I20260808 04:44:47.678661 12534 sys_catalog.cc:455] T 00000000000000000000000000000000 P c2bb92edf25c40fc806d8f2851533b8c [sys.catalog]: SysCatalogTable state changed. Reason: New leader c2bb92edf25c40fc806d8f2851533b8c. Latest consensus state: current_term: 1 leader_uuid: "c2bb92edf25c40fc806d8f2851533b8c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c2bb92edf25c40fc806d8f2851533b8c" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 39903 } } }
I20260808 04:44:47.678828 12534 sys_catalog.cc:458] T 00000000000000000000000000000000 P c2bb92edf25c40fc806d8f2851533b8c [sys.catalog]: This master's current role is: LEADER
I20260808 04:44:47.679206 12533 sys_catalog.cc:455] T 00000000000000000000000000000000 P c2bb92edf25c40fc806d8f2851533b8c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c2bb92edf25c40fc806d8f2851533b8c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c2bb92edf25c40fc806d8f2851533b8c" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 39903 } } }
I20260808 04:44:47.679363 12533 sys_catalog.cc:458] T 00000000000000000000000000000000 P c2bb92edf25c40fc806d8f2851533b8c [sys.catalog]: This master's current role is: LEADER
W20260808 04:44:47.683470 12550 catalog_manager.cc:1558] T 00000000000000000000000000000000 P c2bb92edf25c40fc806d8f2851533b8c: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 04:44:47.683573 12550 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 04:44:47.683676 12542 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 04:44:47.684708 12542 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 04:44:47.687146 12523 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:47.676505 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47231 (local address 127.20.240.254:39903)
0808 04:44:47.676633 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:47.676637 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:47.677373 (+ 736us) server_negotiation.cc:407] Connection header received
0808 04:44:47.677529 (+ 156us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:47.677532 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:47.677582 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:47.677686 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:44:47.678683 (+ 997us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:47.679476 (+ 793us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:47.680707 (+ 1231us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:47.680956 (+ 249us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:47.681071 (+ 115us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:47.682936 (+ 1865us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:44:47.682940 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:44:47.682943 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:44:47.682970 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:44:47.684686 (+ 1716us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:44:47.685431 (+ 745us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:44:47.685434 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:44:47.685436 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:44:47.685525 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:44:47.685917 (+ 392us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:44:47.685920 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:44:47.685922 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:44:47.686177 (+ 255us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:44:47.686321 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0808 04:44:47.686817 (+ 496us) server_negotiation.cc:299] Negotiation successful
0808 04:44:47.686952 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260808 04:44:47.690826 12542 catalog_manager.cc:1347] Generated new cluster ID: 283ab081b0434b7b834b49065299e841
I20260808 04:44:47.690982 12542 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 04:44:47.698752 12542 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 04:44:47.699779 12542 catalog_manager.cc:1504] Loading token signing keys...
I20260808 04:44:47.705202 12542 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c2bb92edf25c40fc806d8f2851533b8c: Generated new TSK 0
I20260808 04:44:47.705968 12542 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 04:44:47.715060 21443 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu with pid 12446
W20260808 04:44:47.723913 12429 connection.cc:535] client connection to 127.20.240.254:39903 recv error: Network error: failed to read from TLS socket (remote: 127.20.240.254:39903): Connection reset by peer (error 104)
2026-08-08T04:44:47Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/12 (1487 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/13
Loading random data
Initializing database '/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786164000593138-21443-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 04:44:47 dist-test-slave-vxj2 krb5kdc[12555](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 04:44:47 dist-test-slave-vxj2 krb5kdc[12555](info): set up 2 sockets
Aug 08 04:44:47 dist-test-slave-vxj2 krb5kdc[12555](info): commencing operation
krb5kdc: starting...
W20260808 04:44:48.822490 21443 mini_kdc.cc:121] Time spent starting KDC: real 1.084s user 0.002s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786164000593138-21443-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786164000593138-21443-0/krb5kdc/test-user.keytab.
Aug 08 04:44:48 dist-test-slave-vxj2 krb5kdc[12555](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164288, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T04:44:48Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T04:44:48Z Disabled control of system clock
WARNING: no policy specified for kudu/127.20.240.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.240.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.240.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.254.keytab.
Entry for principal kudu/127.20.240.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.254.keytab.
I20260808 04:44:48.956486 21443 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
/tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786164000593138-21443-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786164000593138-21443-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786164000593138-21443-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786164000593138-21443-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.240.254:44225
--webserver_interface=127.20.240.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.254.keytab
--principal=kudu/127.20.240.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.240.212:34621
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.240.254:44225
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786164000593138-21443-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786164000593138-21443-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786164000593138-21443-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 04:44:49.071453 12569 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:44:49.071818 12569 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:44:49.071908 12569 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:44:49.076293 12569 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 04:44:49.076402 12569 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:44:49.076442 12569 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:44:49.076504 12569 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 04:44:49.076541 12569 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 04:44:49.082258 12569 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.240.212:34621
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786164000593138-21443-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786164000593138-21443-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.240.254:44225
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.254.keytab
--principal=kudu/127.20.240.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.240.254:44225
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786164000593138-21443-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.240.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12569
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786164000593138-21443-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 04:05:18 UTC on ccycloud.quasar-drfdgt.root.comops.site
build id 4574101
I20260808 04:44:49.083468 12569 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:44:49.084546 12569 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:44:49.093580 12574 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:44:49.093588 12575 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:44:49.093724 12569 server_base.cc:1034] running on GCE node
W20260808 04:44:49.093622 12577 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:44:49.094511 12569 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:44:49.095678 12569 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:44:49.096906 12569 hybrid_clock.cc:648] HybridClock initialized: now 1786164289096875 us; error 43 us; skew 500 ppm
Aug 08 04:44:49 dist-test-slave-vxj2 krb5kdc[12555](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164289, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.240.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:44:49.100253 12569 init.cc:377] Logged in from keytab as kudu/127.20.240.254@KRBTEST.COM (short username kudu)
I20260808 04:44:49.101336 12569 webserver.cc:460] Webserver started at http://127.20.240.254:43893/ using document root <none> and password file <none>
I20260808 04:44:49.101943 12569 fs_manager.cc:359] Metadata directory not provided
I20260808 04:44:49.102041 12569 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:44:49.102286 12569 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 04:44:49.104470 12569 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786164000593138-21443-0/minicluster-data/master-0/data/instance:
uuid: "779fc099e6354dcbafd67b6b3937aa7e"
format_stamp: "Formatted at 2026-08-08 04:44:49 on dist-test-slave-vxj2"
server_key: "6c7676b6aeb0923b35a2deb7e54dcb3b"
server_key_iv: "c72b5b96692b3c8cafe553db185d90e5"
server_key_version: "encryptionkey@0"
I20260808 04:44:49.105058 12569 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786164000593138-21443-0/minicluster-data/master-0/wal/instance:
uuid: "779fc099e6354dcbafd67b6b3937aa7e"
format_stamp: "Formatted at 2026-08-08 04:44:49 on dist-test-slave-vxj2"
server_key: "6c7676b6aeb0923b35a2deb7e54dcb3b"
server_key_iv: "c72b5b96692b3c8cafe553db185d90e5"
server_key_version: "encryptionkey@0"
I20260808 04:44:49.109078 12569 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20260808 04:44:49.111953 12584 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:44:49.113499 12569 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260808 04:44:49.113667 12569 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786164000593138-21443-0/minicluster-data/master-0/data,/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786164000593138-21443-0/minicluster-data/master-0/wal
uuid: "779fc099e6354dcbafd67b6b3937aa7e"
format_stamp: "Formatted at 2026-08-08 04:44:49 on dist-test-slave-vxj2"
server_key: "6c7676b6aeb0923b35a2deb7e54dcb3b"
server_key_iv: "c72b5b96692b3c8cafe553db185d90e5"
server_key_version: "encryptionkey@0"
I20260808 04:44:49.113798 12569 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786164000593138-21443-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786164000593138-21443-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786164000593138-21443-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:44:49.154605 12569 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:44:49.157876 12569 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:44:49.158109 12569 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:44:49.165661 12569 rpc_server.cc:307] RPC server started. Bound to: 127.20.240.254:44225
I20260808 04:44:49.165690 12643 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.240.254:44225 every 8 connection(s)
I20260808 04:44:49.166755 12569 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786164000593138-21443-0/minicluster-data/master-0/data/info.pb
I20260808 04:44:49.169868 12644 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:44:49.174602 21443 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu as pid 12569
I20260808 04:44:49.174787 21443 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786164000593138-21443-0/minicluster-data/master-0/wal/instance
I20260808 04:44:49.175112 21443 external_mini_cluster.cc:1428] Setting key 465c5c9c849ab8111f88f49dcf67e111
I20260808 04:44:49.176978 12644 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 779fc099e6354dcbafd67b6b3937aa7e: Bootstrap starting.
I20260808 04:44:49.179520 12644 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 779fc099e6354dcbafd67b6b3937aa7e: Neither blocks nor log segments found. Creating new log.
I20260808 04:44:49.180369 12644 log.cc:824] T 00000000000000000000000000000000 P 779fc099e6354dcbafd67b6b3937aa7e: Log is configured to *not* fsync() on all Append() calls
I20260808 04:44:49.182690 12644 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 779fc099e6354dcbafd67b6b3937aa7e: No bootstrap required, opened a new log
I20260808 04:44:49.185928 12647 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:49.176760 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36599 (local address 127.20.240.254:44225)
0808 04:44:49.177355 (+ 595us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:49.177371 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:49.177413 (+ 42us) server_negotiation.cc:407] Connection header received
0808 04:44:49.178101 (+ 688us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:49.178120 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:49.178474 (+ 354us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:49.178829 (+ 355us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:44:49.179278 (+ 449us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:49.180361 (+ 1083us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:49.181570 (+ 1209us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:49.182069 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:49.182253 (+ 184us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:49.183305 (+ 1052us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:44:49.183312 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:44:49.183330 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 04:44:49.183877 (+ 547us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:44:49.183953 (+ 76us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 04:44:49.183986 (+ 33us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:44:49.184138 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0808 04:44:49.184307 (+ 169us) server_negotiation.cc:299] Negotiation successful
0808 04:44:49.184461 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":438,"thread_start_us":183,"threads_started":1}
I20260808 04:44:49.187165 12644 raft_consensus.cc:348] T 00000000000000000000000000000000 P 779fc099e6354dcbafd67b6b3937aa7e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "779fc099e6354dcbafd67b6b3937aa7e" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 44225 } }
I20260808 04:44:49.187471 12644 raft_consensus.cc:374] T 00000000000000000000000000000000 P 779fc099e6354dcbafd67b6b3937aa7e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:44:49.187551 12644 raft_consensus.cc:729] T 00000000000000000000000000000000 P 779fc099e6354dcbafd67b6b3937aa7e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 779fc099e6354dcbafd67b6b3937aa7e, State: Initialized, Role: FOLLOWER
I20260808 04:44:49.188050 12644 consensus_queue.cc:260] T 00000000000000000000000000000000 P 779fc099e6354dcbafd67b6b3937aa7e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "779fc099e6354dcbafd67b6b3937aa7e" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 44225 } }
I20260808 04:44:49.188220 12644 raft_consensus.cc:388] T 00000000000000000000000000000000 P 779fc099e6354dcbafd67b6b3937aa7e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 04:44:49.188305 12644 raft_consensus.cc:482] T 00000000000000000000000000000000 P 779fc099e6354dcbafd67b6b3937aa7e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 04:44:49.188438 12644 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 779fc099e6354dcbafd67b6b3937aa7e [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:44:49.189376 21443 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 04:44:49.189819 12644 raft_consensus.cc:504] T 00000000000000000000000000000000 P 779fc099e6354dcbafd67b6b3937aa7e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "779fc099e6354dcbafd67b6b3937aa7e" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 44225 } }
I20260808 04:44:49.190200 12644 leader_election.cc:302] T 00000000000000000000000000000000 P 779fc099e6354dcbafd67b6b3937aa7e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 779fc099e6354dcbafd67b6b3937aa7e; no voters:
I20260808 04:44:49.190606 12644 leader_election.cc:288] T 00000000000000000000000000000000 P 779fc099e6354dcbafd67b6b3937aa7e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 04:44:49.190713 12649 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 779fc099e6354dcbafd67b6b3937aa7e [term 1 FOLLOWER]: Leader election won for term 1
I20260808 04:44:49.190969 12649 raft_consensus.cc:686] T 00000000000000000000000000000000 P 779fc099e6354dcbafd67b6b3937aa7e [term 1 LEADER]: Becoming Leader. State: Replica: 779fc099e6354dcbafd67b6b3937aa7e, State: Running, Role: LEADER
I20260808 04:44:49.191355 12649 consensus_queue.cc:237] T 00000000000000000000000000000000 P 779fc099e6354dcbafd67b6b3937aa7e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "779fc099e6354dcbafd67b6b3937aa7e" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 44225 } }
I20260808 04:44:49.192188 12644 sys_catalog.cc:564] T 00000000000000000000000000000000 P 779fc099e6354dcbafd67b6b3937aa7e [sys.catalog]: configured and running, proceeding with master startup.
I20260808 04:44:49.193331 12655 sys_catalog.cc:455] T 00000000000000000000000000000000 P 779fc099e6354dcbafd67b6b3937aa7e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 779fc099e6354dcbafd67b6b3937aa7e. Latest consensus state: current_term: 1 leader_uuid: "779fc099e6354dcbafd67b6b3937aa7e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "779fc099e6354dcbafd67b6b3937aa7e" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 44225 } } }
I20260808 04:44:49.193343 12656 sys_catalog.cc:455] T 00000000000000000000000000000000 P 779fc099e6354dcbafd67b6b3937aa7e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "779fc099e6354dcbafd67b6b3937aa7e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "779fc099e6354dcbafd67b6b3937aa7e" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 44225 } } }
I20260808 04:44:49.193478 12655 sys_catalog.cc:458] T 00000000000000000000000000000000 P 779fc099e6354dcbafd67b6b3937aa7e [sys.catalog]: This master's current role is: LEADER
I20260808 04:44:49.193480 12656 sys_catalog.cc:458] T 00000000000000000000000000000000 P 779fc099e6354dcbafd67b6b3937aa7e [sys.catalog]: This master's current role is: LEADER
I20260808 04:44:49.193842 12659 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 04:44:49.197316 12659 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 04:44:49.197508 12647 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:49.191703 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46039 (local address 127.20.240.254:44225)
0808 04:44:49.191823 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:49.191828 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:49.192135 (+ 307us) server_negotiation.cc:407] Connection header received
0808 04:44:49.192264 (+ 129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:49.192267 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:49.192317 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:49.192387 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:44:49.192754 (+ 367us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:49.193732 (+ 978us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:49.195193 (+ 1461us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:49.195614 (+ 421us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:49.195695 (+ 81us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:49.196862 (+ 1167us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:44:49.196869 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:44:49.196873 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 04:44:49.196891 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:44:49.196922 (+ 31us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 04:44:49.196936 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:44:49.197002 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0808 04:44:49.197320 (+ 318us) server_negotiation.cc:299] Negotiation successful
0808 04:44:49.197363 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":3,"server-negotiator.queue_time_us":45}
I20260808 04:44:49.203907 12659 catalog_manager.cc:1347] Generated new cluster ID: 5e50bd62b35d4d7c9a96bf05eef96409
I20260808 04:44:49.204006 12659 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 04:44:49.212136 12659 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 04:44:49.213691 12659 catalog_manager.cc:1504] Loading token signing keys...
I20260808 04:44:49.231017 12659 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 779fc099e6354dcbafd67b6b3937aa7e: Generated new TSK 0
I20260808 04:44:49.231829 12659 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 04:44:49.244474 21443 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu with pid 12569
W20260808 04:44:49.251375 12553 connection.cc:535] client connection to 127.20.240.254:44225 recv error: Network error: failed to read from TLS socket (remote: 127.20.240.254:44225): Connection reset by peer (error 104)
2026-08-08T04:44:49Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/13 (1527 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/14
Loading random data
Initializing database '/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786164000593138-21443-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 04:44:49 dist-test-slave-vxj2 krb5kdc[12676](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 04:44:49 dist-test-slave-vxj2 krb5kdc[12676](info): set up 2 sockets
Aug 08 04:44:49 dist-test-slave-vxj2 krb5kdc[12676](info): commencing operation
krb5kdc: starting...
W20260808 04:44:50.379359 21443 mini_kdc.cc:121] Time spent starting KDC: real 1.113s user 0.002s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786164000593138-21443-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786164000593138-21443-0/krb5kdc/test-user.keytab.
Aug 08 04:44:50 dist-test-slave-vxj2 krb5kdc[12676](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164290, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T04:44:50Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T04:44:50Z Disabled control of system clock
WARNING: no policy specified for kudu/127.20.240.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.240.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.240.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.254.keytab.
Entry for principal kudu/127.20.240.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.254.keytab.
I20260808 04:44:50.513302 21443 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
/tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786164000593138-21443-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786164000593138-21443-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786164000593138-21443-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786164000593138-21443-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.240.254:45337
--webserver_interface=127.20.240.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.254.keytab
--principal=kudu/127.20.240.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.240.212:44873
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.240.254:45337
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786164000593138-21443-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786164000593138-21443-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786164000593138-21443-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 04:44:50.627599 12691 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:44:50.627954 12691 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:44:50.628046 12691 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:44:50.632220 12691 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 04:44:50.632345 12691 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:44:50.632387 12691 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:44:50.632436 12691 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 04:44:50.632480 12691 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 04:44:50.638087 12691 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.240.212:44873
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786164000593138-21443-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786164000593138-21443-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.240.254:45337
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.254.keytab
--principal=kudu/127.20.240.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.240.254:45337
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786164000593138-21443-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.240.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12691
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786164000593138-21443-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 04:05:18 UTC on ccycloud.quasar-drfdgt.root.comops.site
build id 4574101
I20260808 04:44:50.639290 12691 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:44:50.640396 12691 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:44:50.649258 12697 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:44:50.649259 12700 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:44:50.649284 12698 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:44:50.649631 12691 server_base.cc:1034] running on GCE node
I20260808 04:44:50.650300 12691 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:44:50.651444 12691 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:44:50.652657 12691 hybrid_clock.cc:648] HybridClock initialized: now 1786164290652636 us; error 35 us; skew 500 ppm
Aug 08 04:44:50 dist-test-slave-vxj2 krb5kdc[12676](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164290, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.240.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:44:50.655578 12691 init.cc:377] Logged in from keytab as kudu/127.20.240.254@KRBTEST.COM (short username kudu)
I20260808 04:44:50.656580 12691 webserver.cc:460] Webserver started at http://127.20.240.254:38425/ using document root <none> and password file <none>
I20260808 04:44:50.657212 12691 fs_manager.cc:359] Metadata directory not provided
I20260808 04:44:50.657302 12691 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:44:50.657534 12691 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 04:44:50.659682 12691 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786164000593138-21443-0/minicluster-data/master-0/data/instance:
uuid: "af53a1ef6a8b4d359a3ccc405c875f29"
format_stamp: "Formatted at 2026-08-08 04:44:50 on dist-test-slave-vxj2"
server_key: "88ec1d38565fc6b771180c7e4ea9b06f"
server_key_iv: "d057b0377f0abbebb2253a9b4cd53b00"
server_key_version: "encryptionkey@0"
I20260808 04:44:50.660315 12691 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786164000593138-21443-0/minicluster-data/master-0/wal/instance:
uuid: "af53a1ef6a8b4d359a3ccc405c875f29"
format_stamp: "Formatted at 2026-08-08 04:44:50 on dist-test-slave-vxj2"
server_key: "88ec1d38565fc6b771180c7e4ea9b06f"
server_key_iv: "d057b0377f0abbebb2253a9b4cd53b00"
server_key_version: "encryptionkey@0"
I20260808 04:44:50.664206 12691 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.004s
I20260808 04:44:50.666842 12707 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:44:50.668118 12691 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260808 04:44:50.668265 12691 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786164000593138-21443-0/minicluster-data/master-0/data,/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786164000593138-21443-0/minicluster-data/master-0/wal
uuid: "af53a1ef6a8b4d359a3ccc405c875f29"
format_stamp: "Formatted at 2026-08-08 04:44:50 on dist-test-slave-vxj2"
server_key: "88ec1d38565fc6b771180c7e4ea9b06f"
server_key_iv: "d057b0377f0abbebb2253a9b4cd53b00"
server_key_version: "encryptionkey@0"
I20260808 04:44:50.668387 12691 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786164000593138-21443-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786164000593138-21443-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786164000593138-21443-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:44:50.673362 12691 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:44:50.676838 12691 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:44:50.677063 12691 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:44:50.684855 12691 rpc_server.cc:307] RPC server started. Bound to: 127.20.240.254:45337
I20260808 04:44:50.684882 12762 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.240.254:45337 every 8 connection(s)
I20260808 04:44:50.685925 12691 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786164000593138-21443-0/minicluster-data/master-0/data/info.pb
I20260808 04:44:50.688977 12763 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:44:50.690501 21443 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu as pid 12691
I20260808 04:44:50.690644 21443 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786164000593138-21443-0/minicluster-data/master-0/wal/instance
I20260808 04:44:50.690913 21443 external_mini_cluster.cc:1428] Setting key a2c637127c75ec9d5b32265464839a45
I20260808 04:44:50.696350 12767 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:50.692430 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58661 (local address 127.20.240.254:45337)
0808 04:44:50.692908 (+ 478us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:50.692922 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:50.692964 (+ 42us) server_negotiation.cc:407] Connection header received
0808 04:44:50.693650 (+ 686us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:50.693666 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:50.693956 (+ 290us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:50.694303 (+ 347us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:44:50.695163 (+ 860us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:44:50.695167 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:44:50.695179 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 04:44:50.695190 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:44:50.695245 (+ 55us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 04:44:50.695264 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:44:50.695416 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0808 04:44:50.695497 (+ 81us) server_negotiation.cc:299] Negotiation successful
0808 04:44:50.695654 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":327,"thread_start_us":155,"threads_started":1}
I20260808 04:44:50.696381 12763 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P af53a1ef6a8b4d359a3ccc405c875f29: Bootstrap starting.
I20260808 04:44:50.699296 21443 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 04:44:50.699332 12763 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P af53a1ef6a8b4d359a3ccc405c875f29: Neither blocks nor log segments found. Creating new log.
I20260808 04:44:50.700181 12763 log.cc:824] T 00000000000000000000000000000000 P af53a1ef6a8b4d359a3ccc405c875f29: Log is configured to *not* fsync() on all Append() calls
I20260808 04:44:50.703068 12763 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P af53a1ef6a8b4d359a3ccc405c875f29: No bootstrap required, opened a new log
I20260808 04:44:50.703392 12767 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:50.701456 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55877 (local address 127.20.240.254:45337)
0808 04:44:50.701594 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:50.701600 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:50.701824 (+ 224us) server_negotiation.cc:407] Connection header received
0808 04:44:50.701984 (+ 160us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:50.701986 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:50.702016 (+ 30us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:50.702085 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:44:50.702888 (+ 803us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:44:50.702891 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:44:50.702894 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 04:44:50.702905 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:44:50.702930 (+ 25us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 04:44:50.702960 (+ 30us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:44:50.703033 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0808 04:44:50.703179 (+ 146us) server_negotiation.cc:299] Negotiation successful
0808 04:44:50.703225 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260808 04:44:50.707769 12763 raft_consensus.cc:348] T 00000000000000000000000000000000 P af53a1ef6a8b4d359a3ccc405c875f29 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "af53a1ef6a8b4d359a3ccc405c875f29" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 45337 } }
I20260808 04:44:50.708158 12763 raft_consensus.cc:374] T 00000000000000000000000000000000 P af53a1ef6a8b4d359a3ccc405c875f29 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:44:50.708314 12763 raft_consensus.cc:729] T 00000000000000000000000000000000 P af53a1ef6a8b4d359a3ccc405c875f29 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af53a1ef6a8b4d359a3ccc405c875f29, State: Initialized, Role: FOLLOWER
I20260808 04:44:50.708895 12763 consensus_queue.cc:260] T 00000000000000000000000000000000 P af53a1ef6a8b4d359a3ccc405c875f29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "af53a1ef6a8b4d359a3ccc405c875f29" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 45337 } }
I20260808 04:44:50.709095 12763 raft_consensus.cc:388] T 00000000000000000000000000000000 P af53a1ef6a8b4d359a3ccc405c875f29 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 04:44:50.709229 12763 raft_consensus.cc:482] T 00000000000000000000000000000000 P af53a1ef6a8b4d359a3ccc405c875f29 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 04:44:50.709384 12763 raft_consensus.cc:3037] T 00000000000000000000000000000000 P af53a1ef6a8b4d359a3ccc405c875f29 [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:44:50.710606 12763 raft_consensus.cc:504] T 00000000000000000000000000000000 P af53a1ef6a8b4d359a3ccc405c875f29 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "af53a1ef6a8b4d359a3ccc405c875f29" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 45337 } }
I20260808 04:44:50.711025 12763 leader_election.cc:302] T 00000000000000000000000000000000 P af53a1ef6a8b4d359a3ccc405c875f29 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: af53a1ef6a8b4d359a3ccc405c875f29; no voters:
I20260808 04:44:50.711422 12763 leader_election.cc:288] T 00000000000000000000000000000000 P af53a1ef6a8b4d359a3ccc405c875f29 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 04:44:50.711578 12775 raft_consensus.cc:2781] T 00000000000000000000000000000000 P af53a1ef6a8b4d359a3ccc405c875f29 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 04:44:50.711834 12775 raft_consensus.cc:686] T 00000000000000000000000000000000 P af53a1ef6a8b4d359a3ccc405c875f29 [term 1 LEADER]: Becoming Leader. State: Replica: af53a1ef6a8b4d359a3ccc405c875f29, State: Running, Role: LEADER
I20260808 04:44:50.712217 12775 consensus_queue.cc:237] T 00000000000000000000000000000000 P af53a1ef6a8b4d359a3ccc405c875f29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "af53a1ef6a8b4d359a3ccc405c875f29" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 45337 } }
I20260808 04:44:50.712992 12763 sys_catalog.cc:564] T 00000000000000000000000000000000 P af53a1ef6a8b4d359a3ccc405c875f29 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 04:44:50.714094 12776 sys_catalog.cc:455] T 00000000000000000000000000000000 P af53a1ef6a8b4d359a3ccc405c875f29 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "af53a1ef6a8b4d359a3ccc405c875f29" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "af53a1ef6a8b4d359a3ccc405c875f29" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 45337 } } }
I20260808 04:44:50.714080 12777 sys_catalog.cc:455] T 00000000000000000000000000000000 P af53a1ef6a8b4d359a3ccc405c875f29 [sys.catalog]: SysCatalogTable state changed. Reason: New leader af53a1ef6a8b4d359a3ccc405c875f29. Latest consensus state: current_term: 1 leader_uuid: "af53a1ef6a8b4d359a3ccc405c875f29" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "af53a1ef6a8b4d359a3ccc405c875f29" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 45337 } } }
I20260808 04:44:50.714248 12776 sys_catalog.cc:458] T 00000000000000000000000000000000 P af53a1ef6a8b4d359a3ccc405c875f29 [sys.catalog]: This master's current role is: LEADER
I20260808 04:44:50.714248 12777 sys_catalog.cc:458] T 00000000000000000000000000000000 P af53a1ef6a8b4d359a3ccc405c875f29 [sys.catalog]: This master's current role is: LEADER
I20260808 04:44:50.714670 12785 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 04:44:50.718011 12785 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 04:44:50.723728 12785 catalog_manager.cc:1347] Generated new cluster ID: f56d97eb1330490dbc9a552ca7fd142c
I20260808 04:44:50.723812 12785 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 04:44:50.738706 12785 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 04:44:50.739095 12785 catalog_manager.cc:1504] Loading token signing keys...
I20260808 04:44:50.743937 12785 catalog_manager.cc:5868] T 00000000000000000000000000000000 P af53a1ef6a8b4d359a3ccc405c875f29: Generated new TSK 0
I20260808 04:44:50.744643 12785 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 04:44:50.752775 21443 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu with pid 12691
2026-08-08T04:44:50Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/14 (1508 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/15
Loading random data
Initializing database '/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786164000593138-21443-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 04:44:50 dist-test-slave-vxj2 krb5kdc[12798](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 04:44:50 dist-test-slave-vxj2 krb5kdc[12798](info): set up 2 sockets
Aug 08 04:44:50 dist-test-slave-vxj2 krb5kdc[12798](info): commencing operation
krb5kdc: starting...
W20260808 04:44:51.869750 21443 mini_kdc.cc:121] Time spent starting KDC: real 1.095s user 0.003s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786164000593138-21443-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786164000593138-21443-0/krb5kdc/test-user.keytab.
Aug 08 04:44:51 dist-test-slave-vxj2 krb5kdc[12798](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164291, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T04:44:51Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T04:44:51Z Disabled control of system clock
WARNING: no policy specified for kudu/127.20.240.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.240.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.240.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.254.keytab.
Entry for principal kudu/127.20.240.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.254.keytab.
I20260808 04:44:52.004593 21443 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
/tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786164000593138-21443-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786164000593138-21443-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786164000593138-21443-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786164000593138-21443-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.240.254:43525
--webserver_interface=127.20.240.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.254.keytab
--principal=kudu/127.20.240.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.240.212:41183
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.240.254:43525
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786164000593138-21443-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786164000593138-21443-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786164000593138-21443-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 04:44:52.121824 12812 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:44:52.122153 12812 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:44:52.122239 12812 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:44:52.126507 12812 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 04:44:52.126641 12812 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:44:52.126693 12812 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:44:52.126752 12812 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 04:44:52.126787 12812 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 04:44:52.132436 12812 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.240.212:41183
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786164000593138-21443-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786164000593138-21443-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.240.254:43525
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.254.keytab
--principal=kudu/127.20.240.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.240.254:43525
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786164000593138-21443-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.240.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12812
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786164000593138-21443-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 04:05:18 UTC on ccycloud.quasar-drfdgt.root.comops.site
build id 4574101
I20260808 04:44:52.133736 12812 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:44:52.134821 12812 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:44:52.144001 12818 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:44:52.144119 12812 server_base.cc:1034] running on GCE node
W20260808 04:44:52.143996 12817 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:44:52.143996 12820 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:44:52.144887 12812 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:44:52.146247 12812 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:44:52.147482 12812 hybrid_clock.cc:648] HybridClock initialized: now 1786164292147469 us; error 38 us; skew 500 ppm
Aug 08 04:44:52 dist-test-slave-vxj2 krb5kdc[12798](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164292, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.240.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:44:52.150847 12812 init.cc:377] Logged in from keytab as kudu/127.20.240.254@KRBTEST.COM (short username kudu)
I20260808 04:44:52.151919 12812 webserver.cc:460] Webserver started at http://127.20.240.254:46181/ using document root <none> and password file <none>
I20260808 04:44:52.152537 12812 fs_manager.cc:359] Metadata directory not provided
I20260808 04:44:52.152633 12812 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:44:52.152873 12812 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 04:44:52.155156 12812 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786164000593138-21443-0/minicluster-data/master-0/data/instance:
uuid: "8cf85b7f395a47e08e9e425fd1965ea4"
format_stamp: "Formatted at 2026-08-08 04:44:52 on dist-test-slave-vxj2"
server_key: "fe3dd2f6bd70a5a746174c8576d02df5"
server_key_iv: "5e222331e8c56c26768266c0e210a2bf"
server_key_version: "encryptionkey@0"
I20260808 04:44:52.155777 12812 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786164000593138-21443-0/minicluster-data/master-0/wal/instance:
uuid: "8cf85b7f395a47e08e9e425fd1965ea4"
format_stamp: "Formatted at 2026-08-08 04:44:52 on dist-test-slave-vxj2"
server_key: "fe3dd2f6bd70a5a746174c8576d02df5"
server_key_iv: "5e222331e8c56c26768266c0e210a2bf"
server_key_version: "encryptionkey@0"
I20260808 04:44:52.159929 12812 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.003s
I20260808 04:44:52.162889 12829 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:44:52.164318 12812 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260808 04:44:52.164520 12812 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786164000593138-21443-0/minicluster-data/master-0/data,/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786164000593138-21443-0/minicluster-data/master-0/wal
uuid: "8cf85b7f395a47e08e9e425fd1965ea4"
format_stamp: "Formatted at 2026-08-08 04:44:52 on dist-test-slave-vxj2"
server_key: "fe3dd2f6bd70a5a746174c8576d02df5"
server_key_iv: "5e222331e8c56c26768266c0e210a2bf"
server_key_version: "encryptionkey@0"
I20260808 04:44:52.164652 12812 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786164000593138-21443-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786164000593138-21443-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786164000593138-21443-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:44:52.182497 12812 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:44:52.185617 12812 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:44:52.185853 12812 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:44:52.193961 12812 rpc_server.cc:307] RPC server started. Bound to: 127.20.240.254:43525
I20260808 04:44:52.193987 12884 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.240.254:43525 every 8 connection(s)
I20260808 04:44:52.194994 12812 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786164000593138-21443-0/minicluster-data/master-0/data/info.pb
I20260808 04:44:52.198015 12885 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:44:52.202162 21443 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu as pid 12812
I20260808 04:44:52.202333 21443 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786164000593138-21443-0/minicluster-data/master-0/wal/instance
I20260808 04:44:52.202665 21443 external_mini_cluster.cc:1428] Setting key d417f8dc975a8f8d6c3d66af5cfa07df
I20260808 04:44:52.204710 12885 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8cf85b7f395a47e08e9e425fd1965ea4: Bootstrap starting.
I20260808 04:44:52.207208 12885 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8cf85b7f395a47e08e9e425fd1965ea4: Neither blocks nor log segments found. Creating new log.
I20260808 04:44:52.207998 12885 log.cc:824] T 00000000000000000000000000000000 P 8cf85b7f395a47e08e9e425fd1965ea4: Log is configured to *not* fsync() on all Append() calls
I20260808 04:44:52.210224 12885 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8cf85b7f395a47e08e9e425fd1965ea4: No bootstrap required, opened a new log
Aug 08 04:44:52 dist-test-slave-vxj2 krb5kdc[12798](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164291, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.240.254@KRBTEST.COM
I20260808 04:44:52.214769 12885 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8cf85b7f395a47e08e9e425fd1965ea4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8cf85b7f395a47e08e9e425fd1965ea4" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 43525 } }
I20260808 04:44:52.215035 12885 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8cf85b7f395a47e08e9e425fd1965ea4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:44:52.215132 12885 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8cf85b7f395a47e08e9e425fd1965ea4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8cf85b7f395a47e08e9e425fd1965ea4, State: Initialized, Role: FOLLOWER
I20260808 04:44:52.215646 12885 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8cf85b7f395a47e08e9e425fd1965ea4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8cf85b7f395a47e08e9e425fd1965ea4" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 43525 } }
I20260808 04:44:52.215791 12885 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8cf85b7f395a47e08e9e425fd1965ea4 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 04:44:52.215864 12885 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8cf85b7f395a47e08e9e425fd1965ea4 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 04:44:52.216033 12885 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8cf85b7f395a47e08e9e425fd1965ea4 [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:44:52.217330 12885 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8cf85b7f395a47e08e9e425fd1965ea4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8cf85b7f395a47e08e9e425fd1965ea4" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 43525 } }
I20260808 04:44:52.217725 12885 leader_election.cc:302] T 00000000000000000000000000000000 P 8cf85b7f395a47e08e9e425fd1965ea4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8cf85b7f395a47e08e9e425fd1965ea4; no voters:
I20260808 04:44:52.218091 12885 leader_election.cc:288] T 00000000000000000000000000000000 P 8cf85b7f395a47e08e9e425fd1965ea4 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 04:44:52.218220 12891 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8cf85b7f395a47e08e9e425fd1965ea4 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 04:44:52.218384 12889 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:52.204230 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49455 (local address 127.20.240.254:43525)
0808 04:44:52.204679 (+ 449us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:52.204694 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:52.204732 (+ 38us) server_negotiation.cc:407] Connection header received
0808 04:44:52.205519 (+ 787us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:52.205538 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:52.205947 (+ 409us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:52.206288 (+ 341us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:44:52.207171 (+ 883us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:52.208294 (+ 1123us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:52.209411 (+ 1117us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:52.209941 (+ 530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:52.210092 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:52.213044 (+ 2952us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:44:52.213049 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:44:52.213064 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:44:52.213097 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:44:52.214972 (+ 1875us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:44:52.215501 (+ 529us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:44:52.215507 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:44:52.215518 (+ 11us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:44:52.215634 (+ 116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:44:52.215941 (+ 307us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:44:52.215946 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:44:52.215948 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:44:52.216498 (+ 550us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:44:52.216711 (+ 213us) server_negotiation.cc:1035] Waiting for connection context
0808 04:44:52.216922 (+ 211us) server_negotiation.cc:299] Negotiation successful
0808 04:44:52.217306 (+ 384us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":306,"thread_start_us":143,"threads_started":1}
I20260808 04:44:52.218462 12891 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8cf85b7f395a47e08e9e425fd1965ea4 [term 1 LEADER]: Becoming Leader. State: Replica: 8cf85b7f395a47e08e9e425fd1965ea4, State: Running, Role: LEADER
I20260808 04:44:52.219034 12891 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8cf85b7f395a47e08e9e425fd1965ea4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8cf85b7f395a47e08e9e425fd1965ea4" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 43525 } }
I20260808 04:44:52.219481 12885 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8cf85b7f395a47e08e9e425fd1965ea4 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 04:44:52.221362 12893 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8cf85b7f395a47e08e9e425fd1965ea4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8cf85b7f395a47e08e9e425fd1965ea4. Latest consensus state: current_term: 1 leader_uuid: "8cf85b7f395a47e08e9e425fd1965ea4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8cf85b7f395a47e08e9e425fd1965ea4" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 43525 } } }
I20260808 04:44:52.222040 21443 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 04:44:52.221653 12892 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8cf85b7f395a47e08e9e425fd1965ea4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8cf85b7f395a47e08e9e425fd1965ea4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8cf85b7f395a47e08e9e425fd1965ea4" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 43525 } } }
I20260808 04:44:52.225723 12892 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8cf85b7f395a47e08e9e425fd1965ea4 [sys.catalog]: This master's current role is: LEADER
I20260808 04:44:52.221792 12893 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8cf85b7f395a47e08e9e425fd1965ea4 [sys.catalog]: This master's current role is: LEADER
W20260808 04:44:52.225481 12906 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 8cf85b7f395a47e08e9e425fd1965ea4: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 04:44:52.226210 12906 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 04:44:52.226351 12914 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 04:44:52.227267 12914 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 04:44:52.234028 12889 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:52.224447 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56055 (local address 127.20.240.254:43525)
0808 04:44:52.224569 (+ 122us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:52.224573 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:52.224859 (+ 286us) server_negotiation.cc:407] Connection header received
0808 04:44:52.224996 (+ 137us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:52.224999 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:52.225053 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:52.225171 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:44:52.226088 (+ 917us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:52.226956 (+ 868us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:52.228134 (+ 1178us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:52.228506 (+ 372us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:52.228621 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:52.230313 (+ 1692us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:44:52.230316 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:44:52.230319 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:44:52.230350 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:44:52.231869 (+ 1519us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:44:52.232409 (+ 540us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:44:52.232413 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:44:52.232415 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:44:52.232517 (+ 102us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:44:52.232890 (+ 373us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:44:52.232893 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:44:52.232895 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:44:52.233143 (+ 248us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:44:52.233293 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0808 04:44:52.233704 (+ 411us) server_negotiation.cc:299] Negotiation successful
0808 04:44:52.233845 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260808 04:44:52.234853 12914 catalog_manager.cc:1347] Generated new cluster ID: eba511af73c54656ac236730f22b7e63
I20260808 04:44:52.234921 12914 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 04:44:52.254841 12914 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 04:44:52.256366 12914 catalog_manager.cc:1504] Loading token signing keys...
I20260808 04:44:52.261004 12914 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8cf85b7f395a47e08e9e425fd1965ea4: Generated new TSK 0
I20260808 04:44:52.261747 12914 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 04:44:52.268251 21443 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu with pid 12812
2026-08-08T04:44:52Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/15 (1516 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/16
Loading random data
Initializing database '/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786164000593138-21443-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 04:44:52 dist-test-slave-vxj2 krb5kdc[12918](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 04:44:52 dist-test-slave-vxj2 krb5kdc[12918](info): set up 2 sockets
Aug 08 04:44:52 dist-test-slave-vxj2 krb5kdc[12918](info): commencing operation
krb5kdc: starting...
W20260808 04:44:53.381633 21443 mini_kdc.cc:121] Time spent starting KDC: real 1.091s user 0.005s sys 0.002s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786164000593138-21443-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786164000593138-21443-0/krb5kdc/test-user.keytab.
Aug 08 04:44:53 dist-test-slave-vxj2 krb5kdc[12918](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164293, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T04:44:53Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T04:44:53Z Disabled control of system clock
WARNING: no policy specified for kudu/127.20.240.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.240.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.240.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.254.keytab.
Entry for principal kudu/127.20.240.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.254.keytab.
I20260808 04:44:53.519936 21443 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
/tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786164000593138-21443-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786164000593138-21443-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786164000593138-21443-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786164000593138-21443-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.240.254:32921
--webserver_interface=127.20.240.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.254.keytab
--principal=kudu/127.20.240.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.240.212:44455
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.240.254:32921
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786164000593138-21443-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786164000593138-21443-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786164000593138-21443-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 04:44:53.639559 12932 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:44:53.639886 12932 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:44:53.639931 12932 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:44:53.644049 12932 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 04:44:53.644125 12932 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:44:53.644145 12932 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:44:53.644162 12932 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 04:44:53.644177 12932 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 04:44:53.649860 12932 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.240.212:44455
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786164000593138-21443-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786164000593138-21443-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.240.254:32921
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.254.keytab
--principal=kudu/127.20.240.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.240.254:32921
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786164000593138-21443-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.240.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12932
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786164000593138-21443-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 04:05:18 UTC on ccycloud.quasar-drfdgt.root.comops.site
build id 4574101
I20260808 04:44:53.650988 12932 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:44:53.652014 12932 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:44:53.661130 12938 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:44:53.661114 12940 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:44:53.661114 12937 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:44:53.661523 12932 server_base.cc:1034] running on GCE node
I20260808 04:44:53.662250 12932 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:44:53.663470 12932 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:44:53.664660 12932 hybrid_clock.cc:648] HybridClock initialized: now 1786164293664641 us; error 35 us; skew 500 ppm
Aug 08 04:44:53 dist-test-slave-vxj2 krb5kdc[12918](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164293, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.240.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:44:53.668016 12932 init.cc:377] Logged in from keytab as kudu/127.20.240.254@KRBTEST.COM (short username kudu)
I20260808 04:44:53.669206 12932 webserver.cc:460] Webserver started at http://127.20.240.254:39433/ using document root <none> and password file <none>
I20260808 04:44:53.669826 12932 fs_manager.cc:359] Metadata directory not provided
I20260808 04:44:53.669929 12932 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:44:53.670177 12932 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 04:44:53.672372 12932 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786164000593138-21443-0/minicluster-data/master-0/data/instance:
uuid: "968a43e695214cd8a7ffec41c1c9f5fa"
format_stamp: "Formatted at 2026-08-08 04:44:53 on dist-test-slave-vxj2"
server_key: "73267e326ce6eb3beb41aa312766d28f"
server_key_iv: "f28505f148fc3dc79a0087e18968e778"
server_key_version: "encryptionkey@0"
I20260808 04:44:53.672986 12932 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786164000593138-21443-0/minicluster-data/master-0/wal/instance:
uuid: "968a43e695214cd8a7ffec41c1c9f5fa"
format_stamp: "Formatted at 2026-08-08 04:44:53 on dist-test-slave-vxj2"
server_key: "73267e326ce6eb3beb41aa312766d28f"
server_key_iv: "f28505f148fc3dc79a0087e18968e778"
server_key_version: "encryptionkey@0"
I20260808 04:44:53.677232 12932 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20260808 04:44:53.680042 12947 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:44:53.681543 12932 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 04:44:53.681708 12932 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786164000593138-21443-0/minicluster-data/master-0/data,/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786164000593138-21443-0/minicluster-data/master-0/wal
uuid: "968a43e695214cd8a7ffec41c1c9f5fa"
format_stamp: "Formatted at 2026-08-08 04:44:53 on dist-test-slave-vxj2"
server_key: "73267e326ce6eb3beb41aa312766d28f"
server_key_iv: "f28505f148fc3dc79a0087e18968e778"
server_key_version: "encryptionkey@0"
I20260808 04:44:53.681849 12932 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786164000593138-21443-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786164000593138-21443-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786164000593138-21443-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:44:53.706353 12932 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:44:53.709893 12932 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:44:53.710143 12932 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:44:53.718276 12932 rpc_server.cc:307] RPC server started. Bound to: 127.20.240.254:32921
I20260808 04:44:53.718297 13002 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.240.254:32921 every 8 connection(s)
I20260808 04:44:53.719395 12932 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786164000593138-21443-0/minicluster-data/master-0/data/info.pb
I20260808 04:44:53.722443 13003 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:44:53.727730 21443 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu as pid 12932
I20260808 04:44:53.727902 21443 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786164000593138-21443-0/minicluster-data/master-0/wal/instance
I20260808 04:44:53.728214 21443 external_mini_cluster.cc:1428] Setting key 590c541846ccc111c16b801b0d4cf8a5
I20260808 04:44:53.728518 13003 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 968a43e695214cd8a7ffec41c1c9f5fa: Bootstrap starting.
I20260808 04:44:53.731431 13003 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 968a43e695214cd8a7ffec41c1c9f5fa: Neither blocks nor log segments found. Creating new log.
I20260808 04:44:53.732380 13003 log.cc:824] T 00000000000000000000000000000000 P 968a43e695214cd8a7ffec41c1c9f5fa: Log is configured to *not* fsync() on all Append() calls
I20260808 04:44:53.734776 13003 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 968a43e695214cd8a7ffec41c1c9f5fa: No bootstrap required, opened a new log
I20260808 04:44:53.739670 13006 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:53.729758 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53117 (local address 127.20.240.254:32921)
0808 04:44:53.730213 (+ 455us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:53.730232 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:53.730277 (+ 45us) server_negotiation.cc:407] Connection header received
0808 04:44:53.731189 (+ 912us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:53.731212 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:53.731689 (+ 477us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:53.732073 (+ 384us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:44:53.732533 (+ 460us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:53.733902 (+ 1369us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:53.735102 (+ 1200us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:53.735814 (+ 712us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:53.735989 (+ 175us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:53.737058 (+ 1069us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:44:53.737066 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:44:53.737087 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 04:44:53.737716 (+ 629us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:44:53.737798 (+ 82us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 04:44:53.737832 (+ 34us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:44:53.737946 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0808 04:44:53.738212 (+ 266us) server_negotiation.cc:299] Negotiation successful
0808 04:44:53.738555 (+ 343us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":295,"thread_start_us":132,"threads_started":1}
I20260808 04:44:53.740091 13003 raft_consensus.cc:348] T 00000000000000000000000000000000 P 968a43e695214cd8a7ffec41c1c9f5fa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "968a43e695214cd8a7ffec41c1c9f5fa" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 32921 } }
I20260808 04:44:53.740373 13003 raft_consensus.cc:374] T 00000000000000000000000000000000 P 968a43e695214cd8a7ffec41c1c9f5fa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:44:53.740451 13003 raft_consensus.cc:729] T 00000000000000000000000000000000 P 968a43e695214cd8a7ffec41c1c9f5fa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 968a43e695214cd8a7ffec41c1c9f5fa, State: Initialized, Role: FOLLOWER
I20260808 04:44:53.740949 13003 consensus_queue.cc:260] T 00000000000000000000000000000000 P 968a43e695214cd8a7ffec41c1c9f5fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "968a43e695214cd8a7ffec41c1c9f5fa" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 32921 } }
I20260808 04:44:53.741122 13003 raft_consensus.cc:388] T 00000000000000000000000000000000 P 968a43e695214cd8a7ffec41c1c9f5fa [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 04:44:53.741217 13003 raft_consensus.cc:482] T 00000000000000000000000000000000 P 968a43e695214cd8a7ffec41c1c9f5fa [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 04:44:53.741322 13003 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 968a43e695214cd8a7ffec41c1c9f5fa [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:44:53.742625 13003 raft_consensus.cc:504] T 00000000000000000000000000000000 P 968a43e695214cd8a7ffec41c1c9f5fa [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "968a43e695214cd8a7ffec41c1c9f5fa" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 32921 } }
I20260808 04:44:53.743021 13003 leader_election.cc:302] T 00000000000000000000000000000000 P 968a43e695214cd8a7ffec41c1c9f5fa [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 968a43e695214cd8a7ffec41c1c9f5fa; no voters:
I20260808 04:44:53.743376 21443 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 04:44:53.743405 13003 leader_election.cc:288] T 00000000000000000000000000000000 P 968a43e695214cd8a7ffec41c1c9f5fa [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 04:44:53.743486 13008 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 968a43e695214cd8a7ffec41c1c9f5fa [term 1 FOLLOWER]: Leader election won for term 1
I20260808 04:44:53.743678 13008 raft_consensus.cc:686] T 00000000000000000000000000000000 P 968a43e695214cd8a7ffec41c1c9f5fa [term 1 LEADER]: Becoming Leader. State: Replica: 968a43e695214cd8a7ffec41c1c9f5fa, State: Running, Role: LEADER
I20260808 04:44:53.744005 13008 consensus_queue.cc:237] T 00000000000000000000000000000000 P 968a43e695214cd8a7ffec41c1c9f5fa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "968a43e695214cd8a7ffec41c1c9f5fa" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 32921 } }
I20260808 04:44:53.744833 13003 sys_catalog.cc:564] T 00000000000000000000000000000000 P 968a43e695214cd8a7ffec41c1c9f5fa [sys.catalog]: configured and running, proceeding with master startup.
I20260808 04:44:53.745282 13008 sys_catalog.cc:455] T 00000000000000000000000000000000 P 968a43e695214cd8a7ffec41c1c9f5fa [sys.catalog]: SysCatalogTable state changed. Reason: New leader 968a43e695214cd8a7ffec41c1c9f5fa. Latest consensus state: current_term: 1 leader_uuid: "968a43e695214cd8a7ffec41c1c9f5fa" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "968a43e695214cd8a7ffec41c1c9f5fa" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 32921 } } }
I20260808 04:44:53.745417 13008 sys_catalog.cc:458] T 00000000000000000000000000000000 P 968a43e695214cd8a7ffec41c1c9f5fa [sys.catalog]: This master's current role is: LEADER
I20260808 04:44:53.745733 13009 sys_catalog.cc:455] T 00000000000000000000000000000000 P 968a43e695214cd8a7ffec41c1c9f5fa [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "968a43e695214cd8a7ffec41c1c9f5fa" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "968a43e695214cd8a7ffec41c1c9f5fa" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 32921 } } }
I20260808 04:44:53.745838 13016 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 04:44:53.745851 13009 sys_catalog.cc:458] T 00000000000000000000000000000000 P 968a43e695214cd8a7ffec41c1c9f5fa [sys.catalog]: This master's current role is: LEADER
I20260808 04:44:53.749440 13016 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 04:44:53.751621 13006 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:53.745852 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36221 (local address 127.20.240.254:32921)
0808 04:44:53.745997 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:53.746004 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:53.746755 (+ 751us) server_negotiation.cc:407] Connection header received
0808 04:44:53.747009 (+ 254us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:53.747012 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:53.747067 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:53.747121 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:44:53.747555 (+ 434us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:53.748308 (+ 753us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:53.749584 (+ 1276us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:53.749927 (+ 343us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:53.750013 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:53.751167 (+ 1154us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:44:53.751171 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:44:53.751174 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 04:44:53.751188 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:44:53.751219 (+ 31us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 04:44:53.751233 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:44:53.751300 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0808 04:44:53.751415 (+ 115us) server_negotiation.cc:299] Negotiation successful
0808 04:44:53.751473 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260808 04:44:53.755897 13016 catalog_manager.cc:1347] Generated new cluster ID: 7314c3ff6bcb4e4788fa976e4239f024
I20260808 04:44:53.755986 13016 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 04:44:53.782991 13016 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 04:44:53.784055 13016 catalog_manager.cc:1504] Loading token signing keys...
I20260808 04:44:53.789371 13016 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 968a43e695214cd8a7ffec41c1c9f5fa: Generated new TSK 0
I20260808 04:44:53.790135 13016 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 04:44:53.798640 21443 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu with pid 12932
2026-08-08T04:44:53Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/16 (1530 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/17
Loading random data
Initializing database '/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786164000593138-21443-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 04:44:53 dist-test-slave-vxj2 krb5kdc[13035](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 04:44:53 dist-test-slave-vxj2 krb5kdc[13035](info): set up 2 sockets
Aug 08 04:44:53 dist-test-slave-vxj2 krb5kdc[13035](info): commencing operation
krb5kdc: starting...
W20260808 04:44:54.889143 21443 mini_kdc.cc:121] Time spent starting KDC: real 1.067s user 0.007s sys 0.000s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786164000593138-21443-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786164000593138-21443-0/krb5kdc/test-user.keytab.
Aug 08 04:44:54 dist-test-slave-vxj2 krb5kdc[13035](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164294, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T04:44:54Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T04:44:54Z Disabled control of system clock
WARNING: no policy specified for kudu/127.20.240.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.240.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.240.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.254.keytab.
Entry for principal kudu/127.20.240.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.254.keytab.
I20260808 04:44:55.021778 21443 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
/tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786164000593138-21443-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786164000593138-21443-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786164000593138-21443-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786164000593138-21443-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.240.254:34399
--webserver_interface=127.20.240.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.254.keytab
--principal=kudu/127.20.240.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.240.212:44761
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.240.254:34399
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786164000593138-21443-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786164000593138-21443-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786164000593138-21443-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 04:44:55.138168 13049 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:44:55.138458 13049 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:44:55.138502 13049 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:44:55.142584 13049 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 04:44:55.142653 13049 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:44:55.142673 13049 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:44:55.142690 13049 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 04:44:55.142705 13049 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 04:44:55.148180 13049 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.240.212:44761
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786164000593138-21443-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786164000593138-21443-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.240.254:34399
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.254.keytab
--principal=kudu/127.20.240.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.240.254:34399
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786164000593138-21443-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.240.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13049
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786164000593138-21443-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 04:05:18 UTC on ccycloud.quasar-drfdgt.root.comops.site
build id 4574101
I20260808 04:44:55.149338 13049 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:44:55.150404 13049 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:44:55.159078 13058 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:44:55.159078 13054 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:44:55.159101 13055 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:44:55.159327 13049 server_base.cc:1034] running on GCE node
I20260808 04:44:55.159992 13049 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:44:55.161134 13049 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:44:55.162384 13049 hybrid_clock.cc:648] HybridClock initialized: now 1786164295162377 us; error 34 us; skew 500 ppm
Aug 08 04:44:55 dist-test-slave-vxj2 krb5kdc[13035](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164295, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.240.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:44:55.165452 13049 init.cc:377] Logged in from keytab as kudu/127.20.240.254@KRBTEST.COM (short username kudu)
I20260808 04:44:55.166343 13049 webserver.cc:460] Webserver started at http://127.20.240.254:42705/ using document root <none> and password file <none>
I20260808 04:44:55.166906 13049 fs_manager.cc:359] Metadata directory not provided
I20260808 04:44:55.166970 13049 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:44:55.167143 13049 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 04:44:55.169337 13049 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786164000593138-21443-0/minicluster-data/master-0/data/instance:
uuid: "48fa4473903d4fdcb32c5d8838f74bd2"
format_stamp: "Formatted at 2026-08-08 04:44:55 on dist-test-slave-vxj2"
server_key: "48176339dfab7b5c354a664227613377"
server_key_iv: "b6f48c0763a969e0bf2e2130c6f6df01"
server_key_version: "encryptionkey@0"
I20260808 04:44:55.169910 13049 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786164000593138-21443-0/minicluster-data/master-0/wal/instance:
uuid: "48fa4473903d4fdcb32c5d8838f74bd2"
format_stamp: "Formatted at 2026-08-08 04:44:55 on dist-test-slave-vxj2"
server_key: "48176339dfab7b5c354a664227613377"
server_key_iv: "b6f48c0763a969e0bf2e2130c6f6df01"
server_key_version: "encryptionkey@0"
I20260808 04:44:55.174041 13049 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.002s
I20260808 04:44:55.176712 13065 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:44:55.178395 13049 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260808 04:44:55.178567 13049 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786164000593138-21443-0/minicluster-data/master-0/data,/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786164000593138-21443-0/minicluster-data/master-0/wal
uuid: "48fa4473903d4fdcb32c5d8838f74bd2"
format_stamp: "Formatted at 2026-08-08 04:44:55 on dist-test-slave-vxj2"
server_key: "48176339dfab7b5c354a664227613377"
server_key_iv: "b6f48c0763a969e0bf2e2130c6f6df01"
server_key_version: "encryptionkey@0"
I20260808 04:44:55.178697 13049 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786164000593138-21443-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786164000593138-21443-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786164000593138-21443-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:44:55.184206 13049 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:44:55.187695 13049 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:44:55.187922 13049 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:44:55.195111 13049 rpc_server.cc:307] RPC server started. Bound to: 127.20.240.254:34399
I20260808 04:44:55.195228 13122 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.240.254:34399 every 8 connection(s)
I20260808 04:44:55.196091 13049 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786164000593138-21443-0/minicluster-data/master-0/data/info.pb
I20260808 04:44:55.199133 13123 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:44:55.199285 21443 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu as pid 13049
I20260808 04:44:55.199450 21443 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786164000593138-21443-0/minicluster-data/master-0/wal/instance
I20260808 04:44:55.199753 21443 external_mini_cluster.cc:1428] Setting key 623d4913f58151761f604c680d4b195d
I20260808 04:44:55.205263 13127 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:55.201088 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57593 (local address 127.20.240.254:34399)
0808 04:44:55.201591 (+ 503us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:55.201606 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:55.201641 (+ 35us) server_negotiation.cc:407] Connection header received
0808 04:44:55.202589 (+ 948us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:55.202608 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:55.202889 (+ 281us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:55.203218 (+ 329us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:44:55.204043 (+ 825us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:44:55.204048 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:44:55.204059 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 04:44:55.204070 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:44:55.204123 (+ 53us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 04:44:55.204141 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:44:55.204289 (+ 148us) server_negotiation.cc:1035] Waiting for connection context
0808 04:44:55.204365 (+ 76us) server_negotiation.cc:299] Negotiation successful
0808 04:44:55.204519 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":358,"thread_start_us":156,"threads_started":1}
I20260808 04:44:55.206202 13123 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 48fa4473903d4fdcb32c5d8838f74bd2: Bootstrap starting.
I20260808 04:44:55.207954 21443 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 04:44:55.208650 13123 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 48fa4473903d4fdcb32c5d8838f74bd2: Neither blocks nor log segments found. Creating new log.
I20260808 04:44:55.209513 13123 log.cc:824] T 00000000000000000000000000000000 P 48fa4473903d4fdcb32c5d8838f74bd2: Log is configured to *not* fsync() on all Append() calls
I20260808 04:44:55.211635 13127 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:55.209966 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46661 (local address 127.20.240.254:34399)
0808 04:44:55.210108 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:55.210114 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:55.210385 (+ 271us) server_negotiation.cc:407] Connection header received
0808 04:44:55.210504 (+ 119us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:55.210507 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:55.210539 (+ 32us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:55.210621 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:44:55.211287 (+ 666us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:44:55.211290 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:44:55.211293 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 04:44:55.211304 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:44:55.211334 (+ 30us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 04:44:55.211346 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:44:55.211439 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0808 04:44:55.211483 (+ 44us) server_negotiation.cc:299] Negotiation successful
0808 04:44:55.211520 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260808 04:44:55.211926 13123 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 48fa4473903d4fdcb32c5d8838f74bd2: No bootstrap required, opened a new log
I20260808 04:44:55.215701 13123 raft_consensus.cc:348] T 00000000000000000000000000000000 P 48fa4473903d4fdcb32c5d8838f74bd2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "48fa4473903d4fdcb32c5d8838f74bd2" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 34399 } }
I20260808 04:44:55.215930 13123 raft_consensus.cc:374] T 00000000000000000000000000000000 P 48fa4473903d4fdcb32c5d8838f74bd2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:44:55.216003 13123 raft_consensus.cc:729] T 00000000000000000000000000000000 P 48fa4473903d4fdcb32c5d8838f74bd2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48fa4473903d4fdcb32c5d8838f74bd2, State: Initialized, Role: FOLLOWER
I20260808 04:44:55.216431 13123 consensus_queue.cc:260] T 00000000000000000000000000000000 P 48fa4473903d4fdcb32c5d8838f74bd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "48fa4473903d4fdcb32c5d8838f74bd2" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 34399 } }
I20260808 04:44:55.216572 13123 raft_consensus.cc:388] T 00000000000000000000000000000000 P 48fa4473903d4fdcb32c5d8838f74bd2 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 04:44:55.216643 13123 raft_consensus.cc:482] T 00000000000000000000000000000000 P 48fa4473903d4fdcb32c5d8838f74bd2 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 04:44:55.216768 13123 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 48fa4473903d4fdcb32c5d8838f74bd2 [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:44:55.217792 13123 raft_consensus.cc:504] T 00000000000000000000000000000000 P 48fa4473903d4fdcb32c5d8838f74bd2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "48fa4473903d4fdcb32c5d8838f74bd2" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 34399 } }
I20260808 04:44:55.218138 13123 leader_election.cc:302] T 00000000000000000000000000000000 P 48fa4473903d4fdcb32c5d8838f74bd2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 48fa4473903d4fdcb32c5d8838f74bd2; no voters:
I20260808 04:44:55.218453 13123 leader_election.cc:288] T 00000000000000000000000000000000 P 48fa4473903d4fdcb32c5d8838f74bd2 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 04:44:55.218586 13134 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 48fa4473903d4fdcb32c5d8838f74bd2 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 04:44:55.218842 13134 raft_consensus.cc:686] T 00000000000000000000000000000000 P 48fa4473903d4fdcb32c5d8838f74bd2 [term 1 LEADER]: Becoming Leader. State: Replica: 48fa4473903d4fdcb32c5d8838f74bd2, State: Running, Role: LEADER
I20260808 04:44:55.219178 13134 consensus_queue.cc:237] T 00000000000000000000000000000000 P 48fa4473903d4fdcb32c5d8838f74bd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "48fa4473903d4fdcb32c5d8838f74bd2" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 34399 } }
I20260808 04:44:55.219864 13123 sys_catalog.cc:564] T 00000000000000000000000000000000 P 48fa4473903d4fdcb32c5d8838f74bd2 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 04:44:55.220918 13136 sys_catalog.cc:455] T 00000000000000000000000000000000 P 48fa4473903d4fdcb32c5d8838f74bd2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 48fa4473903d4fdcb32c5d8838f74bd2. Latest consensus state: current_term: 1 leader_uuid: "48fa4473903d4fdcb32c5d8838f74bd2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "48fa4473903d4fdcb32c5d8838f74bd2" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 34399 } } }
I20260808 04:44:55.221063 13136 sys_catalog.cc:458] T 00000000000000000000000000000000 P 48fa4473903d4fdcb32c5d8838f74bd2 [sys.catalog]: This master's current role is: LEADER
I20260808 04:44:55.221273 13135 sys_catalog.cc:455] T 00000000000000000000000000000000 P 48fa4473903d4fdcb32c5d8838f74bd2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "48fa4473903d4fdcb32c5d8838f74bd2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "48fa4473903d4fdcb32c5d8838f74bd2" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 34399 } } }
I20260808 04:44:55.221427 13135 sys_catalog.cc:458] T 00000000000000000000000000000000 P 48fa4473903d4fdcb32c5d8838f74bd2 [sys.catalog]: This master's current role is: LEADER
I20260808 04:44:55.221506 13144 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 04:44:55.224828 13144 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 04:44:55.230798 13144 catalog_manager.cc:1347] Generated new cluster ID: fc326bbbd437456c90a5ac56a7499dde
I20260808 04:44:55.230901 13144 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 04:44:55.246508 13144 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 04:44:55.246908 13144 catalog_manager.cc:1504] Loading token signing keys...
I20260808 04:44:55.258333 13144 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 48fa4473903d4fdcb32c5d8838f74bd2: Generated new TSK 0
I20260808 04:44:55.259251 13144 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 04:44:55.274145 21443 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu with pid 13049
2026-08-08T04:44:55Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/17 (1475 ms)
[----------] 18 tests from AuthTokenIssuingTest (27112 ms total)
[----------] 2 tests from ConnectToFollowerMasterTest
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0
Loading random data
Initializing database '/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786164000593138-21443-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 04:44:55 dist-test-slave-vxj2 krb5kdc[13158](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 04:44:55 dist-test-slave-vxj2 krb5kdc[13158](info): set up 2 sockets
Aug 08 04:44:55 dist-test-slave-vxj2 krb5kdc[13158](info): commencing operation
krb5kdc: starting...
W20260808 04:44:56.373667 21443 mini_kdc.cc:121] Time spent starting KDC: real 1.077s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786164000593138-21443-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786164000593138-21443-0/krb5kdc/test-user.keytab.
Aug 08 04:44:56 dist-test-slave-vxj2 krb5kdc[13158](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164296, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T04:44:56Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T04:44:56Z Disabled control of system clock
WARNING: no policy specified for kudu/127.20.240.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.240.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.240.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.254.keytab.
Entry for principal kudu/127.20.240.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.254.keytab.
I20260808 04:44:56.502002 21443 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
/tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786164000593138-21443-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786164000593138-21443-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786164000593138-21443-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786164000593138-21443-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.240.254:42189
--webserver_interface=127.20.240.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.254.keytab
--principal=kudu/127.20.240.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.240.212:34135
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.240.254:42189,127.20.240.253:44573,127.20.240.252:34811
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786164000593138-21443-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786164000593138-21443-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786164000593138-21443-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 04:44:56.618618 13171 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260808 04:44:56.618963 13171 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:44:56.619021 13171 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:44:56.619102 13171 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:44:56.623284 13171 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 04:44:56.623361 13171 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:44:56.623381 13171 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:44:56.623399 13171 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 04:44:56.623414 13171 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 04:44:56.629289 13171 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.240.212:34135
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786164000593138-21443-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786164000593138-21443-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.240.254:42189,127.20.240.253:44573,127.20.240.252:34811
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.254.keytab
--principal=kudu/127.20.240.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.240.254:42189
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786164000593138-21443-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.240.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13171
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786164000593138-21443-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 04:05:18 UTC on ccycloud.quasar-drfdgt.root.comops.site
build id 4574101
I20260808 04:44:56.630501 13171 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:44:56.631590 13171 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:44:56.640475 13177 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:44:56.640534 13179 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:44:56.640690 13171 server_base.cc:1034] running on GCE node
W20260808 04:44:56.640472 13176 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:44:56.641551 13171 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:44:56.642844 13171 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:44:56.644057 13171 hybrid_clock.cc:648] HybridClock initialized: now 1786164296644049 us; error 35 us; skew 500 ppm
Aug 08 04:44:56 dist-test-slave-vxj2 krb5kdc[13158](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164296, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.240.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:44:56.647301 13171 init.cc:377] Logged in from keytab as kudu/127.20.240.254@KRBTEST.COM (short username kudu)
I20260808 04:44:56.648309 13171 webserver.cc:460] Webserver started at http://127.20.240.254:40347/ using document root <none> and password file <none>
I20260808 04:44:56.648928 13171 fs_manager.cc:359] Metadata directory not provided
I20260808 04:44:56.648996 13171 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:44:56.649255 13171 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 04:44:56.651593 13171 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786164000593138-21443-0/minicluster-data/master-0/data/instance:
uuid: "a93f9acc99fc45509edfbfd94e11dc20"
format_stamp: "Formatted at 2026-08-08 04:44:56 on dist-test-slave-vxj2"
server_key: "0420e3adce0c7743f66ef3facf68b013"
server_key_iv: "da6ba6991f95d5cf49129d48788c5bb8"
server_key_version: "encryptionkey@0"
I20260808 04:44:56.652330 13171 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786164000593138-21443-0/minicluster-data/master-0/wal/instance:
uuid: "a93f9acc99fc45509edfbfd94e11dc20"
format_stamp: "Formatted at 2026-08-08 04:44:56 on dist-test-slave-vxj2"
server_key: "0420e3adce0c7743f66ef3facf68b013"
server_key_iv: "da6ba6991f95d5cf49129d48788c5bb8"
server_key_version: "encryptionkey@0"
I20260808 04:44:56.656581 13171 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.002s
I20260808 04:44:56.659395 13186 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:44:56.660918 13171 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260808 04:44:56.661082 13171 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786164000593138-21443-0/minicluster-data/master-0/data,/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786164000593138-21443-0/minicluster-data/master-0/wal
uuid: "a93f9acc99fc45509edfbfd94e11dc20"
format_stamp: "Formatted at 2026-08-08 04:44:56 on dist-test-slave-vxj2"
server_key: "0420e3adce0c7743f66ef3facf68b013"
server_key_iv: "da6ba6991f95d5cf49129d48788c5bb8"
server_key_version: "encryptionkey@0"
I20260808 04:44:56.661278 13171 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786164000593138-21443-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786164000593138-21443-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786164000593138-21443-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:44:56.698012 13171 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:44:56.701440 13171 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:44:56.701678 13171 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:44:56.709683 13171 rpc_server.cc:307] RPC server started. Bound to: 127.20.240.254:42189
I20260808 04:44:56.710022 13242 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.240.254:42189 every 8 connection(s)
I20260808 04:44:56.710817 13171 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786164000593138-21443-0/minicluster-data/master-0/data/info.pb
I20260808 04:44:56.713976 13244 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:44:56.718348 13244 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.240.254" port: 42189 } has no permanent_uuid. Determining permanent_uuid...
I20260808 04:44:56.719637 21443 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu as pid 13171
I20260808 04:44:56.719812 21443 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786164000593138-21443-0/minicluster-data/master-0/wal/instance
I20260808 04:44:56.720144 21443 external_mini_cluster.cc:1428] Setting key 2e0ac987e4265d69dc44d9d0e5429a39
WARNING: no policy specified for kudu/127.20.240.253@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.240.253@KRBTEST.COM" created.
Aug 08 04:44:56 dist-test-slave-vxj2 krb5kdc[13158](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164296, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.240.254@KRBTEST.COM for kudu/127.20.240.254@KRBTEST.COM
I20260808 04:44:56.739884 13247 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:56.721266 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41148 (local address 127.20.240.254:42189)
0808 04:44:56.721885 (+ 619us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:56.721911 (+ 26us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:56.722223 (+ 312us) server_negotiation.cc:407] Connection header received
0808 04:44:56.723406 (+ 1183us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:56.723413 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:56.723623 (+ 210us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:56.723804 (+ 181us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:44:56.725212 (+ 1408us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:56.726223 (+ 1011us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:56.728066 (+ 1843us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:56.728491 (+ 425us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:56.728650 (+ 159us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:56.734424 (+ 5774us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:44:56.734435 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:44:56.734454 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:44:56.734493 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:44:56.736288 (+ 1795us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:44:56.736920 (+ 632us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:44:56.736925 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:44:56.736926 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:44:56.737042 (+ 116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:44:56.737508 (+ 466us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:44:56.737511 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:44:56.737512 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:44:56.738067 (+ 555us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:44:56.738219 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0808 04:44:56.738732 (+ 513us) server_negotiation.cc:299] Negotiation successful
0808 04:44:56.738945 (+ 213us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":400,"spinlock_wait_cycles":61696,"thread_start_us":191,"threads_started":1}
I20260808 04:44:56.739889 13246 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:56.721282 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:42189 (local address 127.0.0.1:41148)
0808 04:44:56.722020 (+ 738us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:56.722079 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0808 04:44:56.723047 (+ 968us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:44:56.723871 (+ 824us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:44:56.723880 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:44:56.724460 (+ 580us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:44:56.724949 (+ 489us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:44:56.724978 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:44:56.726383 (+ 1405us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:44:56.726389 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:44:56.727891 (+ 1502us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:44:56.727906 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:44:56.728696 (+ 790us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:44:56.728702 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:44:56.728843 (+ 141us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:56.729587 (+ 744us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:44:56.729614 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:44:56.734213 (+ 4599us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:44:56.736433 (+ 2220us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:44:56.736446 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:44:56.736460 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:44:56.736785 (+ 325us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:44:56.737147 (+ 362us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:44:56.737182 (+ 35us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:44:56.737187 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:44:56.737386 (+ 199us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:44:56.738225 (+ 839us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:44:56.738236 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:44:56.738440 (+ 204us) client_negotiation.cc:769] Sending connection context
0808 04:44:56.738647 (+ 207us) client_negotiation.cc:240] Negotiation successful
0808 04:44:56.739029 (+ 382us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":526,"mutex_wait_us":1,"thread_start_us":190,"threads_started":1}
I20260808 04:44:56.742415 13244 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.240.253" port: 44573 } has no permanent_uuid. Determining permanent_uuid...
I20260808 04:44:56.743289 13246 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:56.742958 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.253:44573 (local address 127.0.0.1:34732)
0808 04:44:56.743120 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:56.743199 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.240.253:44573: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":67}
W20260808 04:44:56.743626 13187 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.20.240.253:44573: connect: Connection refused (error 111)
I20260808 04:44:56.744693 13246 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:56.744437 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.253:44573 (local address 127.0.0.1:34740)
0808 04:44:56.744550 (+ 113us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:56.744624 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.240.253:44573: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
W20260808 04:44:56.744977 13244 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.240.253:44573: Network error: Client connection negotiation failed: client connection to 127.20.240.253:44573: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.240.253 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.253.keytab.
Entry for principal kudu/127.20.240.253 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.253.keytab.
I20260808 04:44:56.752532 21443 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
/tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786164000593138-21443-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786164000593138-21443-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786164000593138-21443-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786164000593138-21443-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.240.253:44573
--webserver_interface=127.20.240.253
--webserver_port=0
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.253.keytab
--principal=kudu/127.20.240.253
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.240.212:34135
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.240.254:42189,127.20.240.253:44573,127.20.240.252:34811
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786164000593138-21443-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786164000593138-21443-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786164000593138-21443-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 04:44:56.794281 13244 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.240.253" port: 44573 } attempt: 1
I20260808 04:44:56.795368 13246 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:56.794914 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.253:44573 (local address 127.0.0.1:34742)
0808 04:44:56.795132 (+ 218us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:56.795228 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.240.253:44573: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":78}
I20260808 04:44:56.796301 13246 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:56.796020 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.253:44573 (local address 127.0.0.1:34758)
0808 04:44:56.796159 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:56.796227 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.240.253:44573: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
W20260808 04:44:56.796502 13244 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.240.253:44573: Network error: Client connection negotiation failed: client connection to 127.20.240.253:44573: connect: Connection refused (error 111)
I20260808 04:44:56.864713 13244 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.240.253" port: 44573 } attempt: 2
I20260808 04:44:56.865758 13246 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:56.865361 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.253:44573 (local address 127.0.0.1:34772)
0808 04:44:56.865578 (+ 217us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:56.865657 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.240.253:44573: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":63}
I20260808 04:44:56.866616 13246 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:56.866321 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.253:44573 (local address 127.0.0.1:34780)
0808 04:44:56.866448 (+ 127us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:56.866523 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.240.253:44573: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
W20260808 04:44:56.866753 13244 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.240.253:44573: Network error: Client connection negotiation failed: client connection to 127.20.240.253:44573: connect: Connection refused (error 111)
W20260808 04:44:56.870699 13252 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260808 04:44:56.871002 13252 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:44:56.871030 13252 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:44:56.871083 13252 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:44:56.875293 13252 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 04:44:56.875375 13252 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:44:56.875399 13252 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:44:56.875420 13252 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 04:44:56.875440 13252 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 04:44:56.881075 13252 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.240.212:34135
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786164000593138-21443-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786164000593138-21443-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.20.240.254:42189,127.20.240.253:44573,127.20.240.252:34811
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.253.keytab
--principal=kudu/127.20.240.253
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.240.253:44573
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786164000593138-21443-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.20.240.253
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13252
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786164000593138-21443-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 04:05:18 UTC on ccycloud.quasar-drfdgt.root.comops.site
build id 4574101
I20260808 04:44:56.882315 13252 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:44:56.883370 13252 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:44:56.892517 13257 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:44:56.892517 13260 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:44:56.892521 13258 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:44:56.892561 13252 server_base.cc:1034] running on GCE node
I20260808 04:44:56.893476 13252 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:44:56.894642 13252 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:44:56.895882 13252 hybrid_clock.cc:648] HybridClock initialized: now 1786164296895849 us; error 44 us; skew 500 ppm
Aug 08 04:44:56 dist-test-slave-vxj2 krb5kdc[13158](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164296, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.240.253@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:44:56.898918 13252 init.cc:377] Logged in from keytab as kudu/127.20.240.253@KRBTEST.COM (short username kudu)
I20260808 04:44:56.899896 13252 webserver.cc:460] Webserver started at http://127.20.240.253:41493/ using document root <none> and password file <none>
I20260808 04:44:56.900497 13252 fs_manager.cc:359] Metadata directory not provided
I20260808 04:44:56.900589 13252 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:44:56.900835 13252 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 04:44:56.903064 13252 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786164000593138-21443-0/minicluster-data/master-1/data/instance:
uuid: "e04b0ee76efd45d4b24bd7429b3efee1"
format_stamp: "Formatted at 2026-08-08 04:44:56 on dist-test-slave-vxj2"
server_key: "69bfd0d5cad30e4322860586fcad523a"
server_key_iv: "b1d3e4997206bc41fee629f28633b36c"
server_key_version: "encryptionkey@0"
I20260808 04:44:56.903689 13252 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786164000593138-21443-0/minicluster-data/master-1/wal/instance:
uuid: "e04b0ee76efd45d4b24bd7429b3efee1"
format_stamp: "Formatted at 2026-08-08 04:44:56 on dist-test-slave-vxj2"
server_key: "69bfd0d5cad30e4322860586fcad523a"
server_key_iv: "b1d3e4997206bc41fee629f28633b36c"
server_key_version: "encryptionkey@0"
I20260808 04:44:56.907689 13252 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260808 04:44:56.910328 13267 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:44:56.911665 13252 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 04:44:56.911831 13252 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786164000593138-21443-0/minicluster-data/master-1/data,/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786164000593138-21443-0/minicluster-data/master-1/wal
uuid: "e04b0ee76efd45d4b24bd7429b3efee1"
format_stamp: "Formatted at 2026-08-08 04:44:56 on dist-test-slave-vxj2"
server_key: "69bfd0d5cad30e4322860586fcad523a"
server_key_iv: "b1d3e4997206bc41fee629f28633b36c"
server_key_version: "encryptionkey@0"
I20260808 04:44:56.911957 13252 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786164000593138-21443-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786164000593138-21443-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786164000593138-21443-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:44:56.925782 13252 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:44:56.928704 13252 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:44:56.928915 13252 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:44:56.936127 13252 rpc_server.cc:307] RPC server started. Bound to: 127.20.240.253:44573
I20260808 04:44:56.936440 13326 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.240.253:44573 every 8 connection(s)
I20260808 04:44:56.937136 13252 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786164000593138-21443-0/minicluster-data/master-1/data/info.pb
I20260808 04:44:56.939878 21443 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu as pid 13252
I20260808 04:44:56.940023 21443 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786164000593138-21443-0/minicluster-data/master-1/wal/instance
I20260808 04:44:56.940235 13327 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:44:56.940358 21443 external_mini_cluster.cc:1428] Setting key 4395faffe0f9246908ac2facd6877810
I20260808 04:44:56.944641 13327 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.240.254" port: 42189 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.20.240.252@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.240.252@KRBTEST.COM" created.
Aug 08 04:44:56 dist-test-slave-vxj2 krb5kdc[13158](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164296, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.240.253@KRBTEST.COM for kudu/127.20.240.254@KRBTEST.COM
I20260808 04:44:56.957907 13244 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.240.253" port: 44573 } attempt: 3
I20260808 04:44:56.961474 13247 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:56.946700 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41158 (local address 127.20.240.254:42189)
0808 04:44:56.946882 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:56.946886 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:56.948055 (+ 1169us) server_negotiation.cc:407] Connection header received
0808 04:44:56.949187 (+ 1132us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:56.949191 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:56.949322 (+ 131us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:56.949435 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:44:56.950798 (+ 1363us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:56.951448 (+ 650us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:56.953441 (+ 1993us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:56.953865 (+ 424us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:56.954006 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:56.956560 (+ 2554us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:44:56.956567 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:44:56.956574 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:44:56.956610 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:44:56.958401 (+ 1791us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:44:56.959091 (+ 690us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:44:56.959094 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:44:56.959096 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:44:56.959186 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:44:56.959611 (+ 425us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:44:56.959615 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:44:56.959616 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:44:56.959854 (+ 238us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:44:56.959955 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0808 04:44:56.961175 (+ 1220us) server_negotiation.cc:299] Negotiation successful
0808 04:44:56.961305 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260808 04:44:56.962138 13330 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:56.947237 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:42189 (local address 127.0.0.1:41158)
0808 04:44:56.947881 (+ 644us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:56.947928 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0808 04:44:56.948941 (+ 1013us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:44:56.949648 (+ 707us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:44:56.949660 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:44:56.950087 (+ 427us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:44:56.950625 (+ 538us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:44:56.950639 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:44:56.951591 (+ 952us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:44:56.951599 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:44:56.953242 (+ 1643us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:44:56.953258 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:44:56.954067 (+ 809us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:44:56.954070 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:44:56.954243 (+ 173us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:56.954913 (+ 670us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:44:56.954934 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:44:56.956371 (+ 1437us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:44:56.958553 (+ 2182us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:44:56.958560 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:44:56.958577 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:44:56.958976 (+ 399us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:44:56.959294 (+ 318us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:44:56.959300 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:44:56.959304 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:44:56.959506 (+ 202us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:44:56.959956 (+ 450us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:44:56.959963 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:44:56.960214 (+ 251us) client_negotiation.cc:769] Sending connection context
0808 04:44:56.960407 (+ 193us) client_negotiation.cc:240] Negotiation successful
0808 04:44:56.961131 (+ 724us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":372,"mutex_wait_us":292,"thread_start_us":180,"threads_started":1}
I20260808 04:44:56.963686 13327 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.240.253" port: 44573 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 04:44:56 dist-test-slave-vxj2 krb5kdc[13158](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164296, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.240.254@KRBTEST.COM for kudu/127.20.240.253@KRBTEST.COM
Aug 08 04:44:56 dist-test-slave-vxj2 krb5kdc[13158](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164296, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.240.253@KRBTEST.COM for kudu/127.20.240.253@KRBTEST.COM
I20260808 04:44:56.969712 13246 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:56.958397 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.253:44573 (local address 127.0.0.1:34794)
0808 04:44:56.958598 (+ 201us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:56.958614 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 04:44:56.958700 (+ 86us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:44:56.959380 (+ 680us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:44:56.959382 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:44:56.959575 (+ 193us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:44:56.959705 (+ 130us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:44:56.959712 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:44:56.961203 (+ 1491us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:44:56.961207 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:44:56.961959 (+ 752us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:44:56.961969 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:44:56.962975 (+ 1006us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:44:56.962978 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:44:56.963112 (+ 134us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:56.963635 (+ 523us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:44:56.963646 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:44:56.965507 (+ 1861us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:44:56.967802 (+ 2295us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:44:56.967806 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:44:56.967808 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:44:56.968044 (+ 236us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:44:56.968440 (+ 396us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:44:56.968444 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:44:56.968446 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:44:56.968537 (+ 91us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:44:56.969133 (+ 596us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:44:56.969136 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:44:56.969282 (+ 146us) client_negotiation.cc:769] Sending connection context
0808 04:44:56.969384 (+ 102us) client_negotiation.cc:240] Negotiation successful
0808 04:44:56.969497 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":124}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.240.252 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.252.keytab.
Entry for principal kudu/127.20.240.252 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.252.keytab.
I20260808 04:44:56.970166 13332 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:56.958504 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34794 (local address 127.20.240.253:44573)
0808 04:44:56.958937 (+ 433us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:56.958947 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:56.958967 (+ 20us) server_negotiation.cc:407] Connection header received
0808 04:44:56.959003 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:56.959008 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:56.959249 (+ 241us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:56.959414 (+ 165us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:44:56.959829 (+ 415us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:56.961061 (+ 1232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:56.962078 (+ 1017us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:56.962841 (+ 763us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:56.963331 (+ 490us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:56.965622 (+ 2291us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:44:56.965630 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:44:56.965641 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:44:56.965661 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:44:56.967684 (+ 2023us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:44:56.968196 (+ 512us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:44:56.968208 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:44:56.968211 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:44:56.968313 (+ 102us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:44:56.968667 (+ 354us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:44:56.968670 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:44:56.968672 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:44:56.968983 (+ 311us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:44:56.969185 (+ 202us) server_negotiation.cc:1035] Waiting for connection context
0808 04:44:56.969506 (+ 321us) server_negotiation.cc:299] Negotiation successful
0808 04:44:56.969666 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":333,"thread_start_us":150,"threads_started":1}
I20260808 04:44:56.970930 21443 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
/tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786164000593138-21443-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786164000593138-21443-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786164000593138-21443-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786164000593138-21443-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.240.252:34811
--webserver_interface=127.20.240.252
--webserver_port=0
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.252.keytab
--principal=kudu/127.20.240.252
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.240.212:34135
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.240.254:42189,127.20.240.253:44573,127.20.240.252:34811
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786164000593138-21443-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786164000593138-21443-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786164000593138-21443-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 04:44:56.972550 13244 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.240.252" port: 34811 } has no permanent_uuid. Determining permanent_uuid...
I20260808 04:44:56.973553 13246 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:56.973206 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.252:34811 (local address 127.0.0.1:53888)
0808 04:44:56.973409 (+ 203us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:56.973454 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.240.252:34811: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":129}
I20260808 04:44:56.973956 13330 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:56.964263 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.253:44573 (local address 127.0.0.1:34802)
0808 04:44:56.964382 (+ 119us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:56.964399 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 04:44:56.964474 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:44:56.964974 (+ 500us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:44:56.964976 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:44:56.965132 (+ 156us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:44:56.965277 (+ 145us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:44:56.965285 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:44:56.966401 (+ 1116us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:44:56.966406 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:44:56.967093 (+ 687us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:44:56.967102 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:44:56.967694 (+ 592us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:44:56.967697 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:44:56.967814 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:56.968328 (+ 514us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:44:56.968340 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:44:56.969906 (+ 1566us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:44:56.972085 (+ 2179us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:44:56.972088 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:44:56.972090 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:44:56.972360 (+ 270us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:44:56.972684 (+ 324us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:44:56.972687 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:44:56.972689 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:44:56.972791 (+ 102us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:44:56.973276 (+ 485us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:44:56.973281 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:44:56.973390 (+ 109us) client_negotiation.cc:769] Sending connection context
0808 04:44:56.973511 (+ 121us) client_negotiation.cc:240] Negotiation successful
0808 04:44:56.973676 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":43,"mutex_wait_us":2}
I20260808 04:44:56.973996 13333 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:56.964441 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34802 (local address 127.20.240.253:44573)
0808 04:44:56.964746 (+ 305us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:56.964756 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:56.964772 (+ 16us) server_negotiation.cc:407] Connection header received
0808 04:44:56.964812 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:56.964814 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:56.964855 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:56.964951 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:44:56.965410 (+ 459us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:56.966228 (+ 818us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:56.967211 (+ 983us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:56.967578 (+ 367us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:56.967690 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:56.970235 (+ 2545us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:44:56.970239 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:44:56.970242 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:44:56.970271 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:44:56.971969 (+ 1698us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:44:56.972475 (+ 506us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:44:56.972479 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:44:56.972481 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:44:56.972565 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:44:56.972892 (+ 327us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:44:56.972895 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:44:56.972896 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:44:56.973136 (+ 240us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:44:56.973292 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0808 04:44:56.973589 (+ 297us) server_negotiation.cc:299] Negotiation successful
0808 04:44:56.973766 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":49,"server-negotiator.queue_time_us":228,"thread_start_us":100,"threads_started":1}
I20260808 04:44:56.974612 13335 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:56.974071 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.252:34811 (local address 127.0.0.1:53890)
0808 04:44:56.974444 (+ 373us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:56.974502 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.240.252:34811: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":297,"thread_start_us":132,"threads_started":1}
I20260808 04:44:56.974965 13327 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.240.252" port: 34811 } has no permanent_uuid. Determining permanent_uuid...
W20260808 04:44:56.975183 13244 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.240.252:34811: Network error: Client connection negotiation failed: client connection to 127.20.240.252:34811: connect: Connection refused (error 111)
I20260808 04:44:56.975699 13330 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:56.975385 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.252:34811 (local address 127.0.0.1:53900)
0808 04:44:56.975525 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:56.975620 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.240.252:34811: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
W20260808 04:44:56.975983 13272 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.20.240.252:34811: connect: Connection refused (error 111)
I20260808 04:44:56.976935 13330 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:56.976652 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.252:34811 (local address 127.0.0.1:53914)
0808 04:44:56.976788 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:56.976855 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.240.252:34811: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
W20260808 04:44:56.977114 13327 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.240.252:34811: Network error: Client connection negotiation failed: client connection to 127.20.240.252:34811: connect: Connection refused (error 111)
I20260808 04:44:57.006381 13244 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.240.252" port: 34811 } attempt: 1
I20260808 04:44:57.007432 13246 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:57.007072 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.252:34811 (local address 127.0.0.1:53930)
0808 04:44:57.007266 (+ 194us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:57.007337 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.240.252:34811: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":68}
I20260808 04:44:57.008286 13246 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:57.008043 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.252:34811 (local address 127.0.0.1:53944)
0808 04:44:57.008157 (+ 114us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:57.008213 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.240.252:34811: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
W20260808 04:44:57.008463 13244 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.240.252:34811: Network error: Client connection negotiation failed: client connection to 127.20.240.252:34811: connect: Connection refused (error 111)
I20260808 04:44:57.026494 13327 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.240.252" port: 34811 } attempt: 1
I20260808 04:44:57.027513 13330 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:57.027144 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.252:34811 (local address 127.0.0.1:53946)
0808 04:44:57.027335 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:57.027416 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.240.252:34811: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":75}
I20260808 04:44:57.028344 13330 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:57.028106 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.252:34811 (local address 127.0.0.1:53960)
0808 04:44:57.028212 (+ 106us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:57.028266 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.240.252:34811: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
W20260808 04:44:57.028522 13327 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.240.252:34811: Network error: Client connection negotiation failed: client connection to 127.20.240.252:34811: connect: Connection refused (error 111)
I20260808 04:44:57.083690 13244 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.240.252" port: 34811 } attempt: 2
I20260808 04:44:57.084924 13246 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:57.084448 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.252:34811 (local address 127.0.0.1:53974)
0808 04:44:57.084674 (+ 226us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:57.084800 (+ 126us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.240.252:34811: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
I20260808 04:44:57.085845 13246 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:57.085571 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.252:34811 (local address 127.0.0.1:53990)
0808 04:44:57.085731 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:57.085783 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.240.252:34811: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":85}
W20260808 04:44:57.086057 13244 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.240.252:34811: Network error: Client connection negotiation failed: client connection to 127.20.240.252:34811: connect: Connection refused (error 111)
W20260808 04:44:57.090514 13334 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260808 04:44:57.090781 13334 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:44:57.090862 13334 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:44:57.090927 13334 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:44:57.095127 13334 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 04:44:57.095197 13334 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:44:57.095217 13334 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:44:57.095235 13334 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 04:44:57.095250 13334 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 04:44:57.096740 13327 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.240.252" port: 34811 } attempt: 2
I20260808 04:44:57.097716 13330 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:57.097368 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.252:34811 (local address 127.0.0.1:54004)
0808 04:44:57.097526 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:57.097599 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.240.252:34811: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
I20260808 04:44:57.098484 13330 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:57.098255 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.252:34811 (local address 127.0.0.1:54014)
0808 04:44:57.098368 (+ 113us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:57.098420 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.240.252:34811: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
W20260808 04:44:57.098634 13327 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.240.252:34811: Network error: Client connection negotiation failed: client connection to 127.20.240.252:34811: connect: Connection refused (error 111)
I20260808 04:44:57.101430 13334 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.240.212:34135
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786164000593138-21443-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786164000593138-21443-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.20.240.254:42189,127.20.240.253:44573,127.20.240.252:34811
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.252.keytab
--principal=kudu/127.20.240.252
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.240.252:34811
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786164000593138-21443-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.20.240.252
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13334
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786164000593138-21443-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 04:05:18 UTC on ccycloud.quasar-drfdgt.root.comops.site
build id 4574101
I20260808 04:44:57.102576 13334 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:44:57.103585 13334 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:44:57.112454 13346 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:44:57.112463 13342 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:44:57.112528 13343 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:44:57.112761 13334 server_base.cc:1034] running on GCE node
I20260808 04:44:57.113461 13334 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:44:57.114625 13334 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:44:57.115792 13334 hybrid_clock.cc:648] HybridClock initialized: now 1786164297115777 us; error 30 us; skew 500 ppm
Aug 08 04:44:57 dist-test-slave-vxj2 krb5kdc[13158](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164297, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.240.252@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:44:57.118919 13334 init.cc:377] Logged in from keytab as kudu/127.20.240.252@KRBTEST.COM (short username kudu)
I20260808 04:44:57.119833 13334 webserver.cc:460] Webserver started at http://127.20.240.252:36163/ using document root <none> and password file <none>
I20260808 04:44:57.120370 13334 fs_manager.cc:359] Metadata directory not provided
I20260808 04:44:57.120430 13334 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:44:57.120605 13334 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 04:44:57.122740 13334 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786164000593138-21443-0/minicluster-data/master-2/data/instance:
uuid: "66d8b8f45c31475c905cf421e90054fb"
format_stamp: "Formatted at 2026-08-08 04:44:57 on dist-test-slave-vxj2"
server_key: "c87cf7484581050d45fad1731f981b69"
server_key_iv: "44d858e123cf4f03c133b0940158f1ce"
server_key_version: "encryptionkey@0"
I20260808 04:44:57.123296 13334 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786164000593138-21443-0/minicluster-data/master-2/wal/instance:
uuid: "66d8b8f45c31475c905cf421e90054fb"
format_stamp: "Formatted at 2026-08-08 04:44:57 on dist-test-slave-vxj2"
server_key: "c87cf7484581050d45fad1731f981b69"
server_key_iv: "44d858e123cf4f03c133b0940158f1ce"
server_key_version: "encryptionkey@0"
I20260808 04:44:57.127246 13334 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260808 04:44:57.129693 13354 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:44:57.130956 13334 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 04:44:57.131095 13334 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786164000593138-21443-0/minicluster-data/master-2/data,/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786164000593138-21443-0/minicluster-data/master-2/wal
uuid: "66d8b8f45c31475c905cf421e90054fb"
format_stamp: "Formatted at 2026-08-08 04:44:57 on dist-test-slave-vxj2"
server_key: "c87cf7484581050d45fad1731f981b69"
server_key_iv: "44d858e123cf4f03c133b0940158f1ce"
server_key_version: "encryptionkey@0"
I20260808 04:44:57.131206 13334 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786164000593138-21443-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786164000593138-21443-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786164000593138-21443-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:44:57.149202 13334 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:44:57.152442 13334 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:44:57.152661 13334 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:44:57.159739 13334 rpc_server.cc:307] RPC server started. Bound to: 127.20.240.252:34811
I20260808 04:44:57.160079 13414 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.240.252:34811 every 8 connection(s)
I20260808 04:44:57.160773 13334 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786164000593138-21443-0/minicluster-data/master-2/data/info.pb
I20260808 04:44:57.163678 13415 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:44:57.167979 13415 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.240.254" port: 42189 } has no permanent_uuid. Determining permanent_uuid...
I20260808 04:44:57.169361 21443 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu as pid 13334
I20260808 04:44:57.169508 21443 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786164000593138-21443-0/minicluster-data/master-2/wal/instance
I20260808 04:44:57.169823 21443 external_mini_cluster.cc:1428] Setting key e256dd626fab2f276fd0fb5935b23143
Aug 08 04:44:57 dist-test-slave-vxj2 krb5kdc[13158](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164297, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.240.252@KRBTEST.COM for kudu/127.20.240.254@KRBTEST.COM
Aug 08 04:44:57 dist-test-slave-vxj2 krb5kdc[13158](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164296, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.240.252@KRBTEST.COM
I20260808 04:44:57.182025 13247 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:57.170090 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41160 (local address 127.20.240.254:42189)
0808 04:44:57.170250 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:57.170255 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:57.171266 (+ 1011us) server_negotiation.cc:407] Connection header received
0808 04:44:57.172234 (+ 968us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:57.172237 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:57.172295 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:57.172395 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:44:57.173280 (+ 885us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:57.173787 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:57.174787 (+ 1000us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:57.175018 (+ 231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:57.175129 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:57.177834 (+ 2705us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:44:57.177838 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:44:57.177841 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:44:57.177874 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:44:57.179734 (+ 1860us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:44:57.180343 (+ 609us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:44:57.180347 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:44:57.180350 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:44:57.180439 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:44:57.180792 (+ 353us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:44:57.180796 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:44:57.180798 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:44:57.180991 (+ 193us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:44:57.181099 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0808 04:44:57.181665 (+ 566us) server_negotiation.cc:299] Negotiation successful
0808 04:44:57.181848 (+ 183us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260808 04:44:57.182843 13419 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:57.170578 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:42189 (local address 127.0.0.1:41160)
0808 04:44:57.171119 (+ 541us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:57.171166 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0808 04:44:57.172034 (+ 868us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:44:57.172447 (+ 413us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:44:57.172453 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:44:57.172811 (+ 358us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:44:57.173088 (+ 277us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:44:57.173101 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:44:57.173908 (+ 807us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:44:57.173913 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:44:57.174663 (+ 750us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:44:57.174671 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:44:57.175171 (+ 500us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:44:57.175176 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:44:57.175384 (+ 208us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:57.176040 (+ 656us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:44:57.176066 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:44:57.177662 (+ 1596us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:44:57.179856 (+ 2194us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:44:57.179865 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:44:57.179874 (+ 9us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:44:57.180207 (+ 333us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:44:57.180536 (+ 329us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:44:57.180540 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:44:57.180542 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:44:57.180685 (+ 143us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:44:57.181097 (+ 412us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:44:57.181104 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:44:57.181416 (+ 312us) client_negotiation.cc:769] Sending connection context
0808 04:44:57.181606 (+ 190us) client_negotiation.cc:240] Negotiation successful
0808 04:44:57.181942 (+ 336us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":352,"mutex_wait_us":1,"thread_start_us":193,"threads_started":1}
I20260808 04:44:57.182847 13418 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:57.170592 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54020 (local address 127.20.240.252:34811)
0808 04:44:57.171304 (+ 712us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:57.171315 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:57.171354 (+ 39us) server_negotiation.cc:407] Connection header received
0808 04:44:57.172046 (+ 692us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:57.172071 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:57.172264 (+ 193us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:57.172466 (+ 202us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:44:57.173350 (+ 884us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:57.174241 (+ 891us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:57.175110 (+ 869us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:57.175531 (+ 421us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:57.175643 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:57.178295 (+ 2652us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:44:57.178301 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:44:57.178336 (+ 35us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:44:57.178364 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:44:57.180370 (+ 2006us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:44:57.180806 (+ 436us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:44:57.180812 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:44:57.180814 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:44:57.180897 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:44:57.181200 (+ 303us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:44:57.181204 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:44:57.181206 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:44:57.181479 (+ 273us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:44:57.181687 (+ 208us) server_negotiation.cc:1035] Waiting for connection context
0808 04:44:57.181899 (+ 212us) server_negotiation.cc:299] Negotiation successful
0808 04:44:57.182043 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":46,"server-negotiator.queue_time_us":615,"thread_start_us":153,"threads_started":1}
I20260808 04:44:57.184118 13415 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.240.253" port: 44573 } has no permanent_uuid. Determining permanent_uuid...
I20260808 04:44:57.185201 13244 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.240.252" port: 34811 } attempt: 3
Aug 08 04:44:57 dist-test-slave-vxj2 krb5kdc[13158](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164297, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.240.252@KRBTEST.COM for kudu/127.20.240.253@KRBTEST.COM
Aug 08 04:44:57 dist-test-slave-vxj2 krb5kdc[13158](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164296, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.240.254@KRBTEST.COM for kudu/127.20.240.252@KRBTEST.COM
I20260808 04:44:57.190297 13327 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.240.252" port: 34811 } attempt: 3
Aug 08 04:44:57 dist-test-slave-vxj2 krb5kdc[13158](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164296, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.240.254@KRBTEST.COM
I20260808 04:44:57.194269 13246 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:57.185585 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.252:34811 (local address 127.0.0.1:54026)
0808 04:44:57.185754 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:57.185771 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 04:44:57.185865 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:44:57.186111 (+ 246us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:44:57.186114 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:44:57.186283 (+ 169us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:44:57.186366 (+ 83us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:44:57.186372 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:44:57.187227 (+ 855us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:44:57.187231 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:44:57.187955 (+ 724us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:44:57.187965 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:44:57.188581 (+ 616us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:44:57.188588 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:44:57.188686 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:57.189131 (+ 445us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:44:57.189176 (+ 45us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:44:57.190552 (+ 1376us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:44:57.192503 (+ 1951us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:44:57.192507 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:44:57.192510 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:44:57.192780 (+ 270us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:44:57.193080 (+ 300us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:44:57.193083 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:44:57.193085 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:44:57.193207 (+ 122us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:44:57.193713 (+ 506us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:44:57.193717 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:44:57.193833 (+ 116us) client_negotiation.cc:769] Sending connection context
0808 04:44:57.193951 (+ 118us) client_negotiation.cc:240] Negotiation successful
0808 04:44:57.194096 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":96}
I20260808 04:44:57.194379 13418 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:57.185675 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54026 (local address 127.20.240.252:34811)
0808 04:44:57.185777 (+ 102us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:57.185781 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:57.185815 (+ 34us) server_negotiation.cc:407] Connection header received
0808 04:44:57.185956 (+ 141us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:57.185961 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:57.185999 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:57.186079 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:44:57.186618 (+ 539us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:57.187116 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:57.188087 (+ 971us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:57.188452 (+ 365us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:57.188557 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:57.190699 (+ 2142us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:44:57.190702 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:44:57.190708 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:44:57.190737 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:44:57.192355 (+ 1618us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:44:57.192875 (+ 520us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:44:57.192878 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:44:57.192880 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:44:57.192966 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:44:57.193336 (+ 370us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:44:57.193339 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:44:57.193341 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:44:57.193549 (+ 208us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:44:57.193658 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0808 04:44:57.194115 (+ 457us) server_negotiation.cc:299] Negotiation successful
0808 04:44:57.194220 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260808 04:44:57.196102 13333 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:57.184781 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34818 (local address 127.20.240.253:44573)
0808 04:44:57.184919 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:57.184924 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:57.184939 (+ 15us) server_negotiation.cc:407] Connection header received
0808 04:44:57.185063 (+ 124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:57.185066 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:57.185122 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:57.185229 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:44:57.185819 (+ 590us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:57.186625 (+ 806us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:57.187681 (+ 1056us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:57.187936 (+ 255us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:57.188046 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:57.190958 (+ 2912us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:44:57.190962 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:44:57.190965 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:44:57.190992 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:44:57.192702 (+ 1710us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:44:57.193493 (+ 791us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:44:57.193497 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:44:57.193499 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:44:57.193610 (+ 111us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:44:57.193975 (+ 365us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:44:57.193981 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:44:57.193983 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:44:57.194196 (+ 213us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:44:57.194267 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0808 04:44:57.195772 (+ 1505us) server_negotiation.cc:299] Negotiation successful
0808 04:44:57.195924 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260808 04:44:57.197129 13419 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:57.184622 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.253:44573 (local address 127.0.0.1:34818)
0808 04:44:57.184850 (+ 228us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:57.184869 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0808 04:44:57.184961 (+ 92us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:44:57.185371 (+ 410us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:44:57.185374 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:44:57.185556 (+ 182us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:44:57.185673 (+ 117us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:44:57.185683 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:44:57.186756 (+ 1073us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:44:57.186759 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:44:57.187569 (+ 810us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:44:57.187584 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:44:57.188043 (+ 459us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:44:57.188047 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:44:57.188149 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:57.188621 (+ 472us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:44:57.188635 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:44:57.190795 (+ 2160us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:44:57.192819 (+ 2024us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:44:57.192824 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:44:57.192827 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:44:57.193091 (+ 264us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:44:57.193749 (+ 658us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:44:57.193752 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:44:57.193753 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:44:57.193855 (+ 102us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:44:57.195459 (+ 1604us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:44:57.195462 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:44:57.195570 (+ 108us) client_negotiation.cc:769] Sending connection context
0808 04:44:57.196817 (+ 1247us) client_negotiation.cc:240] Negotiation successful
0808 04:44:57.196968 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":112,"mutex_wait_us":1}
I20260808 04:44:57.197255 13247 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:57.185235 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41172 (local address 127.20.240.254:42189)
0808 04:44:57.185349 (+ 114us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:57.185353 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:57.185680 (+ 327us) server_negotiation.cc:407] Connection header received
0808 04:44:57.185722 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:57.185725 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:57.185768 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:57.185855 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:44:57.186656 (+ 801us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:57.187410 (+ 754us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:57.188823 (+ 1413us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:57.189224 (+ 401us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:57.189347 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:57.192167 (+ 2820us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:44:57.192173 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:44:57.192179 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:44:57.192206 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:44:57.194711 (+ 2505us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:44:57.195372 (+ 661us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:44:57.195376 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:44:57.195377 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:44:57.195468 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:44:57.195789 (+ 321us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:44:57.195795 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:44:57.195796 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:44:57.195998 (+ 202us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:44:57.196226 (+ 228us) server_negotiation.cc:1035] Waiting for connection context
0808 04:44:57.196967 (+ 741us) server_negotiation.cc:299] Negotiation successful
0808 04:44:57.197074 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
Aug 08 04:44:57 dist-test-slave-vxj2 krb5kdc[13158](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164296, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.240.253@KRBTEST.COM for kudu/127.20.240.252@KRBTEST.COM
I20260808 04:44:57.198190 13415 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.240.252" port: 34811 } has no permanent_uuid. Determining permanent_uuid...
I20260808 04:44:57.198364 13244 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a93f9acc99fc45509edfbfd94e11dc20: Bootstrap starting.
I20260808 04:44:57.201634 13244 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a93f9acc99fc45509edfbfd94e11dc20: Neither blocks nor log segments found. Creating new log.
I20260808 04:44:57.201876 13330 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:57.190722 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.252:34811 (local address 127.0.0.1:54036)
0808 04:44:57.191723 (+ 1001us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:57.191741 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0808 04:44:57.192334 (+ 593us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:44:57.192898 (+ 564us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:44:57.192901 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:44:57.193080 (+ 179us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:44:57.193212 (+ 132us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:44:57.193224 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:44:57.194750 (+ 1526us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:44:57.194754 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:44:57.195373 (+ 619us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:44:57.195381 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:44:57.195994 (+ 613us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:44:57.195998 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:44:57.196087 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:57.196528 (+ 441us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:44:57.196541 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:44:57.198062 (+ 1521us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:44:57.200138 (+ 2076us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:44:57.200142 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:44:57.200144 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:44:57.200408 (+ 264us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:44:57.200702 (+ 294us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:44:57.200706 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:44:57.200708 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:44:57.200803 (+ 95us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:44:57.201247 (+ 444us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:44:57.201250 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:44:57.201382 (+ 132us) client_negotiation.cc:769] Sending connection context
0808 04:44:57.201548 (+ 166us) client_negotiation.cc:240] Negotiation successful
0808 04:44:57.201708 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":195}
I20260808 04:44:57.202473 13421 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:57.191249 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54036 (local address 127.20.240.252:34811)
0808 04:44:57.192655 (+ 1406us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:57.192663 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:57.192674 (+ 11us) server_negotiation.cc:407] Connection header received
0808 04:44:57.192706 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:57.192708 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:57.192754 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:57.193325 (+ 571us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:44:57.193421 (+ 96us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:57.194614 (+ 1193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:57.195522 (+ 908us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:57.195853 (+ 331us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:57.196293 (+ 440us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:57.198188 (+ 1895us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:44:57.198192 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:44:57.198194 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:44:57.198222 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:44:57.200015 (+ 1793us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:44:57.200502 (+ 487us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:44:57.200505 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:44:57.200507 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:44:57.200595 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:44:57.200901 (+ 306us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:44:57.200905 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:44:57.200906 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:44:57.201108 (+ 202us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:44:57.201259 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0808 04:44:57.201612 (+ 353us) server_negotiation.cc:299] Negotiation successful
0808 04:44:57.201743 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1320,"thread_start_us":136,"threads_started":1}
I20260808 04:44:57.202634 13244 log.cc:824] T 00000000000000000000000000000000 P a93f9acc99fc45509edfbfd94e11dc20: Log is configured to *not* fsync() on all Append() calls
Aug 08 04:44:57 dist-test-slave-vxj2 krb5kdc[13158](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164297, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.240.252@KRBTEST.COM for kudu/127.20.240.252@KRBTEST.COM
I20260808 04:44:57.205626 13327 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e04b0ee76efd45d4b24bd7429b3efee1: Bootstrap starting.
I20260808 04:44:57.205873 13244 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a93f9acc99fc45509edfbfd94e11dc20: No bootstrap required, opened a new log
I20260808 04:44:57.207760 13419 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:57.198692 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.252:34811 (local address 127.0.0.1:54042)
0808 04:44:57.198813 (+ 121us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:57.198830 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 04:44:57.198912 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:44:57.199200 (+ 288us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:44:57.199203 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:44:57.199394 (+ 191us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:44:57.199472 (+ 78us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:44:57.199478 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:44:57.200394 (+ 916us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:44:57.200400 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:44:57.201120 (+ 720us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:44:57.201129 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:44:57.201712 (+ 583us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:44:57.201716 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:44:57.201787 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:57.202366 (+ 579us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:44:57.202380 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:44:57.204150 (+ 1770us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:44:57.206234 (+ 2084us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:44:57.206237 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:44:57.206239 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:44:57.206504 (+ 265us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:44:57.206769 (+ 265us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:44:57.206771 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:44:57.206773 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:44:57.206850 (+ 77us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:44:57.207265 (+ 415us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:44:57.207268 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:44:57.207355 (+ 87us) client_negotiation.cc:769] Sending connection context
0808 04:44:57.207450 (+ 95us) client_negotiation.cc:240] Negotiation successful
0808 04:44:57.207588 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":31}
I20260808 04:44:57.208177 13327 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e04b0ee76efd45d4b24bd7429b3efee1: Neither blocks nor log segments found. Creating new log.
I20260808 04:44:57.208395 13418 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:57.198871 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54042 (local address 127.20.240.252:34811)
0808 04:44:57.198954 (+ 83us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:57.198958 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:57.198970 (+ 12us) server_negotiation.cc:407] Connection header received
0808 04:44:57.199003 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:57.199006 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:57.199043 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:57.199116 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:44:57.199600 (+ 484us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:57.200300 (+ 700us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:57.201263 (+ 963us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:57.201500 (+ 237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:57.201588 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:57.204284 (+ 2696us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:44:57.204288 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:44:57.204290 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:44:57.204314 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:44:57.206033 (+ 1719us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:44:57.206606 (+ 573us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:44:57.206608 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:44:57.206610 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:44:57.206685 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:44:57.206938 (+ 253us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:44:57.206941 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:44:57.206942 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:44:57.207148 (+ 206us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:44:57.207235 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0808 04:44:57.208120 (+ 885us) server_negotiation.cc:299] Negotiation successful
0808 04:44:57.208238 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260808 04:44:57.209560 13327 log.cc:824] T 00000000000000000000000000000000 P e04b0ee76efd45d4b24bd7429b3efee1: Log is configured to *not* fsync() on all Append() calls
I20260808 04:44:57.210583 13244 raft_consensus.cc:348] T 00000000000000000000000000000000 P a93f9acc99fc45509edfbfd94e11dc20 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a93f9acc99fc45509edfbfd94e11dc20" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 42189 } } peers { permanent_uuid: "e04b0ee76efd45d4b24bd7429b3efee1" member_type: VOTER last_known_addr { host: "127.20.240.253" port: 44573 } } peers { permanent_uuid: "66d8b8f45c31475c905cf421e90054fb" member_type: VOTER last_known_addr { host: "127.20.240.252" port: 34811 } }
I20260808 04:44:57.210834 13244 raft_consensus.cc:729] T 00000000000000000000000000000000 P a93f9acc99fc45509edfbfd94e11dc20 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a93f9acc99fc45509edfbfd94e11dc20, State: Initialized, Role: FOLLOWER
I20260808 04:44:57.211166 13244 consensus_queue.cc:260] T 00000000000000000000000000000000 P a93f9acc99fc45509edfbfd94e11dc20 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a93f9acc99fc45509edfbfd94e11dc20" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 42189 } } peers { permanent_uuid: "e04b0ee76efd45d4b24bd7429b3efee1" member_type: VOTER last_known_addr { host: "127.20.240.253" port: 44573 } } peers { permanent_uuid: "66d8b8f45c31475c905cf421e90054fb" member_type: VOTER last_known_addr { host: "127.20.240.252" port: 34811 } }
I20260808 04:44:57.211684 13424 sys_catalog.cc:455] T 00000000000000000000000000000000 P a93f9acc99fc45509edfbfd94e11dc20 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a93f9acc99fc45509edfbfd94e11dc20" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 42189 } } peers { permanent_uuid: "e04b0ee76efd45d4b24bd7429b3efee1" member_type: VOTER last_known_addr { host: "127.20.240.253" port: 44573 } } peers { permanent_uuid: "66d8b8f45c31475c905cf421e90054fb" member_type: VOTER last_known_addr { host: "127.20.240.252" port: 34811 } } }
I20260808 04:44:57.211994 13424 sys_catalog.cc:458] T 00000000000000000000000000000000 P a93f9acc99fc45509edfbfd94e11dc20 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 04:44:57.212586 13244 sys_catalog.cc:564] T 00000000000000000000000000000000 P a93f9acc99fc45509edfbfd94e11dc20 [sys.catalog]: configured and running, proceeding with master startup.
Aug 08 04:44:57 dist-test-slave-vxj2 krb5kdc[13158](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164296, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.240.253@KRBTEST.COM
I20260808 04:44:57.216116 13415 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 66d8b8f45c31475c905cf421e90054fb: Bootstrap starting.
W20260808 04:44:57.218107 13436 catalog_manager.cc:1558] T 00000000000000000000000000000000 P a93f9acc99fc45509edfbfd94e11dc20: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 04:44:57.218276 13436 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 04:44:57.219518 13415 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 66d8b8f45c31475c905cf421e90054fb: Neither blocks nor log segments found. Creating new log.
I20260808 04:44:57.220467 13415 log.cc:824] T 00000000000000000000000000000000 P 66d8b8f45c31475c905cf421e90054fb: Log is configured to *not* fsync() on all Append() calls
I20260808 04:44:57.217669 13171 master_runner.cc:186] Error getting master registration for 127.20.240.253:44573: OK, instance_id { permanent_uuid: "e04b0ee76efd45d4b24bd7429b3efee1" instance_seqno: 1786164296934111 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260808 04:44:57.220945 13333 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:57.209082 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34822 (local address 127.20.240.253:44573)
0808 04:44:57.209319 (+ 237us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:57.209331 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:57.209346 (+ 15us) server_negotiation.cc:407] Connection header received
0808 04:44:57.209387 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:57.209390 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:57.209435 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:57.209513 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:44:57.210501 (+ 988us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:57.211484 (+ 983us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:57.212699 (+ 1215us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:57.213053 (+ 354us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:57.213138 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:57.216645 (+ 3507us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:44:57.216650 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:44:57.216653 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:44:57.216684 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:44:57.218504 (+ 1820us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:44:57.219033 (+ 529us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:44:57.219036 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:44:57.219038 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:44:57.219127 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:44:57.219460 (+ 333us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:44:57.219463 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:44:57.219465 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:44:57.219721 (+ 256us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:44:57.219935 (+ 214us) server_negotiation.cc:1035] Waiting for connection context
0808 04:44:57.220603 (+ 668us) server_negotiation.cc:299] Negotiation successful
0808 04:44:57.220730 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":143}
I20260808 04:44:57.220950 13171 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260808 04:44:57.222878 13327 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e04b0ee76efd45d4b24bd7429b3efee1: No bootstrap required, opened a new log
I20260808 04:44:57.222918 13415 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 66d8b8f45c31475c905cf421e90054fb: No bootstrap required, opened a new log
I20260808 04:44:57.224246 21443 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 04:44:57.225745 13214 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "a93f9acc99fc45509edfbfd94e11dc20"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41172
I20260808 04:44:57.226090 13214 raft_consensus.cc:482] T 00000000000000000000000000000000 P a93f9acc99fc45509edfbfd94e11dc20 [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260808 04:44:57.226219 13214 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a93f9acc99fc45509edfbfd94e11dc20 [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:44:57.227099 13415 raft_consensus.cc:348] T 00000000000000000000000000000000 P 66d8b8f45c31475c905cf421e90054fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a93f9acc99fc45509edfbfd94e11dc20" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 42189 } } peers { permanent_uuid: "e04b0ee76efd45d4b24bd7429b3efee1" member_type: VOTER last_known_addr { host: "127.20.240.253" port: 44573 } } peers { permanent_uuid: "66d8b8f45c31475c905cf421e90054fb" member_type: VOTER last_known_addr { host: "127.20.240.252" port: 34811 } }
I20260808 04:44:57.227200 13327 raft_consensus.cc:348] T 00000000000000000000000000000000 P e04b0ee76efd45d4b24bd7429b3efee1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a93f9acc99fc45509edfbfd94e11dc20" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 42189 } } peers { permanent_uuid: "e04b0ee76efd45d4b24bd7429b3efee1" member_type: VOTER last_known_addr { host: "127.20.240.253" port: 44573 } } peers { permanent_uuid: "66d8b8f45c31475c905cf421e90054fb" member_type: VOTER last_known_addr { host: "127.20.240.252" port: 34811 } }
I20260808 04:44:57.227365 13415 raft_consensus.cc:729] T 00000000000000000000000000000000 P 66d8b8f45c31475c905cf421e90054fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66d8b8f45c31475c905cf421e90054fb, State: Initialized, Role: FOLLOWER
I20260808 04:44:57.227422 13327 raft_consensus.cc:729] T 00000000000000000000000000000000 P e04b0ee76efd45d4b24bd7429b3efee1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e04b0ee76efd45d4b24bd7429b3efee1, State: Initialized, Role: FOLLOWER
I20260808 04:44:57.227689 13214 raft_consensus.cc:504] T 00000000000000000000000000000000 P a93f9acc99fc45509edfbfd94e11dc20 [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a93f9acc99fc45509edfbfd94e11dc20" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 42189 } } peers { permanent_uuid: "e04b0ee76efd45d4b24bd7429b3efee1" member_type: VOTER last_known_addr { host: "127.20.240.253" port: 44573 } } peers { permanent_uuid: "66d8b8f45c31475c905cf421e90054fb" member_type: VOTER last_known_addr { host: "127.20.240.252" port: 34811 } }
I20260808 04:44:57.227757 13415 consensus_queue.cc:260] T 00000000000000000000000000000000 P 66d8b8f45c31475c905cf421e90054fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a93f9acc99fc45509edfbfd94e11dc20" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 42189 } } peers { permanent_uuid: "e04b0ee76efd45d4b24bd7429b3efee1" member_type: VOTER last_known_addr { host: "127.20.240.253" port: 44573 } } peers { permanent_uuid: "66d8b8f45c31475c905cf421e90054fb" member_type: VOTER last_known_addr { host: "127.20.240.252" port: 34811 } }
I20260808 04:44:57.227790 13327 consensus_queue.cc:260] T 00000000000000000000000000000000 P e04b0ee76efd45d4b24bd7429b3efee1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a93f9acc99fc45509edfbfd94e11dc20" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 42189 } } peers { permanent_uuid: "e04b0ee76efd45d4b24bd7429b3efee1" member_type: VOTER last_known_addr { host: "127.20.240.253" port: 44573 } } peers { permanent_uuid: "66d8b8f45c31475c905cf421e90054fb" member_type: VOTER last_known_addr { host: "127.20.240.252" port: 34811 } }
I20260808 04:44:57.229274 13327 sys_catalog.cc:564] T 00000000000000000000000000000000 P e04b0ee76efd45d4b24bd7429b3efee1 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 04:44:57.229286 13214 leader_election.cc:288] T 00000000000000000000000000000000 P a93f9acc99fc45509edfbfd94e11dc20 [CANDIDATE]: Term 1 election: Requested vote from peers e04b0ee76efd45d4b24bd7429b3efee1 (127.20.240.253:44573), 66d8b8f45c31475c905cf421e90054fb (127.20.240.252:34811)
I20260808 04:44:57.229595 13415 sys_catalog.cc:564] T 00000000000000000000000000000000 P 66d8b8f45c31475c905cf421e90054fb [sys.catalog]: configured and running, proceeding with master startup.
I20260808 04:44:57.229564 13298 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a93f9acc99fc45509edfbfd94e11dc20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "e04b0ee76efd45d4b24bd7429b3efee1"
I20260808 04:44:57.229668 13386 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a93f9acc99fc45509edfbfd94e11dc20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "66d8b8f45c31475c905cf421e90054fb"
I20260808 04:44:57.229801 13298 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e04b0ee76efd45d4b24bd7429b3efee1 [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:44:57.229907 13386 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 66d8b8f45c31475c905cf421e90054fb [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:44:57.231341 13386 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 66d8b8f45c31475c905cf421e90054fb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a93f9acc99fc45509edfbfd94e11dc20 in term 1.
I20260808 04:44:57.231356 13298 raft_consensus.cc:2454] T 00000000000000000000000000000000 P e04b0ee76efd45d4b24bd7429b3efee1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a93f9acc99fc45509edfbfd94e11dc20 in term 1.
I20260808 04:44:57.231813 13189 leader_election.cc:302] T 00000000000000000000000000000000 P a93f9acc99fc45509edfbfd94e11dc20 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66d8b8f45c31475c905cf421e90054fb, a93f9acc99fc45509edfbfd94e11dc20; no voters:
I20260808 04:44:57.232185 13424 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a93f9acc99fc45509edfbfd94e11dc20 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 04:44:57.232441 13424 raft_consensus.cc:686] T 00000000000000000000000000000000 P a93f9acc99fc45509edfbfd94e11dc20 [term 1 LEADER]: Becoming Leader. State: Replica: a93f9acc99fc45509edfbfd94e11dc20, State: Running, Role: LEADER
I20260808 04:44:57.232795 13424 consensus_queue.cc:237] T 00000000000000000000000000000000 P a93f9acc99fc45509edfbfd94e11dc20 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a93f9acc99fc45509edfbfd94e11dc20" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 42189 } } peers { permanent_uuid: "e04b0ee76efd45d4b24bd7429b3efee1" member_type: VOTER last_known_addr { host: "127.20.240.253" port: 44573 } } peers { permanent_uuid: "66d8b8f45c31475c905cf421e90054fb" member_type: VOTER last_known_addr { host: "127.20.240.252" port: 34811 } }
W20260808 04:44:57.235364 13460 catalog_manager.cc:1558] T 00000000000000000000000000000000 P e04b0ee76efd45d4b24bd7429b3efee1: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 04:44:57.236133 13460 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 04:44:57.237383 13440 sys_catalog.cc:455] T 00000000000000000000000000000000 P 66d8b8f45c31475c905cf421e90054fb [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a93f9acc99fc45509edfbfd94e11dc20" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 42189 } } peers { permanent_uuid: "e04b0ee76efd45d4b24bd7429b3efee1" member_type: VOTER last_known_addr { host: "127.20.240.253" port: 44573 } } peers { permanent_uuid: "66d8b8f45c31475c905cf421e90054fb" member_type: VOTER last_known_addr { host: "127.20.240.252" port: 34811 } } }
I20260808 04:44:57.237538 13440 sys_catalog.cc:458] T 00000000000000000000000000000000 P 66d8b8f45c31475c905cf421e90054fb [sys.catalog]: This master's current role is: FOLLOWER
I20260808 04:44:57.239812 13469 sys_catalog.cc:455] T 00000000000000000000000000000000 P a93f9acc99fc45509edfbfd94e11dc20 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a93f9acc99fc45509edfbfd94e11dc20. Latest consensus state: current_term: 1 leader_uuid: "a93f9acc99fc45509edfbfd94e11dc20" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a93f9acc99fc45509edfbfd94e11dc20" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 42189 } } peers { permanent_uuid: "e04b0ee76efd45d4b24bd7429b3efee1" member_type: VOTER last_known_addr { host: "127.20.240.253" port: 44573 } } peers { permanent_uuid: "66d8b8f45c31475c905cf421e90054fb" member_type: VOTER last_known_addr { host: "127.20.240.252" port: 34811 } } }
I20260808 04:44:57.240284 13469 sys_catalog.cc:458] T 00000000000000000000000000000000 P a93f9acc99fc45509edfbfd94e11dc20 [sys.catalog]: This master's current role is: LEADER
I20260808 04:44:57.241822 13478 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 04:44:57.243443 13478 catalog_manager.cc:1484] Initializing Kudu cluster ID...
W20260808 04:44:57.249727 13467 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 66d8b8f45c31475c905cf421e90054fb: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
I20260808 04:44:57.249876 13386 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 66d8b8f45c31475c905cf421e90054fb [term 1 FOLLOWER]: Refusing update from remote peer a93f9acc99fc45509edfbfd94e11dc20: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 04:44:57.250139 13441 sys_catalog.cc:455] T 00000000000000000000000000000000 P e04b0ee76efd45d4b24bd7429b3efee1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a93f9acc99fc45509edfbfd94e11dc20" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 42189 } } peers { permanent_uuid: "e04b0ee76efd45d4b24bd7429b3efee1" member_type: VOTER last_known_addr { host: "127.20.240.253" port: 44573 } } peers { permanent_uuid: "66d8b8f45c31475c905cf421e90054fb" member_type: VOTER last_known_addr { host: "127.20.240.252" port: 34811 } } }
I20260808 04:44:57.250399 13441 sys_catalog.cc:458] T 00000000000000000000000000000000 P e04b0ee76efd45d4b24bd7429b3efee1 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 04:44:57.250665 13469 consensus_queue.cc:1035] T 00000000000000000000000000000000 P a93f9acc99fc45509edfbfd94e11dc20 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66d8b8f45c31475c905cf421e90054fb" member_type: VOTER last_known_addr { host: "127.20.240.252" port: 34811 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 04:44:57.251950 13298 raft_consensus.cc:1261] T 00000000000000000000000000000000 P e04b0ee76efd45d4b24bd7429b3efee1 [term 1 FOLLOWER]: Refusing update from remote peer a93f9acc99fc45509edfbfd94e11dc20: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 04:44:57.255527 13440 sys_catalog.cc:455] T 00000000000000000000000000000000 P 66d8b8f45c31475c905cf421e90054fb [sys.catalog]: SysCatalogTable state changed. Reason: New leader a93f9acc99fc45509edfbfd94e11dc20. Latest consensus state: current_term: 1 leader_uuid: "a93f9acc99fc45509edfbfd94e11dc20" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a93f9acc99fc45509edfbfd94e11dc20" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 42189 } } peers { permanent_uuid: "e04b0ee76efd45d4b24bd7429b3efee1" member_type: VOTER last_known_addr { host: "127.20.240.253" port: 44573 } } peers { permanent_uuid: "66d8b8f45c31475c905cf421e90054fb" member_type: VOTER last_known_addr { host: "127.20.240.252" port: 34811 } } }
I20260808 04:44:57.255671 13440 sys_catalog.cc:458] T 00000000000000000000000000000000 P 66d8b8f45c31475c905cf421e90054fb [sys.catalog]: This master's current role is: FOLLOWER
I20260808 04:44:57.256047 13469 consensus_queue.cc:1035] T 00000000000000000000000000000000 P a93f9acc99fc45509edfbfd94e11dc20 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e04b0ee76efd45d4b24bd7429b3efee1" member_type: VOTER last_known_addr { host: "127.20.240.253" port: 44573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 04:44:57.260074 13441 sys_catalog.cc:455] T 00000000000000000000000000000000 P e04b0ee76efd45d4b24bd7429b3efee1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a93f9acc99fc45509edfbfd94e11dc20. Latest consensus state: current_term: 1 leader_uuid: "a93f9acc99fc45509edfbfd94e11dc20" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a93f9acc99fc45509edfbfd94e11dc20" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 42189 } } peers { permanent_uuid: "e04b0ee76efd45d4b24bd7429b3efee1" member_type: VOTER last_known_addr { host: "127.20.240.253" port: 44573 } } peers { permanent_uuid: "66d8b8f45c31475c905cf421e90054fb" member_type: VOTER last_known_addr { host: "127.20.240.252" port: 34811 } } }
I20260808 04:44:57.260210 13441 sys_catalog.cc:458] T 00000000000000000000000000000000 P e04b0ee76efd45d4b24bd7429b3efee1 [sys.catalog]: This master's current role is: FOLLOWER
W20260808 04:44:57.249903 13467 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 04:44:57.262372 13418 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:57.239316 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54044 (local address 127.20.240.252:34811)
0808 04:44:57.239445 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:57.239450 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:57.252628 (+ 13178us) server_negotiation.cc:407] Connection header received
0808 04:44:57.252783 (+ 155us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:57.252787 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:57.252840 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:57.252916 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:44:57.254022 (+ 1106us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:57.254816 (+ 794us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:57.256113 (+ 1297us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:57.256452 (+ 339us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:57.256523 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:57.258493 (+ 1970us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:44:57.258498 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:44:57.258500 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:44:57.258530 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:44:57.260238 (+ 1708us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:44:57.260872 (+ 634us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:44:57.260876 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:44:57.260879 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:44:57.260970 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:44:57.261310 (+ 340us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:44:57.261315 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:44:57.261317 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:44:57.261559 (+ 242us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:44:57.261695 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0808 04:44:57.262060 (+ 365us) server_negotiation.cc:299] Negotiation successful
0808 04:44:57.262196 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260808 04:44:57.267166 13469 sys_catalog.cc:455] T 00000000000000000000000000000000 P a93f9acc99fc45509edfbfd94e11dc20 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "a93f9acc99fc45509edfbfd94e11dc20" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a93f9acc99fc45509edfbfd94e11dc20" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 42189 } } peers { permanent_uuid: "e04b0ee76efd45d4b24bd7429b3efee1" member_type: VOTER last_known_addr { host: "127.20.240.253" port: 44573 } } peers { permanent_uuid: "66d8b8f45c31475c905cf421e90054fb" member_type: VOTER last_known_addr { host: "127.20.240.252" port: 34811 } } }
I20260808 04:44:57.267335 13469 sys_catalog.cc:458] T 00000000000000000000000000000000 P a93f9acc99fc45509edfbfd94e11dc20 [sys.catalog]: This master's current role is: LEADER
I20260808 04:44:57.269207 13441 sys_catalog.cc:455] T 00000000000000000000000000000000 P e04b0ee76efd45d4b24bd7429b3efee1 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "a93f9acc99fc45509edfbfd94e11dc20" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a93f9acc99fc45509edfbfd94e11dc20" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 42189 } } peers { permanent_uuid: "e04b0ee76efd45d4b24bd7429b3efee1" member_type: VOTER last_known_addr { host: "127.20.240.253" port: 44573 } } peers { permanent_uuid: "66d8b8f45c31475c905cf421e90054fb" member_type: VOTER last_known_addr { host: "127.20.240.252" port: 34811 } } }
I20260808 04:44:57.269364 13441 sys_catalog.cc:458] T 00000000000000000000000000000000 P e04b0ee76efd45d4b24bd7429b3efee1 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 04:44:57.269538 13479 mvcc.cc:205] Tried to move back new op lower bound from 7316128961526870016 to 7316128961469534208. Current Snapshot: MvccSnapshot[applied={T|T < 7316128961526870016}]
I20260808 04:44:57.272043 13485 mvcc.cc:205] Tried to move back new op lower bound from 7316128961526870016 to 7316128961469534208. Current Snapshot: MvccSnapshot[applied={T|T < 7316128961526870016}]
I20260808 04:44:57.272975 13424 sys_catalog.cc:455] T 00000000000000000000000000000000 P a93f9acc99fc45509edfbfd94e11dc20 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "a93f9acc99fc45509edfbfd94e11dc20" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a93f9acc99fc45509edfbfd94e11dc20" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 42189 } } peers { permanent_uuid: "e04b0ee76efd45d4b24bd7429b3efee1" member_type: VOTER last_known_addr { host: "127.20.240.253" port: 44573 } } peers { permanent_uuid: "66d8b8f45c31475c905cf421e90054fb" member_type: VOTER last_known_addr { host: "127.20.240.252" port: 34811 } } }
I20260808 04:44:57.273126 13424 sys_catalog.cc:458] T 00000000000000000000000000000000 P a93f9acc99fc45509edfbfd94e11dc20 [sys.catalog]: This master's current role is: LEADER
I20260808 04:44:57.274449 13440 sys_catalog.cc:455] T 00000000000000000000000000000000 P 66d8b8f45c31475c905cf421e90054fb [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "a93f9acc99fc45509edfbfd94e11dc20" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a93f9acc99fc45509edfbfd94e11dc20" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 42189 } } peers { permanent_uuid: "e04b0ee76efd45d4b24bd7429b3efee1" member_type: VOTER last_known_addr { host: "127.20.240.253" port: 44573 } } peers { permanent_uuid: "66d8b8f45c31475c905cf421e90054fb" member_type: VOTER last_known_addr { host: "127.20.240.252" port: 34811 } } }
I20260808 04:44:57.274585 13440 sys_catalog.cc:458] T 00000000000000000000000000000000 P 66d8b8f45c31475c905cf421e90054fb [sys.catalog]: This master's current role is: FOLLOWER
I20260808 04:44:57.275368 13483 mvcc.cc:205] Tried to move back new op lower bound from 7316128961526870016 to 7316128961469534208. Current Snapshot: MvccSnapshot[applied={T|T < 7316128961526870016}]
I20260808 04:44:57.276782 13333 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:57.246046 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34828 (local address 127.20.240.253:44573)
0808 04:44:57.246154 (+ 108us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:57.246158 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:57.253502 (+ 7344us) server_negotiation.cc:407] Connection header received
0808 04:44:57.254754 (+ 1252us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:57.254757 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:57.254805 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:57.254871 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:44:57.257255 (+ 2384us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:57.258091 (+ 836us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:57.266000 (+ 7909us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:57.266372 (+ 372us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:57.266495 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:57.270163 (+ 3668us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:44:57.270167 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:44:57.270171 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:44:57.270204 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:44:57.272034 (+ 1830us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:44:57.272555 (+ 521us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:44:57.272559 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:44:57.272561 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:44:57.272651 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:44:57.275310 (+ 2659us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:44:57.275314 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:44:57.275316 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:44:57.275571 (+ 255us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:44:57.275688 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0808 04:44:57.276485 (+ 797us) server_negotiation.cc:299] Negotiation successful
0808 04:44:57.276626 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260808 04:44:57.280719 13478 catalog_manager.cc:1347] Generated new cluster ID: 23918d23b34a414bb7055260fe8ce73f
I20260808 04:44:57.280794 13478 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 04:44:57.289789 13247 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:57.245635 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41180 (local address 127.20.240.254:42189)
0808 04:44:57.245753 (+ 118us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:57.245757 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:57.252999 (+ 7242us) server_negotiation.cc:407] Connection header received
0808 04:44:57.253600 (+ 601us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:57.253604 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:57.253664 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:57.253724 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:44:57.255806 (+ 2082us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:57.256554 (+ 748us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:57.265351 (+ 8797us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:57.265741 (+ 390us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:57.265869 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:57.273009 (+ 7140us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:44:57.273014 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:44:57.273017 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:44:57.273048 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:44:57.274778 (+ 1730us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:44:57.276031 (+ 1253us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:44:57.276035 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:44:57.276037 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:44:57.276132 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:44:57.278370 (+ 2238us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:44:57.278375 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:44:57.278377 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:44:57.278614 (+ 237us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:44:57.278730 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0808 04:44:57.289415 (+ 10685us) server_negotiation.cc:299] Negotiation successful
0808 04:44:57.289600 (+ 185us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260808 04:44:57.343529 13478 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 04:44:57.344923 13478 catalog_manager.cc:1504] Loading token signing keys...
I20260808 04:44:57.359042 13478 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a93f9acc99fc45509edfbfd94e11dc20: Generated new TSK 0
I20260808 04:44:57.360010 13478 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260808 04:44:57.396417 13418 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 04:44:57.384183 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54052 (local address 127.20.240.252:34811)
0808 04:44:57.384328 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:57.384334 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:57.394682 (+ 10348us) server_negotiation.cc:407] Connection header received
0808 04:44:57.395245 (+ 563us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:57.395249 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:57.395323 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:57.395379 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:44:57.396189 (+ 810us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:54052: BlockingRecv error: recv got EOF from 127.0.0.1:54052 (error 108)
Metrics: {"server-negotiator.queue_time_us":53}
W20260808 04:44:57.398835 13247 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 04:44:57.385209 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41194 (local address 127.20.240.254:42189)
0808 04:44:57.393341 (+ 8132us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:57.393347 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:57.397695 (+ 4348us) server_negotiation.cc:407] Connection header received
0808 04:44:57.397958 (+ 263us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:57.397964 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:57.398032 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:57.398095 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:44:57.398694 (+ 599us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:41194: BlockingRecv error: recv got EOF from 127.0.0.1:41194 (error 108)
Metrics: {"server-negotiator.queue_time_us":7984}
W20260808 04:44:57.403576 13333 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 04:44:57.394239 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34834 (local address 127.20.240.253:44573)
0808 04:44:57.394380 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:57.394385 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:57.402435 (+ 8050us) server_negotiation.cc:407] Connection header received
0808 04:44:57.402759 (+ 324us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:57.402763 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:57.402822 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:57.402877 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:44:57.403445 (+ 568us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:34834: BlockingRecv error: recv got EOF from 127.0.0.1:34834 (error 108)
Metrics: {"server-negotiator.queue_time_us":63}
W20260808 04:44:57.411402 13333 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 04:44:57.408984 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34842 (local address 127.20.240.253:44573)
0808 04:44:57.409104 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:57.409109 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:57.409664 (+ 555us) server_negotiation.cc:407] Connection header received
0808 04:44:57.410586 (+ 922us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:57.410590 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:57.410669 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:57.410721 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:44:57.411268 (+ 547us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:34842: BlockingRecv error: recv got EOF from 127.0.0.1:34842 (error 108)
Metrics: {"server-negotiator.queue_time_us":47}
W20260808 04:44:57.417485 13333 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 04:44:57.415527 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34850 (local address 127.20.240.253:44573)
0808 04:44:57.415644 (+ 117us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:57.415648 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:57.416267 (+ 619us) server_negotiation.cc:407] Connection header received
0808 04:44:57.416505 (+ 238us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:57.416509 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:57.416564 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:57.416617 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:44:57.417367 (+ 750us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:34850: BlockingRecv error: recv got EOF from 127.0.0.1:34850 (error 108)
Metrics: {"server-negotiator.queue_time_us":45}
W20260808 04:44:57.424256 13333 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 04:44:57.422516 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34856 (local address 127.20.240.253:44573)
0808 04:44:57.422639 (+ 123us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:57.422644 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:57.423195 (+ 551us) server_negotiation.cc:407] Connection header received
0808 04:44:57.423424 (+ 229us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:57.423427 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:57.423485 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:57.423539 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:44:57.424123 (+ 584us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:34856: BlockingRecv error: recv got EOF from 127.0.0.1:34856 (error 108)
Metrics: {"server-negotiator.queue_time_us":48}
W20260808 04:44:57.433116 13333 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 04:44:57.431346 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34872 (local address 127.20.240.253:44573)
0808 04:44:57.431497 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:57.431502 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:57.432092 (+ 590us) server_negotiation.cc:407] Connection header received
0808 04:44:57.432311 (+ 219us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:57.432314 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:57.432371 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:57.432428 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:44:57.432993 (+ 565us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:34872: BlockingRecv error: recv got EOF from 127.0.0.1:34872 (error 108)
Metrics: {"server-negotiator.queue_time_us":74}
W20260808 04:44:57.445660 13333 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 04:44:57.443967 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34886 (local address 127.20.240.253:44573)
0808 04:44:57.444092 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:57.444097 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:57.444619 (+ 522us) server_negotiation.cc:407] Connection header received
0808 04:44:57.444819 (+ 200us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:57.444823 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:57.444877 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:57.444929 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:44:57.445534 (+ 605us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:34886: BlockingRecv error: recv got EOF from 127.0.0.1:34886 (error 108)
Metrics: {"server-negotiator.queue_time_us":49}
W20260808 04:44:57.466259 13333 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 04:44:57.464762 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34890 (local address 127.20.240.253:44573)
0808 04:44:57.464924 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:57.464929 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:57.465252 (+ 323us) server_negotiation.cc:407] Connection header received
0808 04:44:57.465410 (+ 158us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:57.465412 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:57.465471 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:57.465548 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:44:57.466105 (+ 557us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:34890: BlockingRecv error: recv got EOF from 127.0.0.1:34890 (error 108)
Metrics: {"server-negotiator.queue_time_us":41}
W20260808 04:44:57.501684 13333 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 04:44:57.500476 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34896 (local address 127.20.240.253:44573)
0808 04:44:57.500651 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:57.500655 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:57.500762 (+ 107us) server_negotiation.cc:407] Connection header received
0808 04:44:57.500903 (+ 141us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:57.500905 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:57.500956 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:57.501030 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:44:57.501557 (+ 527us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:34896: BlockingRecv error: recv got EOF from 127.0.0.1:34896 (error 108)
Metrics: {"server-negotiator.queue_time_us":80}
W20260808 04:44:57.569657 13333 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 04:44:57.568213 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34912 (local address 127.20.240.253:44573)
0808 04:44:57.568508 (+ 295us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:57.568514 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:57.568629 (+ 115us) server_negotiation.cc:407] Connection header received
0808 04:44:57.568829 (+ 200us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:57.568832 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:57.568905 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:57.569001 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:44:57.569515 (+ 514us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:34912: BlockingRecv error: recv got EOF from 127.0.0.1:34912 (error 108)
Metrics: {"server-negotiator.queue_time_us":176}
W20260808 04:44:57.701297 13333 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 04:44:57.700043 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34928 (local address 127.20.240.253:44573)
0808 04:44:57.700262 (+ 219us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:57.700271 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:57.700388 (+ 117us) server_negotiation.cc:407] Connection header received
0808 04:44:57.700472 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:57.700475 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:57.700529 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:57.700610 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:44:57.701135 (+ 525us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:34928: BlockingRecv error: recv got EOF from 127.0.0.1:34928 (error 108)
Metrics: {"server-negotiator.queue_time_us":101}
W20260808 04:44:57.961257 13333 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 04:44:57.959962 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34942 (local address 127.20.240.253:44573)
0808 04:44:57.960111 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:57.960115 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:57.960210 (+ 95us) server_negotiation.cc:407] Connection header received
0808 04:44:57.960351 (+ 141us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:57.960355 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:57.960404 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:57.960491 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:44:57.961087 (+ 596us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:34942: BlockingRecv error: recv got EOF from 127.0.0.1:34942 (error 108)
Metrics: {"server-negotiator.queue_time_us":64}
I20260808 04:44:58.237543 13460 catalog_manager.cc:1259] Loaded cluster ID: 23918d23b34a414bb7055260fe8ce73f
I20260808 04:44:58.237639 13460 catalog_manager.cc:1552] T 00000000000000000000000000000000 P e04b0ee76efd45d4b24bd7429b3efee1: loading cluster ID for follower catalog manager: success
I20260808 04:44:58.239362 13460 catalog_manager.cc:1574] T 00000000000000000000000000000000 P e04b0ee76efd45d4b24bd7429b3efee1: acquiring CA information for follower catalog manager: success
I20260808 04:44:58.240512 13460 catalog_manager.cc:1602] T 00000000000000000000000000000000 P e04b0ee76efd45d4b24bd7429b3efee1: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260808 04:44:58.261924 13467 catalog_manager.cc:1259] Loaded cluster ID: 23918d23b34a414bb7055260fe8ce73f
I20260808 04:44:58.262018 13467 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 66d8b8f45c31475c905cf421e90054fb: loading cluster ID for follower catalog manager: success
I20260808 04:44:58.263643 13467 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 66d8b8f45c31475c905cf421e90054fb: acquiring CA information for follower catalog manager: success
I20260808 04:44:58.264799 13467 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 66d8b8f45c31475c905cf421e90054fb: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260808 04:44:58.479481 13561 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:58.475630 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34952 (local address 127.20.240.253:44573)
0808 04:44:58.475906 (+ 276us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:58.475909 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:58.475925 (+ 16us) server_negotiation.cc:407] Connection header received
0808 04:44:58.475978 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:58.475980 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:58.476107 (+ 127us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:58.476206 (+ 99us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 04:44:58.476437 (+ 231us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:58.476996 (+ 559us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:58.477908 (+ 912us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:58.478147 (+ 239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:58.478230 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:58.478549 (+ 319us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 04:44:58.479028 (+ 479us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 04:44:58.479122 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0808 04:44:58.479209 (+ 87us) server_negotiation.cc:299] Negotiation successful
0808 04:44:58.479262 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":177,"thread_start_us":78,"threads_started":1}
I20260808 04:44:58.486600 13567 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:58.482918 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54066 (local address 127.20.240.252:34811)
0808 04:44:58.483145 (+ 227us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:58.483149 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:58.483162 (+ 13us) server_negotiation.cc:407] Connection header received
0808 04:44:58.483244 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:58.483246 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:58.483383 (+ 137us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:58.483486 (+ 103us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 04:44:58.483664 (+ 178us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:58.484180 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:58.485008 (+ 828us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:58.485317 (+ 309us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:58.485405 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:58.485736 (+ 331us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 04:44:58.486205 (+ 469us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 04:44:58.486322 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0808 04:44:58.486410 (+ 88us) server_negotiation.cc:299] Negotiation successful
0808 04:44:58.486475 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":157,"thread_start_us":88,"threads_started":1}
I20260808 04:44:58.494285 13567 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:58.489770 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54076 (local address 127.20.240.252:34811)
0808 04:44:58.489900 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:58.489906 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:58.490398 (+ 492us) server_negotiation.cc:407] Connection header received
0808 04:44:58.490549 (+ 151us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:58.490555 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:58.490609 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:58.490685 (+ 76us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 04:44:58.490985 (+ 300us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:58.491747 (+ 762us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:58.492873 (+ 1126us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:58.493249 (+ 376us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:58.493325 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:58.493712 (+ 387us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 04:44:58.493797 (+ 85us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 04:44:58.493872 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0808 04:44:58.494028 (+ 156us) server_negotiation.cc:299] Negotiation successful
0808 04:44:58.494097 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260808 04:44:58.494752 13575 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:58.489725 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41200 (local address 127.20.240.254:42189)
0808 04:44:58.489998 (+ 273us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:58.490004 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:58.490058 (+ 54us) server_negotiation.cc:407] Connection header received
0808 04:44:58.490280 (+ 222us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:58.490283 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:58.490409 (+ 126us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:58.490516 (+ 107us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 04:44:58.490849 (+ 333us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:58.491726 (+ 877us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:58.492848 (+ 1122us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:58.493096 (+ 248us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:58.493250 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:58.493660 (+ 410us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 04:44:58.494071 (+ 411us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 04:44:58.494158 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0808 04:44:58.494519 (+ 361us) server_negotiation.cc:299] Negotiation successful
0808 04:44:58.494603 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":203,"thread_start_us":72,"threads_started":1}
I20260808 04:44:58.494889 13561 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:58.490108 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34958 (local address 127.20.240.253:44573)
0808 04:44:58.490235 (+ 127us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:58.490239 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:58.490780 (+ 541us) server_negotiation.cc:407] Connection header received
0808 04:44:58.491217 (+ 437us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:58.491221 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:58.491284 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:58.491367 (+ 83us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 04:44:58.491598 (+ 231us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:58.492327 (+ 729us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:58.493528 (+ 1201us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:58.493879 (+ 351us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:58.493977 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:58.494293 (+ 316us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 04:44:58.494383 (+ 90us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 04:44:58.494461 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0808 04:44:58.494657 (+ 196us) server_negotiation.cc:299] Negotiation successful
0808 04:44:58.494726 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260808 04:44:58.498167 21443 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu with pid 13171
I20260808 04:44:58.505826 21443 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu with pid 13252
I20260808 04:44:58.513725 21443 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu with pid 13334
2026-08-08T04:44:58Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0 (3240 ms)
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1
Loading random data
Initializing database '/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786164000593138-21443-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 04:44:58 dist-test-slave-vxj2 krb5kdc[13579](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 04:44:58 dist-test-slave-vxj2 krb5kdc[13579](info): set up 2 sockets
Aug 08 04:44:58 dist-test-slave-vxj2 krb5kdc[13579](info): commencing operation
krb5kdc: starting...
W20260808 04:44:59.609108 21443 mini_kdc.cc:121] Time spent starting KDC: real 1.071s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786164000593138-21443-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786164000593138-21443-0/krb5kdc/test-user.keytab.
Aug 08 04:44:59 dist-test-slave-vxj2 krb5kdc[13579](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164299, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T04:44:59Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T04:44:59Z Disabled control of system clock
WARNING: no policy specified for kudu/127.20.240.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.240.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.240.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.254.keytab.
Entry for principal kudu/127.20.240.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.254.keytab.
I20260808 04:44:59.740975 21443 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
/tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786164000593138-21443-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786164000593138-21443-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786164000593138-21443-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786164000593138-21443-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.240.254:39877
--webserver_interface=127.20.240.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.254.keytab
--principal=kudu/127.20.240.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.240.212:37389
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.240.254:39877,127.20.240.253:35833,127.20.240.252:37801
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786164000593138-21443-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786164000593138-21443-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786164000593138-21443-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 04:44:59.861227 13592 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260808 04:44:59.861629 13592 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:44:59.861709 13592 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:44:59.861792 13592 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:44:59.866125 13592 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 04:44:59.866243 13592 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:44:59.866281 13592 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:44:59.866323 13592 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 04:44:59.866359 13592 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 04:44:59.872480 13592 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.240.212:37389
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786164000593138-21443-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786164000593138-21443-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.240.254:39877,127.20.240.253:35833,127.20.240.252:37801
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.254.keytab
--principal=kudu/127.20.240.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.240.254:39877
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786164000593138-21443-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.240.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13592
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786164000593138-21443-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 04:05:18 UTC on ccycloud.quasar-drfdgt.root.comops.site
build id 4574101
I20260808 04:44:59.873800 13592 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:44:59.874955 13592 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:44:59.884239 13603 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:44:59.884230 13601 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:44:59.884230 13600 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:44:59.884284 13592 server_base.cc:1034] running on GCE node
I20260808 04:44:59.885030 13592 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:44:59.886257 13592 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:44:59.887501 13592 hybrid_clock.cc:648] HybridClock initialized: now 1786164299887485 us; error 27 us; skew 500 ppm
Aug 08 04:44:59 dist-test-slave-vxj2 krb5kdc[13579](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164299, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.240.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:44:59.890376 13592 init.cc:377] Logged in from keytab as kudu/127.20.240.254@KRBTEST.COM (short username kudu)
I20260808 04:44:59.891433 13592 webserver.cc:460] Webserver started at http://127.20.240.254:38221/ using document root <none> and password file <none>
I20260808 04:44:59.892475 13592 fs_manager.cc:359] Metadata directory not provided
I20260808 04:44:59.892592 13592 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:44:59.892834 13592 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 04:44:59.895085 13592 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786164000593138-21443-0/minicluster-data/master-0/data/instance:
uuid: "f98e9b9720634847b02c2456884bad66"
format_stamp: "Formatted at 2026-08-08 04:44:59 on dist-test-slave-vxj2"
server_key: "842233c71d1637b15966a85550b7e95a"
server_key_iv: "a80d682019459031b2d3ef97e38c1cf0"
server_key_version: "encryptionkey@0"
I20260808 04:44:59.895784 13592 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786164000593138-21443-0/minicluster-data/master-0/wal/instance:
uuid: "f98e9b9720634847b02c2456884bad66"
format_stamp: "Formatted at 2026-08-08 04:44:59 on dist-test-slave-vxj2"
server_key: "842233c71d1637b15966a85550b7e95a"
server_key_iv: "a80d682019459031b2d3ef97e38c1cf0"
server_key_version: "encryptionkey@0"
I20260808 04:44:59.900067 13592 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260808 04:44:59.903047 13610 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:44:59.904498 13592 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.001s
I20260808 04:44:59.904675 13592 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786164000593138-21443-0/minicluster-data/master-0/data,/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786164000593138-21443-0/minicluster-data/master-0/wal
uuid: "f98e9b9720634847b02c2456884bad66"
format_stamp: "Formatted at 2026-08-08 04:44:59 on dist-test-slave-vxj2"
server_key: "842233c71d1637b15966a85550b7e95a"
server_key_iv: "a80d682019459031b2d3ef97e38c1cf0"
server_key_version: "encryptionkey@0"
I20260808 04:44:59.904822 13592 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786164000593138-21443-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786164000593138-21443-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786164000593138-21443-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:44:59.919551 13592 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:44:59.922734 13592 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:44:59.922981 13592 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:44:59.930689 13592 rpc_server.cc:307] RPC server started. Bound to: 127.20.240.254:39877
I20260808 04:44:59.931003 13668 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.240.254:39877 every 8 connection(s)
I20260808 04:44:59.931782 13592 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786164000593138-21443-0/minicluster-data/master-0/data/info.pb
I20260808 04:44:59.934881 13670 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:44:59.938457 21443 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu as pid 13592
I20260808 04:44:59.938621 21443 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786164000593138-21443-0/minicluster-data/master-0/wal/instance
I20260808 04:44:59.938966 21443 external_mini_cluster.cc:1428] Setting key ae0819ed373c1d9b734c827f7a9dc370
I20260808 04:44:59.939261 13670 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.240.254" port: 39877 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.20.240.253@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.240.253@KRBTEST.COM" created.
Aug 08 04:44:59 dist-test-slave-vxj2 krb5kdc[13579](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164299, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.240.254@KRBTEST.COM for kudu/127.20.240.254@KRBTEST.COM
I20260808 04:44:59.959081 13673 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:59.941937 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:39877 (local address 127.0.0.1:44636)
0808 04:44:59.942474 (+ 537us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:59.942531 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0808 04:44:59.943838 (+ 1307us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:44:59.944699 (+ 861us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:44:59.944706 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:44:59.945098 (+ 392us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:44:59.945447 (+ 349us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:44:59.945463 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:44:59.946821 (+ 1358us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:44:59.946826 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:44:59.948119 (+ 1293us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:44:59.948131 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:44:59.948874 (+ 743us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:44:59.948880 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:44:59.949025 (+ 145us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:59.949731 (+ 706us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:44:59.949753 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:44:59.953568 (+ 3815us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:44:59.955885 (+ 2317us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:44:59.955896 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:44:59.955907 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:44:59.956136 (+ 229us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:44:59.956475 (+ 339us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:44:59.956478 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:44:59.956480 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:44:59.956593 (+ 113us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:44:59.957269 (+ 676us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:44:59.957276 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:44:59.957421 (+ 145us) client_negotiation.cc:769] Sending connection context
0808 04:44:59.957593 (+ 172us) client_negotiation.cc:240] Negotiation successful
0808 04:44:59.958004 (+ 411us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":307,"mutex_wait_us":109,"thread_start_us":113,"threads_started":1}
I20260808 04:44:59.959081 13674 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:59.941937 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44636 (local address 127.20.240.254:39877)
0808 04:44:59.942439 (+ 502us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:59.942458 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:59.942653 (+ 195us) server_negotiation.cc:407] Connection header received
0808 04:44:59.944240 (+ 1587us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:59.944249 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:59.944470 (+ 221us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:59.944624 (+ 154us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:44:59.945635 (+ 1011us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:59.946662 (+ 1027us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:59.948286 (+ 1624us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:59.948683 (+ 397us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:59.948831 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:59.953745 (+ 4914us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:44:59.953751 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:44:59.953763 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:44:59.953786 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:44:59.955773 (+ 1987us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:44:59.956253 (+ 480us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:44:59.956268 (+ 15us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:44:59.956269 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:44:59.956372 (+ 103us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:44:59.956693 (+ 321us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:44:59.956696 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:44:59.956698 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:44:59.957095 (+ 397us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:44:59.957307 (+ 212us) server_negotiation.cc:1035] Waiting for connection context
0808 04:44:59.957668 (+ 361us) server_negotiation.cc:299] Negotiation successful
0808 04:44:59.957948 (+ 280us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":3,"server-negotiator.queue_time_us":365,"spinlock_wait_cycles":19200,"thread_start_us":190,"threads_started":1}
I20260808 04:44:59.961730 13670 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.240.253" port: 35833 } has no permanent_uuid. Determining permanent_uuid...
I20260808 04:44:59.962625 13673 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:59.962294 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.253:35833 (local address 127.0.0.1:35728)
0808 04:44:59.962430 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:59.962552 (+ 122us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.240.253:35833: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
W20260808 04:44:59.962906 13611 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.20.240.253:35833: connect: Connection refused (error 111)
I20260808 04:44:59.964033 13673 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:59.963801 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.253:35833 (local address 127.0.0.1:35740)
0808 04:44:59.963919 (+ 118us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:59.963970 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.240.253:35833: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
W20260808 04:44:59.964238 13670 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.240.253:35833: Network error: Client connection negotiation failed: client connection to 127.20.240.253:35833: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.240.253 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.253.keytab.
Entry for principal kudu/127.20.240.253 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.253.keytab.
I20260808 04:44:59.972157 21443 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
/tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786164000593138-21443-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786164000593138-21443-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786164000593138-21443-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786164000593138-21443-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.240.253:35833
--webserver_interface=127.20.240.253
--webserver_port=0
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.253.keytab
--principal=kudu/127.20.240.253
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.240.212:37389
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.240.254:39877,127.20.240.253:35833,127.20.240.252:37801
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786164000593138-21443-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786164000593138-21443-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786164000593138-21443-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 04:45:00.013585 13670 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.240.253" port: 35833 } attempt: 1
I20260808 04:45:00.014674 13673 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:45:00.014324 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.253:35833 (local address 127.0.0.1:35754)
0808 04:45:00.014515 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0808 04:45:00.014586 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.240.253:35833: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":74}
I20260808 04:45:00.016072 13673 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:45:00.015726 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.253:35833 (local address 127.0.0.1:35756)
0808 04:45:00.015898 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0808 04:45:00.015985 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.240.253:35833: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":92}
W20260808 04:45:00.016294 13670 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.240.253:35833: Network error: Client connection negotiation failed: client connection to 127.20.240.253:35833: connect: Connection refused (error 111)
I20260808 04:45:00.084512 13670 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.240.253" port: 35833 } attempt: 2
I20260808 04:45:00.085512 13673 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:45:00.085199 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.253:35833 (local address 127.0.0.1:35772)
0808 04:45:00.085363 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0808 04:45:00.085431 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.240.253:35833: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":62}
I20260808 04:45:00.086300 13673 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:45:00.086056 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.253:35833 (local address 127.0.0.1:35786)
0808 04:45:00.086191 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0808 04:45:00.086243 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.240.253:35833: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":62}
W20260808 04:45:00.086519 13670 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.240.253:35833: Network error: Client connection negotiation failed: client connection to 127.20.240.253:35833: connect: Connection refused (error 111)
W20260808 04:45:00.094020 13677 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260808 04:45:00.094324 13677 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:45:00.094381 13677 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:45:00.094478 13677 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:45:00.098732 13677 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 04:45:00.098805 13677 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:45:00.098826 13677 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:45:00.098845 13677 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 04:45:00.098860 13677 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 04:45:00.104672 13677 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.240.212:37389
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786164000593138-21443-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786164000593138-21443-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.20.240.254:39877,127.20.240.253:35833,127.20.240.252:37801
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.253.keytab
--principal=kudu/127.20.240.253
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.240.253:35833
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786164000593138-21443-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.20.240.253
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13677
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786164000593138-21443-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 04:05:18 UTC on ccycloud.quasar-drfdgt.root.comops.site
build id 4574101
I20260808 04:45:00.105976 13677 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:45:00.107139 13677 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:45:00.117311 13686 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:45:00.117385 13677 server_base.cc:1034] running on GCE node
W20260808 04:45:00.117329 13682 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:45:00.117329 13684 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:45:00.118168 13677 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:45:00.119437 13677 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:45:00.120637 13677 hybrid_clock.cc:648] HybridClock initialized: now 1786164300120620 us; error 30 us; skew 500 ppm
Aug 08 04:45:00 dist-test-slave-vxj2 krb5kdc[13579](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164300, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.240.253@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:45:00.127192 13677 init.cc:377] Logged in from keytab as kudu/127.20.240.253@KRBTEST.COM (short username kudu)
I20260808 04:45:00.128312 13677 webserver.cc:460] Webserver started at http://127.20.240.253:46535/ using document root <none> and password file <none>
I20260808 04:45:00.128970 13677 fs_manager.cc:359] Metadata directory not provided
I20260808 04:45:00.129068 13677 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:45:00.129348 13677 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 04:45:00.131619 13677 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786164000593138-21443-0/minicluster-data/master-1/data/instance:
uuid: "b4c3bf2e13c047d094ae3c505f9d0d29"
format_stamp: "Formatted at 2026-08-08 04:45:00 on dist-test-slave-vxj2"
server_key: "5d0160fcfdc2641a5cd9ed02cea8276f"
server_key_iv: "1345d20b9f78514aa850d7b7a8342a0a"
server_key_version: "encryptionkey@0"
I20260808 04:45:00.132261 13677 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786164000593138-21443-0/minicluster-data/master-1/wal/instance:
uuid: "b4c3bf2e13c047d094ae3c505f9d0d29"
format_stamp: "Formatted at 2026-08-08 04:45:00 on dist-test-slave-vxj2"
server_key: "5d0160fcfdc2641a5cd9ed02cea8276f"
server_key_iv: "1345d20b9f78514aa850d7b7a8342a0a"
server_key_version: "encryptionkey@0"
I20260808 04:45:00.136620 13677 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.004s
I20260808 04:45:00.139868 13693 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:45:00.141297 13677 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260808 04:45:00.141460 13677 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786164000593138-21443-0/minicluster-data/master-1/data,/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786164000593138-21443-0/minicluster-data/master-1/wal
uuid: "b4c3bf2e13c047d094ae3c505f9d0d29"
format_stamp: "Formatted at 2026-08-08 04:45:00 on dist-test-slave-vxj2"
server_key: "5d0160fcfdc2641a5cd9ed02cea8276f"
server_key_iv: "1345d20b9f78514aa850d7b7a8342a0a"
server_key_version: "encryptionkey@0"
I20260808 04:45:00.141592 13677 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786164000593138-21443-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786164000593138-21443-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786164000593138-21443-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:45:00.161654 13677 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:45:00.164964 13677 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:45:00.165256 13677 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:45:00.173038 13677 rpc_server.cc:307] RPC server started. Bound to: 127.20.240.253:35833
I20260808 04:45:00.173415 13749 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.240.253:35833 every 8 connection(s)
I20260808 04:45:00.174131 13677 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786164000593138-21443-0/minicluster-data/master-1/data/info.pb
I20260808 04:45:00.177066 13750 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:45:00.177699 13670 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.240.253" port: 35833 } attempt: 3
I20260808 04:45:00.179723 21443 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu as pid 13677
I20260808 04:45:00.179908 21443 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786164000593138-21443-0/minicluster-data/master-1/wal/instance
I20260808 04:45:00.180200 21443 external_mini_cluster.cc:1428] Setting key 772b4ad6d7e84e3076f3c728e4820d45
I20260808 04:45:00.182566 13750 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.240.254" port: 39877 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 04:45:00 dist-test-slave-vxj2 krb5kdc[13579](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164299, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.240.254@KRBTEST.COM for kudu/127.20.240.253@KRBTEST.COM
WARNING: no policy specified for kudu/127.20.240.252@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.240.252@KRBTEST.COM" created.
I20260808 04:45:00.193027 13673 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:45:00.178237 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.253:35833 (local address 127.0.0.1:35800)
0808 04:45:00.178379 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0808 04:45:00.178398 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0808 04:45:00.178501 (+ 103us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:45:00.181685 (+ 3184us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:45:00.181692 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:45:00.181964 (+ 272us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:45:00.182145 (+ 181us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:45:00.182155 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:45:00.183960 (+ 1805us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:45:00.183968 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:45:00.184963 (+ 995us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:45:00.184980 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:45:00.186164 (+ 1184us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:45:00.186171 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:45:00.186304 (+ 133us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:45:00.186938 (+ 634us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:45:00.186954 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:45:00.188312 (+ 1358us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:45:00.190878 (+ 2566us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:45:00.190880 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:45:00.190882 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:45:00.191092 (+ 210us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:45:00.191460 (+ 368us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:45:00.191464 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:45:00.191466 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:45:00.191558 (+ 92us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:45:00.192252 (+ 694us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:45:00.192255 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:45:00.192358 (+ 103us) client_negotiation.cc:769] Sending connection context
0808 04:45:00.192490 (+ 132us) client_negotiation.cc:240] Negotiation successful
0808 04:45:00.192694 (+ 204us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":55}
I20260808 04:45:00.194384 13752 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:45:00.178988 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35800 (local address 127.20.240.253:35833)
0808 04:45:00.179467 (+ 479us) server_negotiation.cc:206] Beginning negotiation
0808 04:45:00.179486 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0808 04:45:00.179532 (+ 46us) server_negotiation.cc:407] Connection header received
0808 04:45:00.180754 (+ 1222us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:45:00.180781 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:45:00.181308 (+ 527us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:45:00.181704 (+ 396us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:45:00.182325 (+ 621us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:45:00.183801 (+ 1476us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:45:00.185133 (+ 1332us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:45:00.186005 (+ 872us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:45:00.186208 (+ 203us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:45:00.188518 (+ 2310us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:45:00.188525 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:45:00.188540 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:45:00.188579 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:45:00.190693 (+ 2114us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:45:00.191197 (+ 504us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:45:00.191202 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:45:00.191207 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:45:00.191325 (+ 118us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:45:00.191651 (+ 326us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:45:00.191654 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:45:00.191655 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:45:00.192131 (+ 476us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:45:00.192235 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0808 04:45:00.192790 (+ 555us) server_negotiation.cc:299] Negotiation successful
0808 04:45:00.193154 (+ 364us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":313,"thread_start_us":145,"threads_started":1}
Aug 08 04:45:00 dist-test-slave-vxj2 krb5kdc[13579](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164300, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.240.253@KRBTEST.COM for kudu/127.20.240.254@KRBTEST.COM
I20260808 04:45:00.197208 13670 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.240.252" port: 37801 } has no permanent_uuid. Determining permanent_uuid...
I20260808 04:45:00.198179 13673 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:45:00.197794 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.252:37801 (local address 127.0.0.1:43426)
0808 04:45:00.197991 (+ 197us) negotiation.cc:107] Waiting for socket to connect
0808 04:45:00.198066 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.240.252:37801: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":65}
I20260808 04:45:00.198987 13673 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:45:00.198703 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.252:37801 (local address 127.0.0.1:43428)
0808 04:45:00.198863 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0808 04:45:00.198916 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.240.252:37801: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":91}
W20260808 04:45:00.199347 13670 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.240.252:37801: Network error: Client connection negotiation failed: client connection to 127.20.240.252:37801: connect: Connection refused (error 111)
I20260808 04:45:00.200032 13674 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:45:00.184598 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44646 (local address 127.20.240.254:39877)
0808 04:45:00.184737 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0808 04:45:00.184744 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 04:45:00.185114 (+ 370us) server_negotiation.cc:407] Connection header received
0808 04:45:00.185343 (+ 229us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:45:00.185347 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:45:00.185406 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:45:00.185449 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:45:00.186252 (+ 803us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:45:00.186938 (+ 686us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:45:00.188299 (+ 1361us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:45:00.189247 (+ 948us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:45:00.189385 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:45:00.195796 (+ 6411us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:45:00.195801 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:45:00.195804 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:45:00.195840 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:45:00.197792 (+ 1952us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:45:00.198444 (+ 652us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:45:00.198448 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:45:00.198450 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:45:00.198571 (+ 121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:45:00.198925 (+ 354us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:45:00.198928 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:45:00.198930 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:45:00.199187 (+ 257us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:45:00.199269 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0808 04:45:00.199822 (+ 553us) server_negotiation.cc:299] Negotiation successful
0808 04:45:00.199936 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260808 04:45:00.200274 13754 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:45:00.184582 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:39877 (local address 127.0.0.1:44646)
0808 04:45:00.184987 (+ 405us) negotiation.cc:107] Waiting for socket to connect
0808 04:45:00.185039 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0808 04:45:00.185227 (+ 188us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:45:00.185598 (+ 371us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:45:00.185602 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:45:00.185956 (+ 354us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:45:00.186119 (+ 163us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:45:00.186130 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:45:00.187072 (+ 942us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:45:00.187076 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:45:00.188156 (+ 1080us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:45:00.188170 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:45:00.189386 (+ 1216us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:45:00.189389 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:45:00.189529 (+ 140us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:45:00.190096 (+ 567us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:45:00.190108 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:45:00.195602 (+ 5494us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:45:00.197941 (+ 2339us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:45:00.197953 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:45:00.197958 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:45:00.198308 (+ 350us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:45:00.198689 (+ 381us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:45:00.198696 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:45:00.198701 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:45:00.198818 (+ 117us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:45:00.199311 (+ 493us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:45:00.199321 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:45:00.199500 (+ 179us) client_negotiation.cc:769] Sending connection context
0808 04:45:00.199697 (+ 197us) client_negotiation.cc:240] Negotiation successful
0808 04:45:00.199978 (+ 281us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":246,"thread_start_us":150,"threads_started":1}
I20260808 04:45:00.201581 13750 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.240.253" port: 35833 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 04:45:00 dist-test-slave-vxj2 krb5kdc[13579](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164300, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.240.253@KRBTEST.COM for kudu/127.20.240.253@KRBTEST.COM
I20260808 04:45:00.210507 13754 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:45:00.202123 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.253:35833 (local address 127.0.0.1:35806)
0808 04:45:00.202328 (+ 205us) negotiation.cc:107] Waiting for socket to connect
0808 04:45:00.202341 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 04:45:00.202439 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:45:00.202691 (+ 252us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:45:00.202693 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:45:00.202888 (+ 195us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:45:00.202982 (+ 94us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:45:00.202987 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:45:00.203732 (+ 745us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:45:00.203738 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:45:00.204307 (+ 569us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:45:00.204316 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:45:00.204855 (+ 539us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:45:00.204858 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:45:00.204995 (+ 137us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:45:00.205552 (+ 557us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:45:00.205563 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:45:00.206930 (+ 1367us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:45:00.208717 (+ 1787us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:45:00.208723 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:45:00.208725 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:45:00.208933 (+ 208us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:45:00.209299 (+ 366us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:45:00.209306 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:45:00.209308 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:45:00.209415 (+ 107us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:45:00.209902 (+ 487us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:45:00.209906 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:45:00.210024 (+ 118us) client_negotiation.cc:769] Sending connection context
0808 04:45:00.210146 (+ 122us) client_negotiation.cc:240] Negotiation successful
0808 04:45:00.210304 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":155,"mutex_wait_us":19}
I20260808 04:45:00.210507 13752 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:45:00.202235 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35806 (local address 127.20.240.253:35833)
0808 04:45:00.202331 (+ 96us) server_negotiation.cc:206] Beginning negotiation
0808 04:45:00.202337 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 04:45:00.202388 (+ 51us) server_negotiation.cc:407] Connection header received
0808 04:45:00.202529 (+ 141us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:45:00.202532 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:45:00.202598 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:45:00.202679 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:45:00.203095 (+ 416us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:45:00.203627 (+ 532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:45:00.204423 (+ 796us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:45:00.204742 (+ 319us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:45:00.204849 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:45:00.207063 (+ 2214us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:45:00.207067 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:45:00.207070 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:45:00.207093 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:45:00.208614 (+ 1521us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:45:00.209032 (+ 418us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:45:00.209038 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:45:00.209040 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:45:00.209121 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:45:00.209569 (+ 448us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:45:00.209574 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:45:00.209576 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:45:00.209789 (+ 213us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:45:00.209913 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0808 04:45:00.210201 (+ 288us) server_negotiation.cc:299] Negotiation successful
0808 04:45:00.210356 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":60,"server-negotiator.queue_time_us":26}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.240.252 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.252.keytab.
Entry for principal kudu/127.20.240.252 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.252.keytab.
I20260808 04:45:00.211805 13750 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.240.252" port: 37801 } has no permanent_uuid. Determining permanent_uuid...
I20260808 04:45:00.212543 21443 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
/tmp/dist-test-taskgby_Qd/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786164000593138-21443-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786164000593138-21443-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786164000593138-21443-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786164000593138-21443-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.240.252:37801
--webserver_interface=127.20.240.252
--webserver_port=0
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.252.keytab
--principal=kudu/127.20.240.252
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.240.212:37389
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.240.254:39877,127.20.240.253:35833,127.20.240.252:37801
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786164000593138-21443-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786164000593138-21443-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786164000593138-21443-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 04:45:00.212634 13754 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:45:00.212312 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.252:37801 (local address 127.0.0.1:43438)
0808 04:45:00.212449 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0808 04:45:00.212554 (+ 105us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.240.252:37801: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
W20260808 04:45:00.212857 13695 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.20.240.252:37801: connect: Connection refused (error 111)
I20260808 04:45:00.213922 13754 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:45:00.213640 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.252:37801 (local address 127.0.0.1:43442)
0808 04:45:00.213768 (+ 128us) negotiation.cc:107] Waiting for socket to connect
0808 04:45:00.213832 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.240.252:37801: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
W20260808 04:45:00.214108 13750 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.240.252:37801: Network error: Client connection negotiation failed: client connection to 127.20.240.252:37801: connect: Connection refused (error 111)
I20260808 04:45:00.230549 13670 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.240.252" port: 37801 } attempt: 1
I20260808 04:45:00.231479 13673 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:45:00.231167 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.252:37801 (local address 127.0.0.1:43448)
0808 04:45:00.231320 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0808 04:45:00.231390 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.240.252:37801: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
I20260808 04:45:00.232291 13673 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:45:00.232070 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.252:37801 (local address 127.0.0.1:43464)
0808 04:45:00.232181 (+ 111us) negotiation.cc:107] Waiting for socket to connect
0808 04:45:00.232234 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.240.252:37801: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
W20260808 04:45:00.232451 13670 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.240.252:37801: Network error: Client connection negotiation failed: client connection to 127.20.240.252:37801: connect: Connection refused (error 111)
I20260808 04:45:00.263425 13750 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.240.252" port: 37801 } attempt: 1
I20260808 04:45:00.264456 13754 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:45:00.264101 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.252:37801 (local address 127.0.0.1:43470)
0808 04:45:00.264286 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0808 04:45:00.264353 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.240.252:37801: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":80}
I20260808 04:45:00.265364 13754 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:45:00.265077 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.252:37801 (local address 127.0.0.1:43474)
0808 04:45:00.265249 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0808 04:45:00.265303 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.240.252:37801: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":62}
W20260808 04:45:00.265509 13750 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.240.252:37801: Network error: Client connection negotiation failed: client connection to 127.20.240.252:37801: connect: Connection refused (error 111)
I20260808 04:45:00.307626 13670 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.240.252" port: 37801 } attempt: 2
I20260808 04:45:00.308709 13673 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:45:00.308249 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.252:37801 (local address 127.0.0.1:43484)
0808 04:45:00.308538 (+ 289us) negotiation.cc:107] Waiting for socket to connect
0808 04:45:00.308600 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.240.252:37801: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":185}
I20260808 04:45:00.309639 13673 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:45:00.309376 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.252:37801 (local address 127.0.0.1:43490)
0808 04:45:00.309525 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0808 04:45:00.309578 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.240.252:37801: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
W20260808 04:45:00.309834 13670 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.240.252:37801: Network error: Client connection negotiation failed: client connection to 127.20.240.252:37801: connect: Connection refused (error 111)
I20260808 04:45:00.333678 13750 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.240.252" port: 37801 } attempt: 2
I20260808 04:45:00.334743 13754 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:45:00.334328 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.252:37801 (local address 127.0.0.1:43506)
0808 04:45:00.334516 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0808 04:45:00.334609 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.240.252:37801: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
I20260808 04:45:00.335603 13754 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:45:00.335329 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.252:37801 (local address 127.0.0.1:43514)
0808 04:45:00.335432 (+ 103us) negotiation.cc:107] Waiting for socket to connect
0808 04:45:00.335499 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.240.252:37801: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":28}
W20260808 04:45:00.335788 13750 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.240.252:37801: Network error: Client connection negotiation failed: client connection to 127.20.240.252:37801: connect: Connection refused (error 111)
W20260808 04:45:00.346616 13757 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260808 04:45:00.346977 13757 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:45:00.347054 13757 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:45:00.347126 13757 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:45:00.351547 13757 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 04:45:00.351665 13757 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:45:00.351701 13757 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:45:00.351739 13757 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 04:45:00.351773 13757 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 04:45:00.357540 13757 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.240.212:37389
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786164000593138-21443-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786164000593138-21443-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.20.240.254:39877,127.20.240.253:35833,127.20.240.252:37801
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786164000593138-21443-0/krb5kdc/kudu_127.20.240.252.keytab
--principal=kudu/127.20.240.252
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.240.252:37801
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786164000593138-21443-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.20.240.252
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13757
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786164000593138-21443-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 04:05:18 UTC on ccycloud.quasar-drfdgt.root.comops.site
build id 4574101
I20260808 04:45:00.358773 13757 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:45:00.359890 13757 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:45:00.368796 13764 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:45:00.368749 13767 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:45:00.368755 13757 server_base.cc:1034] running on GCE node
W20260808 04:45:00.368762 13763 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:45:00.369644 13757 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:45:00.370903 13757 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:45:00.372107 13757 hybrid_clock.cc:648] HybridClock initialized: now 1786164300372071 us; error 50 us; skew 500 ppm
Aug 08 04:45:00 dist-test-slave-vxj2 krb5kdc[13579](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164300, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.240.252@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:45:00.375051 13757 init.cc:377] Logged in from keytab as kudu/127.20.240.252@KRBTEST.COM (short username kudu)
I20260808 04:45:00.376070 13757 webserver.cc:460] Webserver started at http://127.20.240.252:38675/ using document root <none> and password file <none>
I20260808 04:45:00.376667 13757 fs_manager.cc:359] Metadata directory not provided
I20260808 04:45:00.376761 13757 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:45:00.377003 13757 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 04:45:00.379249 13757 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786164000593138-21443-0/minicluster-data/master-2/data/instance:
uuid: "638d4f10aff647c8be157e8b3dade74d"
format_stamp: "Formatted at 2026-08-08 04:45:00 on dist-test-slave-vxj2"
server_key: "3858bece08e84f59ff23688665be6a1d"
server_key_iv: "6fe14d5574f57dcacfdd31e691eb478f"
server_key_version: "encryptionkey@0"
I20260808 04:45:00.379868 13757 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786164000593138-21443-0/minicluster-data/master-2/wal/instance:
uuid: "638d4f10aff647c8be157e8b3dade74d"
format_stamp: "Formatted at 2026-08-08 04:45:00 on dist-test-slave-vxj2"
server_key: "3858bece08e84f59ff23688665be6a1d"
server_key_iv: "6fe14d5574f57dcacfdd31e691eb478f"
server_key_version: "encryptionkey@0"
I20260808 04:45:00.384102 13757 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.004s
I20260808 04:45:00.386871 13776 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:45:00.388233 13757 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260808 04:45:00.388420 13757 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786164000593138-21443-0/minicluster-data/master-2/data,/tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786164000593138-21443-0/minicluster-data/master-2/wal
uuid: "638d4f10aff647c8be157e8b3dade74d"
format_stamp: "Formatted at 2026-08-08 04:45:00 on dist-test-slave-vxj2"
server_key: "3858bece08e84f59ff23688665be6a1d"
server_key_iv: "6fe14d5574f57dcacfdd31e691eb478f"
server_key_version: "encryptionkey@0"
I20260808 04:45:00.388553 13757 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786164000593138-21443-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786164000593138-21443-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786164000593138-21443-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:45:00.408420 13757 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:45:00.409082 13670 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.240.252" port: 37801 } attempt: 3
I20260808 04:45:00.409930 13673 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:45:00.409579 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.252:37801 (local address 127.0.0.1:43530)
0808 04:45:00.409760 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0808 04:45:00.409829 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.240.252:37801: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
I20260808 04:45:00.410686 13673 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:45:00.410434 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.252:37801 (local address 127.0.0.1:43546)
0808 04:45:00.410565 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0808 04:45:00.410629 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.240.252:37801: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
W20260808 04:45:00.410832 13670 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.240.252:37801: Network error: Client connection negotiation failed: client connection to 127.20.240.252:37801: connect: Connection refused (error 111)
I20260808 04:45:00.412298 13757 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:45:00.412518 13757 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:45:00.419581 13757 rpc_server.cc:307] RPC server started. Bound to: 127.20.240.252:37801
I20260808 04:45:00.419864 13830 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.240.252:37801 every 8 connection(s)
I20260808 04:45:00.420645 13757 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786164000593138-21443-0/minicluster-data/master-2/data/info.pb
I20260808 04:45:00.423488 13831 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:45:00.426977 13750 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.240.252" port: 37801 } attempt: 3
I20260808 04:45:00.427485 13831 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.240.254" port: 39877 } has no permanent_uuid. Determining permanent_uuid...
I20260808 04:45:00.430426 21443 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu as pid 13757
I20260808 04:45:00.430555 21443 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgby_Qd/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786164000593138-21443-0/minicluster-data/master-2/wal/instance
I20260808 04:45:00.430866 21443 external_mini_cluster.cc:1428] Setting key 127294e422c26573d50942ac4f944037
Aug 08 04:45:00 dist-test-slave-vxj2 krb5kdc[13579](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164300, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.240.253@KRBTEST.COM for kudu/127.20.240.252@KRBTEST.COM
Aug 08 04:45:00 dist-test-slave-vxj2 krb5kdc[13579](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164300, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.240.252@KRBTEST.COM for kudu/127.20.240.254@KRBTEST.COM
Aug 08 04:45:00 dist-test-slave-vxj2 krb5kdc[13579](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164299, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.240.252@KRBTEST.COM
I20260808 04:45:00.441752 13754 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:45:00.427525 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.252:37801 (local address 127.0.0.1:43554)
0808 04:45:00.427676 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0808 04:45:00.427695 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0808 04:45:00.427790 (+ 95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:45:00.430620 (+ 2830us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:45:00.430624 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:45:00.430841 (+ 217us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:45:00.430981 (+ 140us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:45:00.430990 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:45:00.432804 (+ 1814us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:45:00.432808 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:45:00.433606 (+ 798us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:45:00.433618 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:45:00.434713 (+ 1095us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:45:00.434717 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:45:00.434802 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:45:00.435399 (+ 597us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:45:00.435427 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:45:00.436952 (+ 1525us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:45:00.439575 (+ 2623us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:45:00.439580 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:45:00.439585 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:45:00.439866 (+ 281us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:45:00.440331 (+ 465us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:45:00.440338 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:45:00.440343 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:45:00.440445 (+ 102us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:45:00.441141 (+ 696us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:45:00.441144 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:45:00.441289 (+ 145us) client_negotiation.cc:769] Sending connection context
0808 04:45:00.441411 (+ 122us) client_negotiation.cc:240] Negotiation successful
0808 04:45:00.441576 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":62}
I20260808 04:45:00.443001 13674 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:45:00.430322 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44656 (local address 127.20.240.254:39877)
0808 04:45:00.430494 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0808 04:45:00.430502 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 04:45:00.431206 (+ 704us) server_negotiation.cc:407] Connection header received
0808 04:45:00.431332 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:45:00.431338 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:45:00.431404 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:45:00.431495 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:45:00.432402 (+ 907us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:45:00.433010 (+ 608us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:45:00.434444 (+ 1434us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:45:00.434797 (+ 353us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:45:00.434897 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:45:00.438925 (+ 4028us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:45:00.438934 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:45:00.438936 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:45:00.438964 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:45:00.440801 (+ 1837us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:45:00.441397 (+ 596us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:45:00.441403 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:45:00.441407 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:45:00.441549 (+ 142us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:45:00.441893 (+ 344us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:45:00.441896 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:45:00.441900 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:45:00.442155 (+ 255us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:45:00.442242 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0808 04:45:00.442706 (+ 464us) server_negotiation.cc:299] Negotiation successful
0808 04:45:00.442821 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260808 04:45:00.443122 13834 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:45:00.430188 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.254:39877 (local address 127.0.0.1:44656)
0808 04:45:00.431039 (+ 851us) negotiation.cc:107] Waiting for socket to connect
0808 04:45:00.431108 (+ 69us) client_negotiation.cc:174] Beginning negotiation
0808 04:45:00.431229 (+ 121us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:45:00.431689 (+ 460us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:45:00.431695 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:45:00.432079 (+ 384us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:45:00.432244 (+ 165us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:45:00.432255 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:45:00.433170 (+ 915us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:45:00.433174 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:45:00.434315 (+ 1141us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:45:00.434326 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:45:00.435088 (+ 762us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:45:00.435096 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:45:00.435221 (+ 125us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:45:00.436061 (+ 840us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:45:00.436111 (+ 50us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:45:00.438758 (+ 2647us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:45:00.440917 (+ 2159us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:45:00.440929 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:45:00.440938 (+ 9us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:45:00.441260 (+ 322us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:45:00.441683 (+ 423us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:45:00.441686 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:45:00.441688 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:45:00.441778 (+ 90us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:45:00.442312 (+ 534us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:45:00.442322 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:45:00.442470 (+ 148us) client_negotiation.cc:769] Sending connection context
0808 04:45:00.442630 (+ 160us) client_negotiation.cc:240] Negotiation successful
0808 04:45:00.442822 (+ 192us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":641,"mutex_wait_us":55,"thread_start_us":110,"threads_started":1}
I20260808 04:45:00.443133 13833 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:45:00.428173 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43554 (local address 127.20.240.252:37801)
0808 04:45:00.428602 (+ 429us) server_negotiation.cc:206] Beginning negotiation
0808 04:45:00.428616 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0808 04:45:00.428663 (+ 47us) server_negotiation.cc:407] Connection header received
0808 04:45:00.429462 (+ 799us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:45:00.429482 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:45:00.429887 (+ 405us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:45:00.430238 (+ 351us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:45:00.431150 (+ 912us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:45:00.432669 (+ 1519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:45:00.433737 (+ 1068us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:45:00.434576 (+ 839us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:45:00.434751 (+ 175us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:45:00.437111 (+ 2360us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:45:00.437117 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:45:00.437128 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:45:00.437202 (+ 74us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:45:00.439456 (+ 2254us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:45:00.439984 (+ 528us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:45:00.439990 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:45:00.440004 (+ 14us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:45:00.440196 (+ 192us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:45:00.440563 (+ 367us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:45:00.440566 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:45:00.440568 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:45:00.441021 (+ 453us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:45:00.441196 (+ 175us) server_negotiation.cc:1035] Waiting for connection context
0808 04:45:00.441592 (+ 396us) server_negotiation.cc:299] Negotiation successful
0808 04:45:00.441994 (+ 402us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":60,"server-negotiator.queue_time_us":293,"thread_start_us":118,"threads_started":1}
I20260808 04:45:00.444200 13837 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:45:00.431559 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43566 (local address 127.20.240.252:37801)
0808 04:45:00.432262 (+ 703us) server_negotiation.cc:206] Beginning negotiation
0808 04:45:00.432269 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 04:45:00.432281 (+ 12us) server_negotiation.cc:407] Connection header received
0808 04:45:00.432312 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:45:00.432315 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:45:00.432352 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:45:00.432424 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:45:00.433426 (+ 1002us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:45:00.434056 (+ 630us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:45:00.435173 (+ 1117us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:45:00.435493 (+ 320us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:45:00.435624 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:45:00.438839 (+ 3215us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:45:00.438843 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:45:00.438846 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:45:00.438875 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:45:00.442006 (+ 3131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:45:00.442501 (+ 495us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:45:00.442504 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:45:00.442506 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:45:00.442593 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:45:00.442920 (+ 327us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:45:00.442923 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:45:00.442924 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:45:00.443556 (+ 632us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:45:00.443713 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0808 04:45:00.443954 (+ 241us) server_negotiation.cc:299] Negotiation successful
0808 04:45:00.444046 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":35,"server-negotiator.queue_time_us":638,"thread_start_us":150,"threads_started":1}
I20260808 04:45:00.445564 13831 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.240.253" port: 35833 } has no permanent_uuid. Determining permanent_uuid...
I20260808 04:45:00.447805 13750 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b4c3bf2e13c047d094ae3c505f9d0d29: Bootstrap starting.
Aug 08 04:45:00 dist-test-slave-vxj2 krb5kdc[13579](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164300, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.240.252@KRBTEST.COM for kudu/127.20.240.253@KRBTEST.COM
I20260808 04:45:00.450678 13750 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b4c3bf2e13c047d094ae3c505f9d0d29: Neither blocks nor log segments found. Creating new log.
I20260808 04:45:00.451666 13750 log.cc:824] T 00000000000000000000000000000000 P b4c3bf2e13c047d094ae3c505f9d0d29: Log is configured to *not* fsync() on all Append() calls
I20260808 04:45:00.454689 13750 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b4c3bf2e13c047d094ae3c505f9d0d29: No bootstrap required, opened a new log
I20260808 04:45:00.454723 13752 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:45:00.446343 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35822 (local address 127.20.240.253:35833)
0808 04:45:00.446478 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0808 04:45:00.446482 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:45:00.446512 (+ 30us) server_negotiation.cc:407] Connection header received
0808 04:45:00.446547 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:45:00.446550 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:45:00.446595 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:45:00.446680 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:45:00.447082 (+ 402us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:45:00.447583 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:45:00.448419 (+ 836us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:45:00.448654 (+ 235us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:45:00.448767 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:45:00.450975 (+ 2208us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:45:00.450981 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:45:00.450985 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:45:00.451015 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:45:00.452570 (+ 1555us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:45:00.453114 (+ 544us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:45:00.453119 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:45:00.453122 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:45:00.453271 (+ 149us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:45:00.453624 (+ 353us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:45:00.453631 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:45:00.453634 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:45:00.453959 (+ 325us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:45:00.454039 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0808 04:45:00.454452 (+ 413us) server_negotiation.cc:299] Negotiation successful
0808 04:45:00.454562 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
Aug 08 04:45:00 dist-test-slave-vxj2 krb5kdc[13579](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164299, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.240.254@KRBTEST.COM
I20260808 04:45:00.454725 13834 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:45:00.446109 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.253:35833 (local address 127.0.0.1:35822)
0808 04:45:00.446200 (+ 91us) negotiation.cc:107] Waiting for socket to connect
0808 04:45:00.446210 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 04:45:00.446263 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:45:00.446695 (+ 432us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:45:00.446698 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:45:00.446870 (+ 172us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:45:00.446965 (+ 95us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:45:00.446971 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:45:00.447693 (+ 722us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:45:00.447698 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:45:00.448297 (+ 599us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:45:00.448306 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:45:00.448766 (+ 460us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:45:00.448770 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:45:00.448879 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:45:00.449414 (+ 535us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:45:00.449428 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:45:00.450819 (+ 1391us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:45:00.452668 (+ 1849us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:45:00.452675 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:45:00.452679 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:45:00.452930 (+ 251us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:45:00.453374 (+ 444us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:45:00.453378 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:45:00.453380 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:45:00.453485 (+ 105us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:45:00.454124 (+ 639us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:45:00.454126 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:45:00.454245 (+ 119us) client_negotiation.cc:769] Sending connection context
0808 04:45:00.454391 (+ 146us) client_negotiation.cc:240] Negotiation successful
0808 04:45:00.454550 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":31}
I20260808 04:45:00.455919 13831 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.240.252" port: 37801 } has no permanent_uuid. Determining permanent_uuid...
I20260808 04:45:00.459064 13750 raft_consensus.cc:348] T 00000000000000000000000000000000 P b4c3bf2e13c047d094ae3c505f9d0d29 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f98e9b9720634847b02c2456884bad66" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 39877 } } peers { permanent_uuid: "b4c3bf2e13c047d094ae3c505f9d0d29" member_type: VOTER last_known_addr { host: "127.20.240.253" port: 35833 } } peers { permanent_uuid: "638d4f10aff647c8be157e8b3dade74d" member_type: VOTER last_known_addr { host: "127.20.240.252" port: 37801 } }
I20260808 04:45:00.459365 13750 raft_consensus.cc:729] T 00000000000000000000000000000000 P b4c3bf2e13c047d094ae3c505f9d0d29 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b4c3bf2e13c047d094ae3c505f9d0d29, State: Initialized, Role: FOLLOWER
I20260808 04:45:00.459594 13674 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:45:00.445991 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44660 (local address 127.20.240.254:39877)
0808 04:45:00.449351 (+ 3360us) server_negotiation.cc:206] Beginning negotiation
0808 04:45:00.449358 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 04:45:00.449373 (+ 15us) server_negotiation.cc:407] Connection header received
0808 04:45:00.449414 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:45:00.449417 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:45:00.449468 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:45:00.449561 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:45:00.450352 (+ 791us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:45:00.451063 (+ 711us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:45:00.452129 (+ 1066us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:45:00.452375 (+ 246us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:45:00.452489 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:45:00.455660 (+ 3171us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:45:00.455664 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:45:00.455669 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:45:00.455700 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:45:00.457456 (+ 1756us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:45:00.457914 (+ 458us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:45:00.457918 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:45:00.457920 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:45:00.458012 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:45:00.458335 (+ 323us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:45:00.458338 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:45:00.458340 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:45:00.458532 (+ 192us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:45:00.458786 (+ 254us) server_negotiation.cc:1035] Waiting for connection context
0808 04:45:00.459279 (+ 493us) server_negotiation.cc:299] Negotiation successful
0808 04:45:00.459415 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3229}
I20260808 04:45:00.459750 13750 consensus_queue.cc:260] T 00000000000000000000000000000000 P b4c3bf2e13c047d094ae3c505f9d0d29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f98e9b9720634847b02c2456884bad66" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 39877 } } peers { permanent_uuid: "b4c3bf2e13c047d094ae3c505f9d0d29" member_type: VOTER last_known_addr { host: "127.20.240.253" port: 35833 } } peers { permanent_uuid: "638d4f10aff647c8be157e8b3dade74d" member_type: VOTER last_known_addr { host: "127.20.240.252" port: 37801 } }
I20260808 04:45:00.460286 13839 sys_catalog.cc:455] T 00000000000000000000000000000000 P b4c3bf2e13c047d094ae3c505f9d0d29 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f98e9b9720634847b02c2456884bad66" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 39877 } } peers { permanent_uuid: "b4c3bf2e13c047d094ae3c505f9d0d29" member_type: VOTER last_known_addr { host: "127.20.240.253" port: 35833 } } peers { permanent_uuid: "638d4f10aff647c8be157e8b3dade74d" member_type: VOTER last_known_addr { host: "127.20.240.252" port: 37801 } } }
I20260808 04:45:00.460438 13839 sys_catalog.cc:458] T 00000000000000000000000000000000 P b4c3bf2e13c047d094ae3c505f9d0d29 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 04:45:00.461479 13750 sys_catalog.cc:564] T 00000000000000000000000000000000 P b4c3bf2e13c047d094ae3c505f9d0d29 [sys.catalog]: configured and running, proceeding with master startup.
Aug 08 04:45:00 dist-test-slave-vxj2 krb5kdc[13579](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164300, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.240.252@KRBTEST.COM for kudu/127.20.240.252@KRBTEST.COM
Aug 08 04:45:00 dist-test-slave-vxj2 krb5kdc[13579](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164299, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.240.253@KRBTEST.COM
I20260808 04:45:00.467820 13834 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:45:00.456442 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.252:37801 (local address 127.0.0.1:43582)
0808 04:45:00.456601 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0808 04:45:00.456651 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0808 04:45:00.457273 (+ 622us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:45:00.457633 (+ 360us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:45:00.457636 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:45:00.457817 (+ 181us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:45:00.457901 (+ 84us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:45:00.457908 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:45:00.458877 (+ 969us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:45:00.458881 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:45:00.460491 (+ 1610us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:45:00.460693 (+ 202us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:45:00.461496 (+ 803us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:45:00.461503 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:45:00.461639 (+ 136us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:45:00.462330 (+ 691us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:45:00.462351 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:45:00.463984 (+ 1633us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:45:00.466185 (+ 2201us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:45:00.466187 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:45:00.466190 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:45:00.466426 (+ 236us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:45:00.466692 (+ 266us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:45:00.466694 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:45:00.466696 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:45:00.466766 (+ 70us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:45:00.467296 (+ 530us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:45:00.467308 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:45:00.467396 (+ 88us) client_negotiation.cc:769] Sending connection context
0808 04:45:00.467498 (+ 102us) client_negotiation.cc:240] Negotiation successful
0808 04:45:00.467638 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":69}
I20260808 04:45:00.468333 13837 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:45:00.456508 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43582 (local address 127.20.240.252:37801)
0808 04:45:00.456614 (+ 106us) server_negotiation.cc:206] Beginning negotiation
0808 04:45:00.456618 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:45:00.456693 (+ 75us) server_negotiation.cc:407] Connection header received
0808 04:45:00.457396 (+ 703us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:45:00.457400 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:45:00.457456 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:45:00.457536 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:45:00.458021 (+ 485us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:45:00.458775 (+ 754us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:45:00.460808 (+ 2033us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:45:00.461253 (+ 445us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:45:00.461375 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:45:00.464140 (+ 2765us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:45:00.464146 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:45:00.464149 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:45:00.464176 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:45:00.466078 (+ 1902us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:45:00.466539 (+ 461us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:45:00.466542 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:45:00.466544 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:45:00.466613 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:45:00.466850 (+ 237us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:45:00.466853 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:45:00.466855 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:45:00.467171 (+ 316us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:45:00.467264 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0808 04:45:00.468015 (+ 751us) server_negotiation.cc:299] Negotiation successful
0808 04:45:00.468149 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
W20260808 04:45:00.469192 13852 catalog_manager.cc:1558] T 00000000000000000000000000000000 P b4c3bf2e13c047d094ae3c505f9d0d29: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 04:45:00.469347 13852 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 04:45:00.471975 13752 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:45:00.461346 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35824 (local address 127.20.240.253:35833)
0808 04:45:00.461467 (+ 121us) server_negotiation.cc:206] Beginning negotiation
0808 04:45:00.461471 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:45:00.461575 (+ 104us) server_negotiation.cc:407] Connection header received
0808 04:45:00.461687 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:45:00.461690 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:45:00.461740 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:45:00.461824 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:45:00.462692 (+ 868us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:45:00.463302 (+ 610us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:45:00.464442 (+ 1140us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:45:00.464744 (+ 302us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:45:00.464819 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:45:00.467823 (+ 3004us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:45:00.467827 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:45:00.467830 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:45:00.467860 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:45:00.469757 (+ 1897us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:45:00.470247 (+ 490us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:45:00.470251 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:45:00.470253 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:45:00.470339 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:45:00.470654 (+ 315us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:45:00.470661 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:45:00.470664 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:45:00.470876 (+ 212us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:45:00.471084 (+ 208us) server_negotiation.cc:1035] Waiting for connection context
0808 04:45:00.471720 (+ 636us) server_negotiation.cc:299] Negotiation successful
0808 04:45:00.471839 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260808 04:45:00.472126 13831 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 638d4f10aff647c8be157e8b3dade74d: Bootstrap starting.
I20260808 04:45:00.474948 13831 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 638d4f10aff647c8be157e8b3dade74d: Neither blocks nor log segments found. Creating new log.
I20260808 04:45:00.475798 21443 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 04:45:00.475907 13831 log.cc:824] T 00000000000000000000000000000000 P 638d4f10aff647c8be157e8b3dade74d: Log is configured to *not* fsync() on all Append() calls
I20260808 04:45:00.465952 13677 master_runner.cc:186] Error getting master registration for 127.20.240.254:39877: OK, instance_id { permanent_uuid: "f98e9b9720634847b02c2456884bad66" instance_seqno: 1786164299928491 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260808 04:45:00.478480 13677 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260808 04:45:00.477111 13641 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "f98e9b9720634847b02c2456884bad66"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44660
I20260808 04:45:00.480067 13831 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 638d4f10aff647c8be157e8b3dade74d: No bootstrap required, opened a new log
I20260808 04:45:00.484344 13831 raft_consensus.cc:348] T 00000000000000000000000000000000 P 638d4f10aff647c8be157e8b3dade74d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f98e9b9720634847b02c2456884bad66" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 39877 } } peers { permanent_uuid: "b4c3bf2e13c047d094ae3c505f9d0d29" member_type: VOTER last_known_addr { host: "127.20.240.253" port: 35833 } } peers { permanent_uuid: "638d4f10aff647c8be157e8b3dade74d" member_type: VOTER last_known_addr { host: "127.20.240.252" port: 37801 } }
I20260808 04:45:00.484601 13831 raft_consensus.cc:729] T 00000000000000000000000000000000 P 638d4f10aff647c8be157e8b3dade74d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 638d4f10aff647c8be157e8b3dade74d, State: Initialized, Role: FOLLOWER
I20260808 04:45:00.484958 13831 consensus_queue.cc:260] T 00000000000000000000000000000000 P 638d4f10aff647c8be157e8b3dade74d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f98e9b9720634847b02c2456884bad66" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 39877 } } peers { permanent_uuid: "b4c3bf2e13c047d094ae3c505f9d0d29" member_type: VOTER last_known_addr { host: "127.20.240.253" port: 35833 } } peers { permanent_uuid: "638d4f10aff647c8be157e8b3dade74d" member_type: VOTER last_known_addr { host: "127.20.240.252" port: 37801 } }
I20260808 04:45:00.485543 13855 sys_catalog.cc:455] T 00000000000000000000000000000000 P 638d4f10aff647c8be157e8b3dade74d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f98e9b9720634847b02c2456884bad66" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 39877 } } peers { permanent_uuid: "b4c3bf2e13c047d094ae3c505f9d0d29" member_type: VOTER last_known_addr { host: "127.20.240.253" port: 35833 } } peers { permanent_uuid: "638d4f10aff647c8be157e8b3dade74d" member_type: VOTER last_known_addr { host: "127.20.240.252" port: 37801 } } }
I20260808 04:45:00.485692 13855 sys_catalog.cc:458] T 00000000000000000000000000000000 P 638d4f10aff647c8be157e8b3dade74d [sys.catalog]: This master's current role is: FOLLOWER
I20260808 04:45:00.486429 13831 sys_catalog.cc:564] T 00000000000000000000000000000000 P 638d4f10aff647c8be157e8b3dade74d [sys.catalog]: configured and running, proceeding with master startup.
W20260808 04:45:00.492787 13867 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 638d4f10aff647c8be157e8b3dade74d: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 04:45:00.492879 13867 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 04:45:00.490963 13757 master_runner.cc:186] Error getting master registration for 127.20.240.254:39877: OK, instance_id { permanent_uuid: "f98e9b9720634847b02c2456884bad66" instance_seqno: 1786164299928491 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260808 04:45:00.494534 13757 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260808 04:45:00.574998 13670 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.240.252" port: 37801 } attempt: 4
Aug 08 04:45:00 dist-test-slave-vxj2 krb5kdc[13579](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164299, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.240.254@KRBTEST.COM for kudu/127.20.240.252@KRBTEST.COM
I20260808 04:45:00.586977 13837 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:45:00.576451 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43586 (local address 127.20.240.252:37801)
0808 04:45:00.576597 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0808 04:45:00.576602 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 04:45:00.576616 (+ 14us) server_negotiation.cc:407] Connection header received
0808 04:45:00.576664 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:45:00.576667 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:45:00.576714 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:45:00.576792 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:45:00.577554 (+ 762us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:45:00.578363 (+ 809us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:45:00.579533 (+ 1170us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:45:00.579881 (+ 348us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:45:00.579976 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:45:00.582897 (+ 2921us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:45:00.582901 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:45:00.582904 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:45:00.582935 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:45:00.584915 (+ 1980us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:45:00.585499 (+ 584us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:45:00.585503 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:45:00.585505 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:45:00.585594 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:45:00.585891 (+ 297us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:45:00.585895 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:45:00.585896 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:45:00.586124 (+ 228us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:45:00.586212 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0808 04:45:00.586667 (+ 455us) server_negotiation.cc:299] Negotiation successful
0808 04:45:00.586800 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260808 04:45:00.587847 13673 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:45:00.575706 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.240.252:37801 (local address 127.0.0.1:43586)
0808 04:45:00.576108 (+ 402us) negotiation.cc:107] Waiting for socket to connect
0808 04:45:00.576125 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 04:45:00.576265 (+ 140us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:45:00.576935 (+ 670us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:45:00.576938 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:45:00.577228 (+ 290us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:45:00.577385 (+ 157us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:45:00.577398 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:45:00.578513 (+ 1115us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:45:00.578517 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:45:00.579385 (+ 868us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:45:00.579397 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:45:00.580121 (+ 724us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:45:00.580125 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:45:00.580214 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:45:00.580832 (+ 618us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:45:00.580848 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:45:00.582722 (+ 1874us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:45:00.585048 (+ 2326us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:45:00.585052 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:45:00.585054 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:45:00.585383 (+ 329us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:45:00.585695 (+ 312us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:45:00.585699 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:45:00.585701 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:45:00.585791 (+ 90us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:45:00.586267 (+ 476us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:45:00.586270 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:45:00.586372 (+ 102us) client_negotiation.cc:769] Sending connection context
0808 04:45:00.586460 (+ 88us) client_negotiation.cc:240] Negotiation successful
0808 04:45:00.587683 (+ 1223us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":296}
I20260808 04:45:00.591416 13670 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f98e9b9720634847b02c2456884bad66: Bootstrap starting.
I20260808 04:45:00.594705 13670 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f98e9b9720634847b02c2456884bad66: Neither blocks nor log segments found. Creating new log.
I20260808 04:45:00.595738 13670 log.cc:824] T 00000000000000000000000000000000 P f98e9b9720634847b02c2456884bad66: Log is configured to *not* fsync() on all Append() calls
I20260808 04:45:00.598841 13670 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f98e9b9720634847b02c2456884bad66: No bootstrap required, opened a new log
I20260808 04:45:00.603840 13670 raft_consensus.cc:348] T 00000000000000000000000000000000 P f98e9b9720634847b02c2456884bad66 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f98e9b9720634847b02c2456884bad66" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 39877 } } peers { permanent_uuid: "b4c3bf2e13c047d094ae3c505f9d0d29" member_type: VOTER last_known_addr { host: "127.20.240.253" port: 35833 } } peers { permanent_uuid: "638d4f10aff647c8be157e8b3dade74d" member_type: VOTER last_known_addr { host: "127.20.240.252" port: 37801 } }
I20260808 04:45:00.604328 13670 raft_consensus.cc:729] T 00000000000000000000000000000000 P f98e9b9720634847b02c2456884bad66 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f98e9b9720634847b02c2456884bad66, State: Initialized, Role: FOLLOWER
I20260808 04:45:00.604904 13670 consensus_queue.cc:260] T 00000000000000000000000000000000 P f98e9b9720634847b02c2456884bad66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f98e9b9720634847b02c2456884bad66" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 39877 } } peers { permanent_uuid: "b4c3bf2e13c047d094ae3c505f9d0d29" member_type: VOTER last_known_addr { host: "127.20.240.253" port: 35833 } } peers { permanent_uuid: "638d4f10aff647c8be157e8b3dade74d" member_type: VOTER last_known_addr { host: "127.20.240.252" port: 37801 } }
I20260808 04:45:00.605777 13870 sys_catalog.cc:455] T 00000000000000000000000000000000 P f98e9b9720634847b02c2456884bad66 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f98e9b9720634847b02c2456884bad66" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 39877 } } peers { permanent_uuid: "b4c3bf2e13c047d094ae3c505f9d0d29" member_type: VOTER last_known_addr { host: "127.20.240.253" port: 35833 } } peers { permanent_uuid: "638d4f10aff647c8be157e8b3dade74d" member_type: VOTER last_known_addr { host: "127.20.240.252" port: 37801 } } }
I20260808 04:45:00.605950 13870 sys_catalog.cc:458] T 00000000000000000000000000000000 P f98e9b9720634847b02c2456884bad66 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 04:45:00.607492 13641 raft_consensus.cc:482] T 00000000000000000000000000000000 P f98e9b9720634847b02c2456884bad66 [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260808 04:45:00.607622 13641 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f98e9b9720634847b02c2456884bad66 [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:45:00.607415 13670 sys_catalog.cc:564] T 00000000000000000000000000000000 P f98e9b9720634847b02c2456884bad66 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 04:45:00.609006 13641 raft_consensus.cc:504] T 00000000000000000000000000000000 P f98e9b9720634847b02c2456884bad66 [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f98e9b9720634847b02c2456884bad66" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 39877 } } peers { permanent_uuid: "b4c3bf2e13c047d094ae3c505f9d0d29" member_type: VOTER last_known_addr { host: "127.20.240.253" port: 35833 } } peers { permanent_uuid: "638d4f10aff647c8be157e8b3dade74d" member_type: VOTER last_known_addr { host: "127.20.240.252" port: 37801 } }
I20260808 04:45:00.610061 13641 leader_election.cc:288] T 00000000000000000000000000000000 P f98e9b9720634847b02c2456884bad66 [CANDIDATE]: Term 1 election: Requested vote from peers b4c3bf2e13c047d094ae3c505f9d0d29 (127.20.240.253:35833), 638d4f10aff647c8be157e8b3dade74d (127.20.240.252:37801)
I20260808 04:45:00.611542 13804 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "f98e9b9720634847b02c2456884bad66" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "638d4f10aff647c8be157e8b3dade74d"
I20260808 04:45:00.611793 13804 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 638d4f10aff647c8be157e8b3dade74d [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:45:00.613101 13804 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 638d4f10aff647c8be157e8b3dade74d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f98e9b9720634847b02c2456884bad66 in term 1.
I20260808 04:45:00.613651 13723 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "f98e9b9720634847b02c2456884bad66" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "b4c3bf2e13c047d094ae3c505f9d0d29"
I20260808 04:45:00.613896 13723 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b4c3bf2e13c047d094ae3c505f9d0d29 [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:45:00.615278 13723 raft_consensus.cc:2454] T 00000000000000000000000000000000 P b4c3bf2e13c047d094ae3c505f9d0d29 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f98e9b9720634847b02c2456884bad66 in term 1.
I20260808 04:45:00.618861 13611 leader_election.cc:302] T 00000000000000000000000000000000 P f98e9b9720634847b02c2456884bad66 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b4c3bf2e13c047d094ae3c505f9d0d29, f98e9b9720634847b02c2456884bad66; no voters:
I20260808 04:45:00.619184 13870 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f98e9b9720634847b02c2456884bad66 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 04:45:00.619416 13870 raft_consensus.cc:686] T 00000000000000000000000000000000 P f98e9b9720634847b02c2456884bad66 [term 1 LEADER]: Becoming Leader. State: Replica: f98e9b9720634847b02c2456884bad66, State: Running, Role: LEADER
I20260808 04:45:00.619758 13870 consensus_queue.cc:237] T 00000000000000000000000000000000 P f98e9b9720634847b02c2456884bad66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f98e9b9720634847b02c2456884bad66" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 39877 } } peers { permanent_uuid: "b4c3bf2e13c047d094ae3c505f9d0d29" member_type: VOTER last_known_addr { host: "127.20.240.253" port: 35833 } } peers { permanent_uuid: "638d4f10aff647c8be157e8b3dade74d" member_type: VOTER last_known_addr { host: "127.20.240.252" port: 37801 } }
I20260808 04:45:00.621609 13870 sys_catalog.cc:455] T 00000000000000000000000000000000 P f98e9b9720634847b02c2456884bad66 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f98e9b9720634847b02c2456884bad66. Latest consensus state: current_term: 1 leader_uuid: "f98e9b9720634847b02c2456884bad66" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f98e9b9720634847b02c2456884bad66" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 39877 } } peers { permanent_uuid: "b4c3bf2e13c047d094ae3c505f9d0d29" member_type: VOTER last_known_addr { host: "127.20.240.253" port: 35833 } } peers { permanent_uuid: "638d4f10aff647c8be157e8b3dade74d" member_type: VOTER last_known_addr { host: "127.20.240.252" port: 37801 } } }
I20260808 04:45:00.621726 13870 sys_catalog.cc:458] T 00000000000000000000000000000000 P f98e9b9720634847b02c2456884bad66 [sys.catalog]: This master's current role is: LEADER
I20260808 04:45:00.627444 13592 master_runner.cc:263] No leader master found from master f98e9b9720634847b02c2456884bad66
I20260808 04:45:00.627537 13592 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260808 04:45:00.615550 13881 catalog_manager.cc:1558] T 00000000000000000000000000000000 P f98e9b9720634847b02c2456884bad66: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 04:45:00.627595 13881 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 04:45:00.627888 13890 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 04:45:00.628854 13890 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 04:45:00.636304 13804 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 638d4f10aff647c8be157e8b3dade74d [term 1 FOLLOWER]: Refusing update from remote peer f98e9b9720634847b02c2456884bad66: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 04:45:00.637040 13870 consensus_queue.cc:1035] T 00000000000000000000000000000000 P f98e9b9720634847b02c2456884bad66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "638d4f10aff647c8be157e8b3dade74d" member_type: VOTER last_known_addr { host: "127.20.240.252" port: 37801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 04:45:00.641461 13855 sys_catalog.cc:455] T 00000000000000000000000000000000 P 638d4f10aff647c8be157e8b3dade74d [sys.catalog]: SysCatalogTable state changed. Reason: New leader f98e9b9720634847b02c2456884bad66. Latest consensus state: current_term: 1 leader_uuid: "f98e9b9720634847b02c2456884bad66" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f98e9b9720634847b02c2456884bad66" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 39877 } } peers { permanent_uuid: "b4c3bf2e13c047d094ae3c505f9d0d29" member_type: VOTER last_known_addr { host: "127.20.240.253" port: 35833 } } peers { permanent_uuid: "638d4f10aff647c8be157e8b3dade74d" member_type: VOTER last_known_addr { host: "127.20.240.252" port: 37801 } } }
I20260808 04:45:00.641606 13855 sys_catalog.cc:458] T 00000000000000000000000000000000 P 638d4f10aff647c8be157e8b3dade74d [sys.catalog]: This master's current role is: FOLLOWER
I20260808 04:45:00.642814 13723 raft_consensus.cc:1261] T 00000000000000000000000000000000 P b4c3bf2e13c047d094ae3c505f9d0d29 [term 1 FOLLOWER]: Refusing update from remote peer f98e9b9720634847b02c2456884bad66: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 04:45:00.643522 13870 consensus_queue.cc:1035] T 00000000000000000000000000000000 P f98e9b9720634847b02c2456884bad66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4c3bf2e13c047d094ae3c505f9d0d29" member_type: VOTER last_known_addr { host: "127.20.240.253" port: 35833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 04:45:00.645004 13752 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:45:00.621564 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35830 (local address 127.20.240.253:35833)
0808 04:45:00.621685 (+ 121us) server_negotiation.cc:206] Beginning negotiation
0808 04:45:00.621689 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:45:00.633413 (+ 11724us) server_negotiation.cc:407] Connection header received
0808 04:45:00.633583 (+ 170us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:45:00.633586 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:45:00.633633 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:45:00.633681 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:45:00.634620 (+ 939us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:45:00.635333 (+ 713us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:45:00.636492 (+ 1159us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:45:00.636814 (+ 322us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:45:00.636891 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:45:00.638975 (+ 2084us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:45:00.638980 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:45:00.638984 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:45:00.639017 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:45:00.641245 (+ 2228us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:45:00.642837 (+ 1592us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:45:00.642843 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:45:00.642846 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:45:00.642951 (+ 105us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:45:00.643762 (+ 811us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:45:00.643766 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:45:00.643767 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:45:00.644042 (+ 275us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:45:00.644165 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0808 04:45:00.644648 (+ 483us) server_negotiation.cc:299] Negotiation successful
0808 04:45:00.644815 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260808 04:45:00.647809 13837 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:45:00.619487 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43592 (local address 127.20.240.252:37801)
0808 04:45:00.619619 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0808 04:45:00.619624 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 04:45:00.628001 (+ 8377us) server_negotiation.cc:407] Connection header received
0808 04:45:00.628598 (+ 597us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:45:00.628601 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:45:00.628653 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:45:00.628707 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:45:00.630979 (+ 2272us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:45:00.631780 (+ 801us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:45:00.636568 (+ 4788us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:45:00.636914 (+ 346us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:45:00.636995 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:45:00.641872 (+ 4877us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:45:00.641878 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:45:00.641883 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:45:00.641915 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:45:00.645733 (+ 3818us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:45:00.646243 (+ 510us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:45:00.646247 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:45:00.646249 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:45:00.646338 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:45:00.646679 (+ 341us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:45:00.646685 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:45:00.646690 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:45:00.646954 (+ 264us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:45:00.647076 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0808 04:45:00.647453 (+ 377us) server_negotiation.cc:299] Negotiation successful
0808 04:45:00.647586 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260808 04:45:00.648212 13674 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:45:00.620286 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44670 (local address 127.20.240.254:39877)
0808 04:45:00.620396 (+ 110us) server_negotiation.cc:206] Beginning negotiation
0808 04:45:00.620400 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:45:00.628273 (+ 7873us) server_negotiation.cc:407] Connection header received
0808 04:45:00.629036 (+ 763us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:45:00.629039 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:45:00.629091 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:45:00.629141 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:45:00.633004 (+ 3863us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:45:00.633698 (+ 694us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:45:00.637398 (+ 3700us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:45:00.637770 (+ 372us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:45:00.637853 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:45:00.643384 (+ 5531us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:45:00.643389 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:45:00.643392 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:45:00.643424 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:45:00.645206 (+ 1782us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:45:00.646554 (+ 1348us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:45:00.646559 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:45:00.646560 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:45:00.646656 (+ 96us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:45:00.647075 (+ 419us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:45:00.647079 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:45:00.647081 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:45:00.647323 (+ 242us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:45:00.647426 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0808 04:45:00.647915 (+ 489us) server_negotiation.cc:299] Negotiation successful
0808 04:45:00.648061 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260808 04:45:00.648979 13839 sys_catalog.cc:455] T 00000000000000000000000000000000 P b4c3bf2e13c047d094ae3c505f9d0d29 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f98e9b9720634847b02c2456884bad66. Latest consensus state: current_term: 1 leader_uuid: "f98e9b9720634847b02c2456884bad66" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f98e9b9720634847b02c2456884bad66" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 39877 } } peers { permanent_uuid: "b4c3bf2e13c047d094ae3c505f9d0d29" member_type: VOTER last_known_addr { host: "127.20.240.253" port: 35833 } } peers { permanent_uuid: "638d4f10aff647c8be157e8b3dade74d" member_type: VOTER last_known_addr { host: "127.20.240.252" port: 37801 } } }
I20260808 04:45:00.649103 13839 sys_catalog.cc:458] T 00000000000000000000000000000000 P b4c3bf2e13c047d094ae3c505f9d0d29 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 04:45:00.655992 13887 sys_catalog.cc:455] T 00000000000000000000000000000000 P f98e9b9720634847b02c2456884bad66 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "f98e9b9720634847b02c2456884bad66" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f98e9b9720634847b02c2456884bad66" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 39877 } } peers { permanent_uuid: "b4c3bf2e13c047d094ae3c505f9d0d29" member_type: VOTER last_known_addr { host: "127.20.240.253" port: 35833 } } peers { permanent_uuid: "638d4f10aff647c8be157e8b3dade74d" member_type: VOTER last_known_addr { host: "127.20.240.252" port: 37801 } } }
I20260808 04:45:00.656183 13887 sys_catalog.cc:458] T 00000000000000000000000000000000 P f98e9b9720634847b02c2456884bad66 [sys.catalog]: This master's current role is: LEADER
I20260808 04:45:00.659471 13839 sys_catalog.cc:455] T 00000000000000000000000000000000 P b4c3bf2e13c047d094ae3c505f9d0d29 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "f98e9b9720634847b02c2456884bad66" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f98e9b9720634847b02c2456884bad66" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 39877 } } peers { permanent_uuid: "b4c3bf2e13c047d094ae3c505f9d0d29" member_type: VOTER last_known_addr { host: "127.20.240.253" port: 35833 } } peers { permanent_uuid: "638d4f10aff647c8be157e8b3dade74d" member_type: VOTER last_known_addr { host: "127.20.240.252" port: 37801 } } }
I20260808 04:45:00.659621 13839 sys_catalog.cc:458] T 00000000000000000000000000000000 P b4c3bf2e13c047d094ae3c505f9d0d29 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 04:45:00.660790 13893 mvcc.cc:205] Tried to move back new op lower bound from 7316128975397998592 to 7316128975341867008. Current Snapshot: MvccSnapshot[applied={T|T < 7316128975397998592}]
I20260808 04:45:00.662312 13896 mvcc.cc:205] Tried to move back new op lower bound from 7316128975397998592 to 7316128975341867008. Current Snapshot: MvccSnapshot[applied={T|T < 7316128975397998592}]
I20260808 04:45:00.662726 13870 sys_catalog.cc:455] T 00000000000000000000000000000000 P f98e9b9720634847b02c2456884bad66 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "f98e9b9720634847b02c2456884bad66" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f98e9b9720634847b02c2456884bad66" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 39877 } } peers { permanent_uuid: "b4c3bf2e13c047d094ae3c505f9d0d29" member_type: VOTER last_known_addr { host: "127.20.240.253" port: 35833 } } peers { permanent_uuid: "638d4f10aff647c8be157e8b3dade74d" member_type: VOTER last_known_addr { host: "127.20.240.252" port: 37801 } } }
I20260808 04:45:00.662864 13870 sys_catalog.cc:458] T 00000000000000000000000000000000 P f98e9b9720634847b02c2456884bad66 [sys.catalog]: This master's current role is: LEADER
I20260808 04:45:00.664251 13855 sys_catalog.cc:455] T 00000000000000000000000000000000 P 638d4f10aff647c8be157e8b3dade74d [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "f98e9b9720634847b02c2456884bad66" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f98e9b9720634847b02c2456884bad66" member_type: VOTER last_known_addr { host: "127.20.240.254" port: 39877 } } peers { permanent_uuid: "b4c3bf2e13c047d094ae3c505f9d0d29" member_type: VOTER last_known_addr { host: "127.20.240.253" port: 35833 } } peers { permanent_uuid: "638d4f10aff647c8be157e8b3dade74d" member_type: VOTER last_known_addr { host: "127.20.240.252" port: 37801 } } }
I20260808 04:45:00.664381 13855 sys_catalog.cc:458] T 00000000000000000000000000000000 P 638d4f10aff647c8be157e8b3dade74d [sys.catalog]: This master's current role is: FOLLOWER
I20260808 04:45:00.668284 13894 mvcc.cc:205] Tried to move back new op lower bound from 7316128975397998592 to 7316128975341867008. Current Snapshot: MvccSnapshot[applied={T|T < 7316128975397998592}]
I20260808 04:45:00.671896 13890 catalog_manager.cc:1347] Generated new cluster ID: 642ffdac431e4f95a486441bd32f36cd
I20260808 04:45:00.671986 13890 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 04:45:00.697234 13890 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 04:45:00.698580 13890 catalog_manager.cc:1504] Loading token signing keys...
I20260808 04:45:00.705945 13890 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f98e9b9720634847b02c2456884bad66: Generated new TSK 0
I20260808 04:45:00.706980 13890 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260808 04:45:00.740096 13752 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 04:45:00.738479 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35832 (local address 127.20.240.253:35833)
0808 04:45:00.738606 (+ 127us) server_negotiation.cc:206] Beginning negotiation
0808 04:45:00.738610 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:45:00.738872 (+ 262us) server_negotiation.cc:407] Connection header received
0808 04:45:00.739093 (+ 221us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:45:00.739097 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:45:00.739152 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:45:00.739207 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:45:00.739941 (+ 734us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35832: BlockingRecv error: recv got EOF from 127.0.0.1:35832 (error 108)
Metrics: {"server-negotiator.queue_time_us":39}
W20260808 04:45:00.740096 13837 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 04:45:00.738521 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43600 (local address 127.20.240.252:37801)
0808 04:45:00.738649 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0808 04:45:00.738653 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:45:00.738855 (+ 202us) server_negotiation.cc:407] Connection header received
0808 04:45:00.739103 (+ 248us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:45:00.739107 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:45:00.739158 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:45:00.739215 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:45:00.739929 (+ 714us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:43600: BlockingRecv error: recv got EOF from 127.0.0.1:43600 (error 108)
Metrics: {"server-negotiator.queue_time_us":41}
W20260808 04:45:00.740097 13674 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 04:45:00.738078 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44676 (local address 127.20.240.254:39877)
0808 04:45:00.738458 (+ 380us) server_negotiation.cc:206] Beginning negotiation
0808 04:45:00.738463 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 04:45:00.738884 (+ 421us) server_negotiation.cc:407] Connection header received
0808 04:45:00.739121 (+ 237us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:45:00.739124 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:45:00.739174 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:45:00.739227 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:45:00.739949 (+ 722us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:44676: BlockingRecv error: recv got EOF from 127.0.0.1:44676 (error 108)
Metrics: {"server-negotiator.queue_time_us":287}
W20260808 04:45:00.743636 13752 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 04:45:00.742598 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35838 (local address 127.20.240.253:35833)
0808 04:45:00.742768 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0808 04:45:00.742772 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:45:00.742841 (+ 69us) server_negotiation.cc:407] Connection header received
0808 04:45:00.742990 (+ 149us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:45:00.742993 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:45:00.743072 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:45:00.743153 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:45:00.743525 (+ 372us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35838: BlockingRecv error: recv got EOF from 127.0.0.1:35838 (error 108)
Metrics: {"server-negotiator.queue_time_us":94}
W20260808 04:45:00.748004 13752 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 04:45:00.747182 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35842 (local address 127.20.240.253:35833)
0808 04:45:00.747316 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0808 04:45:00.747320 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:45:00.747335 (+ 15us) server_negotiation.cc:407] Connection header received
0808 04:45:00.747381 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:45:00.747384 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:45:00.747432 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:45:00.747512 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:45:00.747898 (+ 386us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35842: BlockingRecv error: recv got EOF from 127.0.0.1:35842 (error 108)
Metrics: {"server-negotiator.queue_time_us":56}
W20260808 04:45:00.752817 13752 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 04:45:00.751710 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35848 (local address 127.20.240.253:35833)
0808 04:45:00.751841 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0808 04:45:00.751845 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:45:00.752006 (+ 161us) server_negotiation.cc:407] Connection header received
0808 04:45:00.752156 (+ 150us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:45:00.752159 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:45:00.752214 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:45:00.752298 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:45:00.752712 (+ 414us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35848: BlockingRecv error: recv got EOF from 127.0.0.1:35848 (error 108)
Metrics: {"server-negotiator.queue_time_us":65}
W20260808 04:45:00.760143 13752 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 04:45:00.758895 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35860 (local address 127.20.240.253:35833)
0808 04:45:00.759100 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0808 04:45:00.759104 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:45:00.759214 (+ 110us) server_negotiation.cc:407] Connection header received
0808 04:45:00.759388 (+ 174us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:45:00.759392 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:45:00.759468 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:45:00.759562 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:45:00.760018 (+ 456us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35860: BlockingRecv error: recv got EOF from 127.0.0.1:35860 (error 108)
Metrics: {"server-negotiator.queue_time_us":122}
W20260808 04:45:00.771973 13752 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 04:45:00.770590 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35876 (local address 127.20.240.253:35833)
0808 04:45:00.770745 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0808 04:45:00.770753 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 04:45:00.771027 (+ 274us) server_negotiation.cc:407] Connection header received
0808 04:45:00.771199 (+ 172us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:45:00.771202 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:45:00.771250 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:45:00.771322 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:45:00.771833 (+ 511us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35876: BlockingRecv error: recv got EOF from 127.0.0.1:35876 (error 108)
Metrics: {"server-negotiator.queue_time_us":62}
W20260808 04:45:00.791632 13752 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 04:45:00.790443 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35888 (local address 127.20.240.253:35833)
0808 04:45:00.790592 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0808 04:45:00.790598 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 04:45:00.790713 (+ 115us) server_negotiation.cc:407] Connection header received
0808 04:45:00.790850 (+ 137us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:45:00.790854 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:45:00.790919 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:45:00.791025 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:45:00.791504 (+ 479us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35888: BlockingRecv error: recv got EOF from 127.0.0.1:35888 (error 108)
Metrics: {"server-negotiator.queue_time_us":62}
W20260808 04:45:00.826932 13752 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 04:45:00.825819 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35904 (local address 127.20.240.253:35833)
0808 04:45:00.826024 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0808 04:45:00.826028 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:45:00.826077 (+ 49us) server_negotiation.cc:407] Connection header received
0808 04:45:00.826229 (+ 152us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:45:00.826232 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:45:00.826283 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:45:00.826358 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:45:00.826781 (+ 423us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35904: BlockingRecv error: recv got EOF from 127.0.0.1:35904 (error 108)
Metrics: {"server-negotiator.queue_time_us":96}
W20260808 04:45:00.894383 13752 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 04:45:00.893098 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35908 (local address 127.20.240.253:35833)
0808 04:45:00.893263 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0808 04:45:00.893268 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 04:45:00.893416 (+ 148us) server_negotiation.cc:407] Connection header received
0808 04:45:00.893611 (+ 195us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:45:00.893615 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:45:00.893676 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:45:00.893768 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:45:00.894241 (+ 473us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35908: BlockingRecv error: recv got EOF from 127.0.0.1:35908 (error 108)
Metrics: {"server-negotiator.queue_time_us":63}
W20260808 04:45:01.025956 13752 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 04:45:01.024752 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35918 (local address 127.20.240.253:35833)
0808 04:45:01.025033 (+ 281us) server_negotiation.cc:206] Beginning negotiation
0808 04:45:01.025037 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:45:01.025055 (+ 18us) server_negotiation.cc:407] Connection header received
0808 04:45:01.025175 (+ 120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:45:01.025178 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:45:01.025229 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:45:01.025327 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:45:01.025792 (+ 465us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35918: BlockingRecv error: recv got EOF from 127.0.0.1:35918 (error 108)
Metrics: {"server-negotiator.queue_time_us":174}
W20260808 04:45:01.285631 13752 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 04:45:01.284402 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35930 (local address 127.20.240.253:35833)
0808 04:45:01.284574 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0808 04:45:01.284578 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:45:01.284598 (+ 20us) server_negotiation.cc:407] Connection header received
0808 04:45:01.284728 (+ 130us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:45:01.284730 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:45:01.284783 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:45:01.284865 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:45:01.285493 (+ 628us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35930: BlockingRecv error: recv got EOF from 127.0.0.1:35930 (error 108)
Metrics: {"server-negotiator.queue_time_us":68}
I20260808 04:45:01.470813 13852 catalog_manager.cc:1259] Loaded cluster ID: 642ffdac431e4f95a486441bd32f36cd
I20260808 04:45:01.470943 13852 catalog_manager.cc:1552] T 00000000000000000000000000000000 P b4c3bf2e13c047d094ae3c505f9d0d29: loading cluster ID for follower catalog manager: success
I20260808 04:45:01.472628 13852 catalog_manager.cc:1574] T 00000000000000000000000000000000 P b4c3bf2e13c047d094ae3c505f9d0d29: acquiring CA information for follower catalog manager: success
I20260808 04:45:01.473874 13852 catalog_manager.cc:1602] T 00000000000000000000000000000000 P b4c3bf2e13c047d094ae3c505f9d0d29: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260808 04:45:01.494293 13867 catalog_manager.cc:1259] Loaded cluster ID: 642ffdac431e4f95a486441bd32f36cd
I20260808 04:45:01.494418 13867 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 638d4f10aff647c8be157e8b3dade74d: loading cluster ID for follower catalog manager: success
I20260808 04:45:01.496114 13867 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 638d4f10aff647c8be157e8b3dade74d: acquiring CA information for follower catalog manager: success
I20260808 04:45:01.497359 13867 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 638d4f10aff647c8be157e8b3dade74d: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260808 04:45:01.804041 13973 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:45:01.800095 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35944 (local address 127.20.240.253:35833)
0808 04:45:01.800379 (+ 284us) server_negotiation.cc:206] Beginning negotiation
0808 04:45:01.800384 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 04:45:01.800402 (+ 18us) server_negotiation.cc:407] Connection header received
0808 04:45:01.800461 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:45:01.800463 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:45:01.800602 (+ 139us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:45:01.800720 (+ 118us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 04:45:01.801020 (+ 300us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:45:01.801614 (+ 594us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:45:01.802480 (+ 866us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:45:01.802701 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:45:01.802795 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:45:01.803133 (+ 338us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 04:45:01.803610 (+ 477us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 04:45:01.803718 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0808 04:45:01.803766 (+ 48us) server_negotiation.cc:299] Negotiation successful
0808 04:45:01.803818 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":202,"thread_start_us":78,"threads_started":1}
I20260808 04:45:01.811358 13979 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:45:01.807389 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43604 (local address 127.20.240.252:37801)
0808 04:45:01.807625 (+ 236us) server_negotiation.cc:206] Beginning negotiation
0808 04:45:01.807629 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:45:01.807708 (+ 79us) server_negotiation.cc:407] Connection header received
0808 04:45:01.807917 (+ 209us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:45:01.807919 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:45:01.808060 (+ 141us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:45:01.808198 (+ 138us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 04:45:01.808366 (+ 168us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:45:01.808890 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:45:01.809847 (+ 957us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:45:01.810086 (+ 239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:45:01.810171 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:45:01.810431 (+ 260us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 04:45:01.810919 (+ 488us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 04:45:01.811041 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0808 04:45:01.811104 (+ 63us) server_negotiation.cc:299] Negotiation successful
0808 04:45:01.811156 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":162,"thread_start_us":67,"threads_started":1}
I20260808 04:45:01.818975 13973 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:45:01.814592 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35950 (local address 127.20.240.253:35833)
0808 04:45:01.814724 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0808 04:45:01.814728 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:45:01.815135 (+ 407us) server_negotiation.cc:407] Connection header received
0808 04:45:01.815327 (+ 192us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:45:01.815331 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:45:01.815404 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:45:01.815490 (+ 86us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 04:45:01.815816 (+ 326us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:45:01.816626 (+ 810us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:45:01.817701 (+ 1075us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:45:01.818036 (+ 335us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:45:01.818138 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:45:01.818425 (+ 287us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 04:45:01.818525 (+ 100us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 04:45:01.818595 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0808 04:45:01.818717 (+ 122us) server_negotiation.cc:299] Negotiation successful
0808 04:45:01.818784 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260808 04:45:01.819213 13979 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:45:01.814573 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43610 (local address 127.20.240.252:37801)
0808 04:45:01.814799 (+ 226us) server_negotiation.cc:206] Beginning negotiation
0808 04:45:01.814804 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 04:45:01.815026 (+ 222us) server_negotiation.cc:407] Connection header received
0808 04:45:01.815236 (+ 210us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:45:01.815240 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:45:01.815301 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:45:01.815350 (+ 49us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 04:45:01.815775 (+ 425us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:45:01.816614 (+ 839us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:45:01.817827 (+ 1213us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:45:01.818173 (+ 346us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:45:01.818265 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:45:01.818561 (+ 296us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 04:45:01.818636 (+ 75us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 04:45:01.818698 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0808 04:45:01.819010 (+ 312us) server_negotiation.cc:299] Negotiation successful
0808 04:45:01.819066 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":152}
I20260808 04:45:01.820847 13984 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:45:01.814586 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44684 (local address 127.20.240.254:39877)
0808 04:45:01.815150 (+ 564us) server_negotiation.cc:206] Beginning negotiation
0808 04:45:01.815158 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 04:45:01.815196 (+ 38us) server_negotiation.cc:407] Connection header received
0808 04:45:01.815444 (+ 248us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:45:01.815450 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:45:01.815631 (+ 181us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:45:01.815760 (+ 129us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 04:45:01.817045 (+ 1285us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:45:01.817887 (+ 842us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:45:01.818945 (+ 1058us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:45:01.819715 (+ 770us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:45:01.819835 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:45:01.820153 (+ 318us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 04:45:01.820445 (+ 292us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 04:45:01.820551 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0808 04:45:01.820637 (+ 86us) server_negotiation.cc:299] Negotiation successful
0808 04:45:01.820695 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":484,"thread_start_us":68,"threads_started":1}
I20260808 04:45:01.826072 21443 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu with pid 13592
I20260808 04:45:01.834568 21443 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu with pid 13677
I20260808 04:45:01.842901 21443 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgby_Qd/build/debug/bin/kudu with pid 13757
2026-08-08T04:45:01Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1 (3329 ms)
[----------] 2 tests from ConnectToFollowerMasterTest (6570 ms total)
[----------] Global test environment tear-down
[==========] 56 tests from 4 test suites ran. (301213 ms total)
[ PASSED ] 55 tests.
[ FAILED ] 1 test, listed below:
[ FAILED ] SecurityITest.TestJwtMiniCluster
1 FAILED TEST